Mistral-7B-Instruct-v0.1
Mistral-7B-Instruct-v0.1.
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Sep 2023 Mistral-7B-Instruct-v0.1
Open weights Small
No Epoch Capabilities Index score yet
- LiveSQLBench 2.83% #35 /36
- GTA 7.37% #12 /15
- Anthropic Red Team 71% #75 /75
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU-Pro | 25.8% | #187 of 212 | Official leaderboard | |
| EQ-Bench v2 | 52.1 | #76 of 85 | Official leaderboard | |
| RepoQA | 11% | #21 of 22 | Official leaderboard | |
| LMArena (Elo) | 1,110 | #321 of 333 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveSQLBench | 2.83% | #35 of 36 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 21 | #108 of 183 | Official leaderboard | |
| GTA | 7.37% | #12 of 15 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Anthropic Red Team | 71% | #75 of 75 | Official leaderboard | |
| HELM Safety | 52.5 | #75 of 75 | Official leaderboard | |
| SimpleSafetyTests | 43.3% | #75 of 75 | Official leaderboard |