Mistral-7B-Instruct-v0.2
Mistral-7B-Instruct-v0.2.
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Dec 2023 Mistral-7B-Instruct-v0.2
Open weights Small
No Epoch Capabilities Index score yet
- MixEval 70% #29 /34
- RepoQA 47.4% #17 /22
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 68.2 | #57 of 85 | Official leaderboard | |
| RepoQA | 47.4% | #17 of 22 | Official leaderboard | |
| WildBench | 30.7 | #39 of 47 | Official leaderboard | |
| MixEval | 70% | #29 of 34 | Official leaderboard | |
| MMLU-Pro | 30.8% | #181 of 212 | Official leaderboard | |
| Chinese SimpleQA | 15.6% | #24 of 27 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval+ | 36% | #37 of 46 | Official leaderboard | |
| MBPP+ | 37% | #32 of 35 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 15 | #169 of 183 | Official leaderboard |