Mistral Small v24.09
Mistral Small v24.09.
Mistral AI Released 17 Sep 2024 7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Sep 2024 Mistral Small v24.09
Open weights
No Epoch Capabilities Index score yet
- BigCodeBench-Hard 14.8% #71 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 80.9 | #19 of 85 | Official leaderboard | |
| MMLU-Pro | 48.4% | #136 of 212 | Official leaderboard | |
| SuperGPQA | 25.9% | #46 of 58 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DTBench | 49.5% | #164 of 177 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 41.4% | #46 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 14.8% | #71 of 96 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Galileo Agent Leaderboard | 0.75 | #27 of 31 | Official leaderboard |