- Wildbench v2 65.3
- Arena Hard v2 43.1
- IF (Internal; accuracy) 84.8
- Infinite Generations (Internal; lower is better) 1.29
- MMLU 80.5
- MMLU Pro (5-shot CoT) 69.1
- MATH 69.4
- GPQA Main (5-shot CoT) 44.2
- GPQA Diamond (5-shot CoT) 46.1
- MBPP Plus - Pass@5 78.3
- HumanEval Plus - Pass@5 92.9
- SimpleQA (TotalAcc) 12.1
- MMMU 62.5
- Mathvista 67.1
- ChartQA 87.4
- DocVQA 94.9
- AI2D 92.9
Mistral Small 3.2
Mistral Small 3.2 places in the top three on GPQA Main.
Mistral AI Released 20 Jun 2025 33
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Mistral AI Jun 2025 Mistral Small 3.2
Open weights
No Epoch Capabilities Index score yet
- CritPt 0% #136 /160
- GPQA Diamond 49% #148 /219
- Human Pathogen Capabilities Test v2 (HPCT v2) 27.9% #66 /71
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Slop Score | 52.7 | #8 of 17 | Official leaderboard | |
| LMArena (Elo) | 1,356 | #169 of 333 | Official leaderboard | |
| Phare | 64.5% | #35 of 62 | Official leaderboard | |
| MMLU | 80.5% | #72 of 127 | Model card | |
| Wer wird Millionär? LLM Benchmark | 933.0 | #49 of 76 | Official leaderboard | |
| EQ-Bench 3 | 1,091 | #56 of 78 | Official leaderboard | |
| MMLU-Pro | 69.1% | #113 of 151 | Model card | |
| Creative Writing v3 | 57.2 | #90 of 120 | Official leaderboard | |
| SimpleQA | 12.1% | #46 of 59 | Model card | |
| Longform Creative Writing (EQ-Bench) | 41.6 | #97 of 119 | Official leaderboard | |
| Judgemark v2.1 | 50.2 | #39 of 42 | Official leaderboard | |
| Arena-Hard v2.0 | 43.1% | #24 of 24 | Model card | |
| IFEval (Mistral internal version) | 84.8% | #2 of 2 | Model card | |
| Infinite Generations (Mistral internal) | 1.29% | #1 of 1 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Main | 44.2% | #3 of 7 | Model card | |
| MATH | 69.4% | #42 of 93 | Model card | |
| OTIS Mock AIME 2024-2025 | 30.3% | #136 of 202 | Epoch AI | |
| GPQA Diamond | 49% | #148 of 219 | Epoch AI | |
| DTBench | 33.1% | #143 of 178 | Official leaderboard | |
| CritPt | 0% | #136 of 160 | Epoch AI | |
| Verifying the Verifiers (Project APE CRED benchmark) | 19% | #21 of 23 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval+ | 92.9% | #4 of 27 | Model card | |
| MBPP+ | 78.3% | #7 of 15 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BFCL V4 | 37.1% | #32 of 65 | Official leaderboard | |
| Galileo Agent Leaderboard v2 | 26% | #18 of 21 | Official leaderboard | |
| LisanBench | 52.7 | #122 of 133 | Official leaderboard |
Vision, audio and robotics
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Human Pathogen Capabilities Test v2 (HPCT v2) | 27.9% | #66 of 71 | Official leaderboard |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.