Mistral Medium 3.1
Mistral Medium 3.1 places in the top three on Galileo Agent Leaderboard v2.
Mistral AI Released 12 Aug 2025 25
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Mistral AI Aug 2025 Mistral Medium 3.1
Closed weights
No Epoch Capabilities Index score yet
- CritPt 0% #139 /160
- CorpFin v2 50.7% #96 /119
- Vectara Hallucination Leaderboard (HHEM) 11.4% #15 /148
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (HHEM) | 11.4% | #15 of 148 | Official leaderboard | |
| LMArena (Elo) | 1,408 | #122 of 333 | Official leaderboard | |
| Creative Writing v3 | 66.3 | #65 of 120 | Official leaderboard | |
| Longform Creative Writing (EQ-Bench) | 46.2 | #91 of 119 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 22.7% | #101 of 104 | Official leaderboard | |
| Extended NYT Connections | 6.50% | #96 of 97 | Official leaderboard |
Math and science
Coding
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Galileo Agent Leaderboard v2 | 61% | #2 of 21 | Official leaderboard | |
| Step Race | 1 | #40 of 59 | Official leaderboard | |
| Elimination Game | 0 | #56 of 56 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| TaxEval v2 | 70.3% | #85 of 129 | Official leaderboard | |
| CorpFin v2 | 50.7% | #96 of 119 | Official leaderboard | |
| Vals Finance Agent v1 | 8.85% | #41 of 47 | Official leaderboard | |
| LegalBench | 62% | #128 of 138 | Official leaderboard | |
| MortgageTax | 36.5% | #83 of 86 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vision Arena | 1,160 | #97 of 136 | Official leaderboard | |
| ClockBench | 10.6% | #29 of 37 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Spiral-Bench v1.2 | 15.0 | #20 of 21 | Official leaderboard | |
| Human Pathogen Capabilities Test v2 (HPCT v2) | 24.3% | #70 of 71 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LMCA | 19.1% | #106 of 139 | Epoch AI | |
| Conceptual Reasoning Index | 28.4 | #117 of 149 | Official leaderboard | |
| ACCoRD | 39.2 | #131 of 150 | Official leaderboard |