Ministral 3B
Ministral 3B.
Mistral AI Released 16 Oct 2024 12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Oct 2024 Ministral 3B
Closed weights
118.0
#206 of 271
Epoch Capabilities Index
- SimpleQA Verified 5.43% #55 /56
- GPQA Diamond 25.3% #210 /219
- Vectara Hallucination Leaderboard (HHEM) 8.30% #29 /148
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (HHEM) | 8.30% | #29 of 148 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 7.30% | #34 of 104 | Official leaderboard | |
| SimpleQA Verified | 5.43% | #55 of 56 | Official leaderboard | |
| ECLeKTic | 0.64% | #35 of 35 | Official leaderboard | |
| FACTS Grounding | 52.2% | #34 of 34 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 14.4% | #83 of 94 | Epoch AI | |
| DTBench | 19.6% | #158 of 178 | Official leaderboard | |
| GPQA Diamond | 25.3% | #210 of 219 | Epoch AI |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 9 | #178 of 183 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LMCA | 5.48% | #134 of 139 | Epoch AI | |
| Conceptual Reasoning Index | 10.1 | #147 of 149 | Official leaderboard | |
| ACCoRD | 14.6 | #148 of 150 | Official leaderboard |
Mistral AI's models over time
Mistral AI's models in color, against every other model on the Epoch Capabilities Index, by release date.