Magistral-Small-2507 model card (Hugging Face) 24 Jul 2025
- AIME24 pass@1 72
- AIME25 pass@1 61
- GPQA Diamond 71.5
- Livecodebench (v5) 59.4
Magistral Medium 1.1.
Closed weights
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Diamond | 71.5% | #160 of 284 | Model card | |
| AIME 2024 | 72% | #58 of 87 | Model card | |
| AIME 2025 | 61% | #127 of 143 | Model card | |
| ARC-AGI | 6.12% | #88 of 96 | Epoch AI | |
| ARC-AGI-2 | 0% | #93 of 94 | Epoch AI |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench v5 | 59.4% | #27 of 44 | Model card |
The benchmarks the lab chose to headline, with the scores it gave.