- LiveCodeBench (10/01/2024-02/01/2025) 49.4
- MATH-500 95
- MMLU Pro 82.2
- GPQA Diamond 73.7
- Multilingual MMLU 85.8
- MMMU 76.1
Llama 4 Behemoth
Llama 4 Behemoth.
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Apr 2025 Llama 4 Behemoth
Flagship
No Epoch Capabilities Index score yet
- MMLU-Pro 82.2% #54 /151
- MMMLU 85.8% #27 /62
- MMMU 76.1% #18 /136
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Diamond | 73.7% | #148 of 284 | Model card | |
| MATH-500 | 95% | #40 of 67 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench | 49.4% | #44 of 73 | Model card |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMMU | 76.1% | #18 of 136 | Official leaderboard |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.