Llama 3.2 90B
Llama 3.2 90B.
Meta Released 24 Sep 2024 31
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Sep 2024 Llama 3.2 90B
Open weights
125.5
#182 of 271
Epoch Capabilities Index
- ZeroBench 0% #63 /66
- GPQA Diamond 41% #172 /219
- VisualPuzzles 34.1% #16 /29
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 80.3% | #21 of 127 | Epoch AI | |
| EQ-Bench v2 | 82.0 | #16 of 85 | Official leaderboard | |
| MMBench-CN v1.1 | 75.2% | #77 of 178 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 4.30% | #77 of 148 | Official leaderboard | |
| SEAL Precise Instruction Following | 82.1 | #12 of 18 | Official leaderboard | |
| SEAL Multilingual | 944 | #17 of 19 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 39.4% | #63 of 94 | Epoch AI | |
| GPQA Diamond | 41% | #172 of 219 | Epoch AI | |
| U-MATH | 37.2% | #24 of 30 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 2.64% | #180 of 202 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval-V | 4.00% | #14 of 24 | Official leaderboard | |
| SEAL Coding | 984 | #18 of 26 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 25 | #76 of 183 | Official leaderboard | |
| BALROG | 27.3% | #20 of 35 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MortgageTax | 38.8% | #82 of 86 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-EN v1.1 | 79.5% | #58 of 178 | Official leaderboard | |
| MMBench | 80.4% | #52 of 155 | Official leaderboard | |
| CharXiv | 37.5% | #27 of 77 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 54.1% | #54 of 152 | Official leaderboard | |
| MMMU | 60.3% | #54 of 136 | Official leaderboard | |
| MMStar | 55.3% | #80 of 173 | Official leaderboard | |
| MMVU | 47.1% | #14 of 28 | Official leaderboard | |
| VisualPuzzles | 34.1% | #16 of 29 | Official leaderboard | |
| MMMU-Pro | 39.5% | #35 of 57 | Official leaderboard | |
| GeoBench | 52% | #40 of 48 | Official leaderboard | |
| Vision Arena | 1,032 | #122 of 136 | Official leaderboard | |
| ZeroBench | 0% | #63 of 66 | Official leaderboard | |
| VISTA | 24.6% | #52 of 54 | Official leaderboard | |
| EnigmaEval | 0.38% | #41 of 41 | Epoch AI |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 81.9 | #11 of 71 | Official leaderboard | |
| OpenVLM Leaderboard | 63.4 | #70 of 173 | Official leaderboard |
Meta's models over time
Meta's models in color, against every other model on the Epoch Capabilities Index, by release date.