Llama 3.3 70B
Llama 3.3 70B.
Meta Released 6 Dec 2024 30
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Dec 2024 Llama 3.3 70B
Open weights
127.3
#173 of 271
Epoch Capabilities Index
- CritPt 0% #120 /160
- GPQA Diamond 47.4% #157 /219
- LMCA 17.5% #110 /139
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 86.3% | #7 of 127 | Epoch AI | |
| LongBench v2 | 36.2% | #26 of 33 | Official leaderboard | |
| LLM Confabulation Leaderboard | 22.8% | #46 of 58 | Official leaderboard | |
| Fiction.LiveBench | 33.3% | #54 of 57 | Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ForecastBench | 61.3 | #21 of 83 | Epoch AI | |
| MATH Level 5 | 41.6% | #60 of 94 | Epoch AI | |
| GPQA Diamond | 47.4% | #157 of 219 | Epoch AI | |
| CritPt | 0% | #120 of 160 | Epoch AI | |
| DTBench | 32.5% | #145 of 178 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 5.14% | #171 of 202 | Epoch AI | |
| SimpleBench | 19.9% | #77 of 82 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigO(Bench) | 33.7% | #12 of 18 | Official leaderboard | |
| SWE-PolyBench | 6.02% | #4 of 6 | Official leaderboard | |
| WeirdML | 14.4% | #120 of 130 | Epoch AI |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BALROG | 23% | #21 of 35 | Official leaderboard | |
| Elimination Game | 4 | #36 of 56 | Official leaderboard | |
| Factorio Learning Environment | 54998.0 | #4 of 6 | Official leaderboard | |
| Step Race | 1 | #42 of 59 | Official leaderboard | |
| LLM Chess | -608 | #114 of 124 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LegalBench | 77.2% | #101 of 138 | Official leaderboard | |
| TaxEval v2 | 59.4% | #117 of 129 | Official leaderboard | |
| Vals Finance Agent v1 | 3.36% | #45 of 47 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| FORTRESS | 44.8% | #48 of 66 | Official leaderboard | |
| BaxBench | 10.7% | #26 of 34 | Official leaderboard | |
| Human Pathogen Capabilities Test v2 (HPCT v2) | 24.8% | #68 of 71 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Political Science LLM Benchmark | 66.9% | #10 of 29 | Official leaderboard | |
| LiveBench | 50.2% | #25 of 48 | Epoch AI | |
| ACCoRD | 45.5 | #118 of 150 | Official leaderboard | |
| LMCA | 17.5% | #110 of 139 | Epoch AI | |
| Conceptual Reasoning Index | 26.1 | #122 of 149 | Official leaderboard |
Meta's models over time
Meta's models in color, against every other model on the Epoch Capabilities Index, by release date.