Llama-3.3-Nemotron-Super-49B-v1
Llama-3.3-Nemotron-Super-49B-v1 places in the top three on MBPP.
13
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
NVIDIA Mar 2025 Llama-3.3-Nemotron-Super-49B-v1
Open weights Mid-size
No Epoch Capabilities Index score yet
- LiveCodeBench v5 45.5% #35 /44
- Misguided Attention 57.4% #8 /45
- AIME 2025 60% #128 /143
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MT-Bench | 9.17 | #4 of 23 | Model card | |
| IFEval | 89.2% | #35 of 126 | Model card | |
| Arena-Hard-Auto | 88.3% | #13 of 39 | Model card | |
| LMArena (Elo) | 1,328 | #197 of 333 | Official leaderboard | |
| JudgeBench | 69.7% | #2 of 2 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Misguided Attention | 57.4% | #8 of 45 | Official leaderboard | |
| MATH-500 | 96.6% | #25 of 67 | Model card | |
| GPQA Diamond | 66.7% | #184 of 284 | Model card | |
| AIME 2024 | 67.5% | #68 of 87 | Model card | |
| AIME 2025 | 60% | #128 of 143 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MBPP | 91.3% | #2 of 66 | Model card | |
| LiveCodeBench v5 | 45.5% | #35 of 44 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 73.7% | #12 of 47 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 3 of them aren't in the launch post.
Llama-Nemotron: Efficient Reasoning Models 2 May 2025
Capabilities
- GPQA Diamond 66.7
- AIME 2024 67.5
- AIME 2025 60
- MATH-500 96.6
- Berkeley Function Calling Leaderboard (BFCL) 73.7
- LiveCodeBench v5 45.5
- IFEval 89.2
- Arena-Hard-Auto 88.3
- JudgeBench 69.7