Benchmark Almanac

Llama-3.3-Nemotron-Super-49B-v1.5

Llama-3.3-Nemotron-Super-49B-v1.5.

NVIDIA Released 25 Jul 2025 Family Llama Nemotron The lab's model card
11
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
NVIDIA Jul 2025

Llama-3.3-Nemotron-Super-49B-v1.5

Open weights Mid-size

No Epoch Capabilities Index score yet
  • LiveCodeBench v5 73.6% #4 /44
  • MMLU-Pro 79.5% #79 /151
  • AIME 2025 82.7% #84 /143

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Arena-Hard-Auto 92% #6 of 39 Model card
IFEval 88.6% #41 of 126 Model card
MMLU-Pro 79.5% #79 of 151 Model card
LMArena (Elo) 1,343 #184 of 333 Official leaderboard
Humanity's Last Exam 7.64% #140 of 147 Model card

Math and science

BenchmarkScoreRankSource
MATH-500 97.4% #15 of 67 Model card
AIME 2024 87.5% #25 of 87 Model card
GPQA Diamond 72% #156 of 284 Model card
AIME 2025 82.7% #84 of 143 Model card

Coding

BenchmarkScoreRankSource
LiveCodeBench v5 73.6% #4 of 44 Model card

Agents and tools

BenchmarkScoreRankSource
Berkeley Function Calling Leaderboard (BFCL) 71.8% #18 of 47 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.