Benchmark Almanac

Nemotron 3 Ultra

Nemotron 3 Ultra ranks first on IMO-ProofBench.

NVIDIA Released 4 Jun 2026
77
Benchmarks with a score
1
Ranked first, out of five or more models
4
In the top three
NVIDIA Jun 2026

Nemotron 3 Ultra

Open weights

146.0 #86 of 271
Epoch Capabilities Index
  • IFBench 81.7% #4 /70
  • SciCode 44.6% #20 /47
  • AA-LCR (Artificial Analysis Long Context Reasoning) 65.4% #15 /31

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
IFBench 81.7% #4 of 70 Model card
MMLU-Pro 86.8% #12 of 151 Model card
RULER 94.7% #8 of 38 Model card
LMArena (Elo) 1,427 #93 of 333 Official leaderboard
MMLU-ProX 83% #5 of 17 Model card
LongBench v2 61.9% #8 of 27 Model card
BullshitBench 41.8% #33 of 107 Official leaderboard
MultiChallenge 63.8% #12 of 36 Model card
BullshitBench V2 49% #46 of 122 Official leaderboard
AA-LCR (Artificial Analysis Long Context Reasoning) 65.4% #15 of 31 Model card
Humanity's Last Exam 26.7% #80 of 147 Model card
AA-Omniscience 24.1% #10 of 17 Model card
SEA-HELM 64.1 #43 of 62 Official leaderboard
WMT24++ 83.7% #10 of 12 Model card

Math and science

BenchmarkScoreRankSource
IMO-AnswerBench 88.6% #7 of 37 Model card
IMO-ProofBench 82.3% #1 of 5 Model card
MathArena (Apex, IMO, USAMO) 74.9% #3 of 13 Model card
DTBench 83.5% #48 of 178 Official leaderboard
GPQA Diamond 85.3% #70 of 219 Epoch AI
USAMO 2026 97.6% #2 of 6 Model card
OTIS Mock AIME 2024-2025 86.7% #73 of 202 Epoch AI
CritPt 3.14% #79 of 160 Epoch AI
SimpleBench 41.7% #64 of 100 Official leaderboard
IMO 2025 83.3% #4 of 6 Model card
ProofBench 2.00% #56 of 59 Official leaderboard
LatchBio Capabilities v1.0 24.2% #26 of 27 Official leaderboard

Coding

BenchmarkScoreRankSource
LiveCodeBench v6 89% #9 of 76 Model card
SciCode 44.6% #20 of 47 Model card
SWE-bench Verified 70.7% #71 of 150 Model card
StructEval 74.3% #15 of 28 Official leaderboard
WeirdML 43.5% #65 of 112 Official leaderboard
SWE-bench Multilingual 67.7% #45 of 70 Model card
Vibe Code Bench 7.64% #99 of 115 Official leaderboard
Code Migration 4.91% #72 of 78 Official leaderboard
FrontierCode 13.6% #43 of 46 Epoch AI

Agents and tools

BenchmarkScoreRankSource
PinchBench 2.0 89.9% #4 of 57 Official leaderboard
tau3-bench 86.9% #2 of 12 Model card
PinchBench 90% #5 of 13 Model card
SnakeBench 24 #87 of 183 Official leaderboard
Mystery Game Puzzles 20% #46 of 80 Epoch AI
τ³-bench Banking 22.6% #12 of 20 Model card
MCP Atlas 63.1% #26 of 34 Official leaderboard
BrowseComp 44.4% #64 of 77 Model card
Terminal-Bench 2.1 56.4% #45 of 53 Model card
Agent Arena -0.16 #50 of 53 Official leaderboard
Toolathlon-Verified 34.3% #24 of 25 Official leaderboard
Pencil Puzzle Bench 0% #53 of 53 Official leaderboard

Professional work

BenchmarkScoreRankSource
CorpFin v2 65.5% #28 of 119 Official leaderboard
TaxEval v2 73.1% #51 of 129 Official leaderboard
ProfBench 56% #1 of 2 Model card
LegalBench 82.1% #74 of 138 Official leaderboard
MedCode 38.6% #66 of 96 Official leaderboard
Vals Finance Agent 60.1% #6 of 8 Model card
Harvey LAB (Legal Agent Benchmark) 0.42% #63 of 80 Official leaderboard
Legal Research Bench 15.4% #71 of 88 Official leaderboard
Vals Finance Agent v2 37.7% #67 of 80 Official leaderboard
Excel Modeling Benchmark 31.7% #65 of 76 Official leaderboard
JobBench 27.2% #14 of 16 Official leaderboard
APEX-Agents 22.7% #54 of 56 Epoch AI
GDPval 46.7% #10 of 10 Model card

Safety and security

BenchmarkScoreRankSource
FORTRESS 26.4% #35 of 66 Official leaderboard
DistressBench 62.1% #38 of 42 Official leaderboard
TxBench-Antibody-Discovery 21% #26 of 28 Official leaderboard
TxBench-Oligo-Discovery 25.1% #26 of 28 Official leaderboard
OncologyBench 1.33% #28 of 30 Official leaderboard
BioSecBench-Refusal 0% #21 of 22 Official leaderboard
MetagenomicsBench 16.3% #25 of 26 Official leaderboard
BioSecBench-Function 21.6% #26 of 27 Official leaderboard
BioSecBench-Surveillance 21.2% #26 of 27 Official leaderboard
EpiBench 11.3% #26 of 27 Official leaderboard
scBench-Long 3.03% #26 of 27 Official leaderboard
SpatialBench-Long 15.9% #26 of 27 Official leaderboard
VariantBench 17.8% #26 of 27 Official leaderboard
TxBench-Preclinical-Pharmacology 22.7% #27 of 28 Official leaderboard

Other

BenchmarkScoreRankSource
Conceptual Reasoning Index 51.8 #63 of 149 Official leaderboard
LMCA 36.9% #65 of 139 Epoch AI
ACCoRD 64.6 #74 of 150 Official leaderboard

NVIDIA's models over time

NVIDIA's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Nemotron 3 Ultra Nemotron-4 15B 50 75 100 125 150 175 2023 2024 2025 2026 2027 Nemotron 3 Ultra Nemotron-4 15B

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 4 of them aren't in the launch post.

Hallucination