Benchmark Almanac

NVIDIA

Best on the Capabilities Index Nemotron 3 Ultra 146.0
29 models 20 model cards read nvidia.com

NVIDIA's models against the field

Every model on the Epoch Capabilities Index by release date, with NVIDIA's in color.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Nemotron 3 Ultra Nemotron-4 15B 50 75 100 125 150 175 2023 2024 2025 2026 2027 Nemotron 3 Ultra Nemotron-4 15B

Its strongest models

NVIDIA Jun 2026

Nemotron 3 Ultra

Open weights

146.0 #86 of 271
Epoch Capabilities Index
  • IFBench 81.7% #4 /70
  • SciCode 44.6% #20 /47
  • AA-LCR (Artificial Analysis Long Context Reasoning) 65.4% #15 /31
NVIDIA Feb 2024

Nemotron-4 15B

Closed weights

107.6 #232 of 271
Epoch Capabilities Index

What its model cards measure

Tall ticks are NVIDIA model cards that list the benchmark in their headline table. Gray dots are cards that leave it out. Rows are the benchmarks the lab listed most, at least twice each, in the order it started using them.

GPQA Diamond AIME 2025 Berkeley Function Calling Leaderboard (BFCL) MATH-500 IFEval RoboCasa RoboCasa GR1 Tabletop Tasks LiveCodeBench v5 OCRBench v2 Video-MME Humanity's Last Exam MMLU-Pro RULER OCR-Reasoning IFBench SciCode SWE-bench Verified tau2-bench AA-LCR (Artificial Analysis Long Context Reasoning) MultiChallenge MMLU-ProX WMT24++ LiveCodeBench v6 BrowseComp SWE-bench Multilingual Terminal-Bench 2.1 τ³-bench Banking AA-Omniscience

Model cards

DateModelDocumentBenchmarks
23 Oct 2026 Nemotron 3.5 Bolt E4B NVIDIA-Nemotron-3.5-Bolt-E4B-4GB model card (Hugging Face) 21
15 Oct 2026 Nemotron 3.5 Bolt 74B-A9B NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB model card (Hugging Face) 12
15 Oct 2026 Nemotron 3.5 Super VL NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 model card (Hugging Face) 35
11 Aug 2026 Nemotron 3.5 Lightning 30B-A3B NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card (Hugging Face) 14
7 Jul 2026 GR00T N1.7 GR00T N1.7 General Release: benchmark example results (Isaac-GR00T GitHub) 4
4 Jun 2026 Nemotron 3 Ultra NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 model card (Hugging Face) 27
28 Apr 2026 Nemotron 3 Nano Omni 30B-A3B Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 model card (Hugging Face) 12
19 Mar 2026 Nemotron-Cascade 2 30B-A3B Nemotron-Cascade-2-30B-A3B model card (Hugging Face) 28
16 Mar 2026 Nemotron 3 Nano 4B NVIDIA-Nemotron-3-Nano-4B-BF16 model card (Hugging Face) 12
11 Mar 2026 Nemotron 3 Super NVIDIA-Nemotron-3-Super-120B-A12B-BF16 model card (Hugging Face) 21
16 Dec 2025 GR00T N1.6 GR00T N1.6 release: benchmark example results (Isaac-GR00T GitHub) 5
15 Dec 2025 Nemotron 3 Nano 30B-A3B NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 model card (Hugging Face) 18
28 Oct 2025 Nemotron Nano 12B v2 VL NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 model card (Hugging Face) 9
18 Aug 2025 nvidia-nemotron-nano-9b-v2 NVIDIA-Nemotron-Nano-9B-v2 model card (Hugging Face) 8
25 Jul 2025 Llama-3.3-Nemotron-Super-49B-v1.5 Llama-3_3-Nemotron-Super-49B-v1_5 model card (Hugging Face) 10
11 Jun 2025 GR00T N1.5 GR00T N1.5: An Improved Open Foundation Model for Generalist Humanoid Robots (NVIDIA GEAR) 2
3 Jun 2025 Llama-3.1-Nemotron-Nano-VL-8B-V1 Llama-3.1-Nemotron-Nano-VL-8B-V1 model card (Hugging Face) 8
7 Apr 2025 Llama-3.1-Nemotron-Ultra-253B-v1 Llama-3_1-Nemotron-Ultra-253B-v1 model card (Hugging Face) 7
18 Mar 2025 GR00T N1 GR00T N1: An Open Foundation Model for Generalist Humanoid Robots (NVIDIA white paper) 2
18 Mar 2025 Llama-3.3-Nemotron-Super-49B-v1 Llama-3_3-Nemotron-Super-49B-v1 model card (Hugging Face) 8

Every NVIDIA model