Amazon Nova Pro
Amazon Nova Pro.
Amazon Released 3 Dec 2024 22
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Amazon Dec 2024 Amazon Nova Pro
Closed weights
No Epoch Capabilities Index score yet
- Humanity's Last Exam 4.40% #44 /47
- Vectara Hallucination Leaderboard (HHEM) 1.80% #132 /148
- VISTA 26.3% #49 /54
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (2025 dataset) | 5.10% | #10 of 104 | Official leaderboard | |
| MMLU | 82% | #18 of 127 | Epoch AI | |
| LMArena (Elo) | 1,290 | #232 of 333 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 1.80% | #132 of 148 | Official leaderboard | |
| LLM Confabulation Leaderboard | 30.1% | #54 of 58 | Official leaderboard | |
| Humanity's Last Exam | 4.40% | #44 of 47 | Official leaderboard | |
| Lech Mazur Creative Writing | 6.05 | #44 of 44 | Epoch AI |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 60.8% | #23 of 67 | Official leaderboard | |
| Galileo Agent Leaderboard | 0.87 | #17 of 31 | Official leaderboard | |
| Elimination Game | 4 | #37 of 56 | Official leaderboard | |
| LisanBench | 146.0 | #100 of 133 | Official leaderboard | |
| BFCL V4 | 25% | #52 of 65 | Official leaderboard | |
| Galileo Agent Leaderboard v2 | 29% | #17 of 21 | Official leaderboard | |
| ToolComp | 47% | #26 of 32 | Official leaderboard | |
| PACT | 1,426 | #25 of 26 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| TheAgentCompany | 1.70% | #13 of 14 | Epoch AI |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMMU | 62% | #53 of 136 | Official leaderboard | |
| VISTA | 26.3% | #49 of 54 | Official leaderboard | |
| Vision Arena | 1,018 | #126 of 136 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 88.5 | #5 of 71 | Official leaderboard | |
| LiveBench | 43.5% | #34 of 48 | Epoch AI | |
| HELM Capabilities | 59.1 | #45 of 60 | Official leaderboard |