Hermes 2 Theta Llama-3 70B
Hermes 2 Theta Llama-3 70B.
Nous Research Released 20 Jun 2024
5
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Nous Research Jun 2024
Hermes 2 Theta Llama-3 70B
Open weights
No Epoch Capabilities Index score yet
- GPQA Diamond 37.5% #182 /219
- BigCodeBench-Hard 22.3% #53 /96
- OTIS Mock AIME 2024-2025 2.50% #183 /202
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 22.7% | #75 of 94 | Epoch AI | |
| GPQA Diamond | 37.5% | #182 of 219 | Epoch AI | |
| OTIS Mock AIME 2024-2025 | 2.50% | #183 of 202 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 50.6% | #20 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 22.3% | #53 of 96 | Official leaderboard |