- MMLU PRO 87.2
- GPQA Diamond 69.3
- C-SimpleQA 67.9
- DROP F1 93.1
- Zebra Logic 79.6
- MATH-500 96.2
- AIME 2024 78.2
- LiveCodeBench 64.9
- CEval 91.8
- CMMLU 90
- ArenaHard 91.9
- CFBench 81
- CELLO 76.4
- T-Eval 68.8
Hunyuan-T1
Hunyuan-T1 places in the top three on DROP.
15
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Hunyuan-T1
Closed weights Flagship
No Epoch Capabilities Index score yet
- MMLU-Pro 87.2% #8 /151
- LiveCodeBench 64.9% #28 /73
- C-Eval 91.8% #9 /38
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DROP | 93.1% | #2 of 40 | Model card | |
| MMLU-Pro | 87.2% | #8 of 151 | Model card | |
| Arena-Hard-Auto | 91.9% | #7 of 39 | Model card | |
| C-Eval | 91.8% | #9 of 38 | Model card | |
| CMMLU | 90% | #6 of 17 | Model card | |
| LMArena (Elo) | 1,387 | #146 of 333 | Official leaderboard | |
| CFBench | 81% | #1 of 2 | Model card | |
| Chinese SimpleQA | 67.9% | #9 of 13 | Model card | |
| CELLO | 76.4% | #1 of 1 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH-500 | 96.2% | #33 of 67 | Model card | |
| AIME 2024 | 78.2% | #46 of 87 | Model card | |
| GPQA Diamond | 69.3% | #175 of 284 | Model card | |
| ZebraLogic | 79.6% | #18 of 23 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench | 64.9% | #28 of 73 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| T-Eval | 68.8% | #2 of 2 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.