- KMMLU (0-shot) 77
- Hae-Rae 1.0 86.2
- KBL (law) 75.5
- KBankMMLU (finance, private benchmark built with Korean financial institutions) 71
- KorMedMCQA (medical) 87.4
- MMLU (0-shot, CoT) 88.2
- MMLU-Pro 76.5
- IFEval 87.8
- Arena-Hard-v2.0 46.2
- HumanEval (0-shot) 98.8
- SWE Bench (Agentless) 40.8
- Math500 95.4
- AIME'24 pass@1 76.5
- AIME'25 pass@1 69.1
- BFCL.v3 63.9
Solar Pro 2
Solar Pro 2 ranks first on 2 of the 11 benchmarks it has scores on.
15
Benchmarks with a score
2
Ranked first, out of five or more models
2
In the top three
Upstage Jul 2025 Solar Pro 2
Closed weights Flagship
No Epoch Capabilities Index score yet
- KMMLU 77% #1 /6
- MMLU-Pro 76.5% #95 /151
- AIME 2025 69.1% #114 /143
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| KMMLU | 77% | #1 of 6 | Model card | |
| MMLU | 88.2% | #28 of 127 | Model card | |
| HAE-RAE Bench | 86.2% | #1 of 3 | Model card | |
| IFEval | 87.8% | #49 of 126 | Model card | |
| MMLU-Pro | 76.5% | #95 of 151 | Model card | |
| Arena-Hard v2.0 | 46.2% | #22 of 24 | Model card |
Math and science
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval | 98.8% | #1 of 95 | Model card | |
| SWE-bench Verified | 40.8% | #139 of 150 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 63.9% | #37 of 47 | Model card |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| KBL | 75.5% | #2 of 4 | Model card | |
| KBank-MMLU (Upstage) | 71% | #2 of 3 | Model card | |
| KorMedMCQA | 87.4% | #3 of 4 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.