o1-pro
o1-pro places in the top three on ToolComp.
OpenAI Released 19 Mar 2025
7
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
OpenAI Mar 2025
o1-pro
Closed weights
No Epoch Capabilities Index score yet
- Humanity's Last Exam 8.12% #32 /47
- Vectara Hallucination Leaderboard (HHEM) 2.40% #119 /148
- VISTA 47.3% #17 /54
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Humanity's Last Exam | 8.12% | #32 of 47 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 2.40% | #119 of 148 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ARC-AGI | 23.3% | #79 of 96 | Epoch AI | |
| USAMO 2025 | 2.83% | #9 of 10 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ToolComp | 67% | #3 of 32 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| VISTA | 47.3% | #17 of 54 | Official leaderboard | |
| EnigmaEval | 6.14% | #19 of 41 | Epoch AI |