GPT-4 Turbo Apr 2024
GPT-4 Turbo places in the top three on 5 benchmarks.
65
Benchmarks with a score
0
Ranked first, out of five or more models
5
In the top three
OpenAI Apr 2024
GPT-4 Turbo
Apr 2024 snapshot Closed weights Flagship
127.3
#174 of 271
Epoch Capabilities Index
- GPQA Diamond 46.6% #161 /219
- KOR-Bench 53.5% #7 /33
- Vectara Hallucination Leaderboard (HHEM) 1.70% #134 /148
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 86.3 | #2 of 85 | Official leaderboard | |
| AlpacaEval 2.0 | 55% | #2 of 40 | Official leaderboard | |
| MixEval | 88.8% | #2 of 34 | Official leaderboard | |
| MMLU-CF | 70.4% | #3 of 37 | Official leaderboard | |
| WildBench | 56.1 | #4 of 47 | Official leaderboard | |
| MGSM | 89.6% | #13 of 52 | Model card | |
| MMBench-CN v1.1 | 79.5% | #49 of 178 | Official leaderboard | |
| Chinese SimpleQA | 49.1% | #8 of 27 | Official leaderboard | |
| MMLU | 86.7% | #43 of 127 | Model card | |
| DROP | 86% | #14 of 40 | Model card | |
| RepoQA | 76.4% | #9 of 22 | Official leaderboard | |
| ThaiExam | 57.5% | #10 of 24 | Official leaderboard | |
| RewardBench | 84% | #21 of 48 | Official leaderboard | |
| SEAL Precise Instruction Following | 83.2 | #8 of 18 | Official leaderboard | |
| MMLU-Pro | 63.7% | #103 of 212 | Official leaderboard | |
| SEAL Multilingual | 1,020 | #11 of 19 | Official leaderboard | |
| LMArena (Elo) | 1,325 | #201 of 333 | Official leaderboard | |
| LLM Confabulation Leaderboard | 28.4% | #52 of 58 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 1.70% | #134 of 148 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ForecastBench | 52.5 | #5 of 86 | Official leaderboard | |
| KOR-Bench | 53.5% | #7 of 33 | Official leaderboard | |
| ZebraLogic | 28.4% | #12 of 46 | Official leaderboard | |
| GSM1k | 95.1% | #5 of 15 | Official leaderboard | |
| MATH | 73.4% | #36 of 93 | Model card | |
| MATH Level 5 | 46.7% | #55 of 94 | Epoch AI | |
| GPQA Diamond | 46.6% | #161 of 219 | Epoch AI | |
| DTBench | 36% | #135 of 178 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 6.67% | #163 of 202 | Epoch AI | |
| SimpleBench | 25.1% | #85 of 100 | Official leaderboard | |
| FrontierMath Tiers 1-3 v2 | 0.70% | #86 of 89 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 53.2% | #7 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 32.1% | #10 of 96 | Official leaderboard | |
| HumanEval+ | 86.6% | #5 of 46 | Official leaderboard | |
| CRUXEval | 82% | #2 of 11 | Official leaderboard | |
| HumanEval | 88.2% | #24 of 95 | Model card | |
| MHPP | 43.8% | #6 of 23 | Official leaderboard | |
| SEAL Coding | 1,034 | #12 of 26 | Official leaderboard | |
| SciCode | 1.50% | #10 of 18 | Official leaderboard | |
| METR Time Horizon | 7.8 min | #23 of 31 | Official leaderboard | |
| LiveCodeBench v6 | 28.7% | #18 of 21 | Official leaderboard | |
| METR Time Horizon 1.1 | 3.7 min | #23 of 26 | Official leaderboard | |
| LiveCodeBench v5 | 28.6% | #19 of 21 | Official leaderboard | |
| WeirdML | 18% | #104 of 112 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ToolComp | 60.8% | #14 of 32 | Official leaderboard | |
| LLM Chess | -104 | #74 of 124 | Official leaderboard | |
| LisanBench | 300.0 | #80 of 133 | Official leaderboard | |
| GAIA | 11% | #50 of 57 | Official leaderboard | |
| AndroidWorld | 30.6% | #9 of 10 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LegalBench | 80.5% | #82 of 138 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-EN v1.1 | 80% | #53 of 178 | Official leaderboard | |
| LongVideoBench | 60.7% | #4 of 13 | Official leaderboard | |
| MathVista | 58.1% | #21 of 43 | Official leaderboard | |
| VHELM | 51.5 | #22 of 41 | Official leaderboard | |
| MATH-Vision (MathVision) | 30.3% | #74 of 105 | Official leaderboard | |
| Vision Arena | 1,112 | #115 of 136 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Anthropic Red Team | 99.7% | #10 of 75 | Official leaderboard | |
| OR-Bench | 12.8% | #6 of 28 | Official leaderboard | |
| HELM Safety | 96.1 | #19 of 75 | Official leaderboard | |
| AIR-Bench 2024 | 71.9% | #33 of 82 | Official leaderboard | |
| SimpleSafetyTests | 99% | #32 of 75 | Official leaderboard | |
| SEAL Adversarial Robustness | 20.0 | #6 of 8 | Official leaderboard | |
| AgentDojo | 28.6% | #17 of 20 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 86.4 | #7 of 71 | Official leaderboard | |
| ACCoRD | 42.2 | #127 of 150 | Official leaderboard | |
| Conceptual Reasoning Index | 21.5 | #131 of 149 | Official leaderboard |
OpenAI's models over time
OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.