GPT-4 Turbo Nov 2023
GPT-4 Turbo ranks first on 3 of the 23 benchmarks it has scores on.
OpenAI Released 6 Nov 2023
24
Benchmarks with a score
3
Ranked first, out of five or more models
3
In the top three
OpenAI Nov 2023
GPT-4 Turbo
Nov 2023 snapshot Closed weights
126.4
#179 of 271
Epoch Capabilities Index
- GPQA Diamond 42.4% #170 /219
- LMCA 9.78% #126 /139
- GTA 46.6% #1 /15
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AlpacaEval | 97.7% | #1 of 19 | Official leaderboard | |
| AlpacaEval 2.0 | 50% | #5 of 40 | Official leaderboard | |
| CriticEval | 7.86 | #1 of 8 | Official leaderboard | |
| MMLU | 79.6% | #26 of 127 | Epoch AI | |
| SEAL Multilingual | 1,034 | #9 of 19 | Official leaderboard | |
| LMArena (Elo) | 1,313 | #217 of 333 | Official leaderboard | |
| SEAL Precise Instruction Following | 79.5 | #17 of 18 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 40% | #62 of 94 | Epoch AI | |
| DTBench | 61.6% | #126 of 177 | Epoch AI | |
| GPQA Diamond | 42.4% | #170 of 219 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval+ | 81.7% | #10 of 46 | Official leaderboard | |
| MBPP+ | 73.3% | #8 of 35 | Official leaderboard | |
| SWE-bench | 12.5% | #5 of 9 | Official leaderboard | |
| SEAL Coding | 992 | #16 of 26 | Official leaderboard | |
| SWE-bench Lite | 28.3% | #10 of 15 | Official leaderboard | |
| METR Time Horizon | 9.4 min | #22 of 31 | Official leaderboard | |
| METR Time Horizon 1.1 | 4.0 min | #20 of 26 | Official leaderboard | |
| SWE-bench Verified | 22.4% | #52 of 60 | Official leaderboard |
Agents and tools
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Image2Struct | 45.6 | #11 of 18 | Official leaderboard | |
| VHELM | 46.1 | #27 of 41 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LMCA | 9.78% | #126 of 139 | Epoch AI |
OpenAI's models over time
OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.