GPT-3.5 Turbo Nov 2023
GPT-3.5 Turbo ranks first on ANLI.
OpenAI Released 6 Nov 2023
23
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
OpenAI Nov 2023
GPT-3.5 Turbo
Nov 2023 snapshot Closed weights
118.5
#203 of 271
Epoch Capabilities Index
- SimpleQA Verified 11.2% #45 /56
- GPQA Diamond 28% #202 /219
- ANLI 58.1% #1 /11
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ANLI | 58.1% | #1 of 11 | Epoch AI | |
| ARC-Challenge | 87.4% | #7 of 75 | Epoch AI | |
| OpenBookQA | 86% | #4 of 41 | Epoch AI | |
| TriviaQA | 85.8% | #6 of 38 | Epoch AI | |
| MMLU | 71.4% | #51 of 127 | Epoch AI | |
| EQ-Bench v2 | 71.7 | #49 of 85 | Official leaderboard | |
| WinoGrande | 68.8% | #51 of 76 | Epoch AI | |
| AlpacaEval | 86.3% | #13 of 19 | Official leaderboard | |
| AlpacaEval 2.0 | 19.3% | #29 of 40 | Official leaderboard | |
| SimpleQA Verified | 11.2% | #45 of 56 | Official leaderboard | |
| LMArena (Elo) | 1,204 | #280 of 333 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 15.9% | #80 of 94 | Epoch AI | |
| GPQA Diamond | 28% | #202 of 219 | Epoch AI | |
| DTBench | 14.2% | #169 of 178 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MBPP+ | 69.7% | #13 of 35 | Official leaderboard | |
| HumanEval+ | 70.7% | #18 of 46 | Official leaderboard | |
| CodeEditorBench | 72.4% | #5 of 7 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Anthropic Red Team | 98% | #57 of 75 | Official leaderboard | |
| AIR-Bench 2024 | 52.5% | #63 of 82 | Official leaderboard | |
| SimpleSafetyTests | 92.3% | #68 of 75 | Official leaderboard | |
| HELM Safety | 83.5 | #69 of 75 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Conceptual Reasoning Index | 12.7 | #141 of 149 | Official leaderboard | |
| ACCoRD | 20.2 | #145 of 150 | Official leaderboard |
OpenAI's models over time
OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.