davinci-002
davinci-002.
OpenAI Released 15 Mar 2022
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenAI Mar 2022
davinci-002
Closed weights
No Epoch Capabilities Index score yet
- Situational Awareness Dataset (SAD) 30.1% #17 /17
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ARC-Challenge | 85.2% | #11 of 75 | Epoch AI | |
| WinoGrande | 81.6% | #12 of 76 | Epoch AI | |
| BoolQ | 87.7% | #13 of 75 | Epoch AI | |
| HellaSwag | 81.5% | #24 of 74 | Epoch AI | |
| MMLU | 70% | #55 of 127 | Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 56.8% | #31 of 82 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| METR Time Horizon 1.1 | 0.1 min | #25 of 26 | Official leaderboard | |
| METR Time Horizon | 0.1 min | #30 of 31 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Situational Awareness Dataset (SAD) | 30.1% | #17 of 17 | Official leaderboard |