Benchmark Almanac

GPT-3 175B (davinci)

GPT-3 175B (davinci).

OpenAI Released 28 May 2020
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenAI May 2020

GPT-3 175B (davinci)

Closed weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
HellaSwag 77.5% #34 of 74 Epoch AI
BoolQ 76.4% #3 of 3 Official leaderboard
CB 75.6% #3 of 3 Official leaderboard
SuperGLUE 71.8% #3 of 3 Official leaderboard
WSC 80.1% #3 of 3 Official leaderboard
PIQA 82.8% #1 of 1 Official leaderboard

Math and science

BenchmarkScoreRankSource
GSM8K 9.00% #72 of 82 Epoch AI

Coding

BenchmarkScoreRankSource
METR Time Horizon 0.1 min #38 of 39 Epoch AI