Benchmark Almanac

PaLM 62B

PaLM 62B.

Released 4 Apr 2022
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Apr 2022

PaLM 62B

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 84.8% #25 of 75 Epoch AI
WinoGrande 77% #27 of 76 Epoch AI
PIQA 80.5% #33 of 58 Epoch AI
ARC-Challenge 52.5% #45 of 75 Epoch AI
OpenBookQA 50.4% #28 of 41 Epoch AI
MMLU 53.7% #96 of 127 Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 33% #53 of 82 Epoch AI