Benchmark Almanac

PaLM 2-M

PaLM 2-M.

Released 17 May 2023
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab May 2023

PaLM 2-M

108.2 #229 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 88.6% #9 of 75 Epoch AI
HellaSwag 84% #14 of 74 Epoch AI
WinoGrande 79.2% #19 of 76 Epoch AI
TriviaQA 81.7% #13 of 38 Epoch AI
ARC-Challenge 64.9% #29 of 75 Epoch AI
OpenBookQA 57.4% #19 of 41 Epoch AI

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B CodeQwen1.5-7B internlm-20b internlm-7b open_llama_7b 50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B