Benchmark Almanac

PaLM 2-S

PaLM 2-S.

Released 17 May 2023
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab May 2023

PaLM 2-S

106.1 #236 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 88.1% #12 of 75 Epoch AI
HellaSwag 82% #23 of 74 Epoch AI
WinoGrande 77.9% #24 of 76 Epoch AI
ARC-Challenge 59.6% #35 of 75 Epoch AI
TriviaQA 75.2% #21 of 38 Epoch AI
OpenBookQA 56.2% #24 of 41 Epoch AI

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B CodeQwen1.5-7B internlm-20b internlm-7b open_llama_7b 50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B