Benchmark Almanac

open_llama_7b

open_llama_7b.

Released 7 Jun 2023
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Jun 2023

open_llama_7b

91.5 #261 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
HellaSwag 71.8% #47 of 74 Epoch AI
BoolQ 70.6% #54 of 75 Epoch AI
WinoGrande 67% #55 of 76 Epoch AI
OpenBookQA 39% #33 of 41 Epoch AI
ARC-Challenge 38.7% #62 of 75 Epoch AI
PIQA 76% #48 of 58 Epoch AI
MMLU 29.9% #120 of 127 Epoch AI

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B CodeQwen1.5-7B internlm-20b internlm-7b open_llama_7b 50 75 100 125 150 175 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B