Benchmark Almanac

OLMo-7B-Instruct

OLMo-7B-Instruct.

Ai2 Released 23 Feb 2024 Family OLMo The lab's model card
3
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Ai2 Feb 2024

OLMo-7B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • RewardBench 67.3% #45 /48
  • MixEval 55% #33 /34

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
RewardBench 67.3% #45 of 48 Official leaderboard
MixEval 55% #33 of 34 Official leaderboard
LMArena (Elo) 1,074 #325 of 333 Official leaderboard