Benchmark Almanac

Zephyr 7B Beta

Zephyr 7B Beta.

Hugging Face Released 26 Oct 2023 Family Zephyr The lab's model card
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Oct 2023

Zephyr 7B Beta

Open weights Small

No Epoch Capabilities Index score yet
  • RewardBench 72.8% #39 /48
  • AlpacaEval 90.6% #10 /19

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
AlpacaEval 90.6% #10 of 19 Official leaderboard
EQ-Bench v2 58.3 #69 of 85 Official leaderboard
RewardBench 72.8% #39 of 48 Official leaderboard
MMLU-Pro 33% #176 of 212 Official leaderboard
LMArena (Elo) 1,131 #313 of 333 Official leaderboard

Safety and security

BenchmarkScoreRankSource
DecodingTrust 63.2 #5 of 5 Official leaderboard