Benchmark Almanac

Qwen1.5-7B-Chat

Qwen1.5-7B-Chat.

Qwen Released 4 Feb 2024 Family Qwen1.5 The lab's model card
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Feb 2024

Qwen1.5-7B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • ThaiExam 41.6% #16 /24
  • GTA 10.6% #8 /15
  • RewardBench 67.5% #44 /48

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
ThaiExam 41.6% #16 of 24 Official leaderboard
AlpacaEval 2.0 14.8% #32 of 40 Official leaderboard
MixEval 71.4% #28 of 34 Official leaderboard
MMLU-Pro 29.1% #184 of 212 Official leaderboard
WildBench 27.4 #41 of 47 Official leaderboard
EQ-Bench v2 54.4 #75 of 85 Official leaderboard
RewardBench 67.5% #44 of 48 Official leaderboard
RepoQA 2.80% #22 of 22 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
GTA 10.6% #8 of 15 Official leaderboard