Benchmark Almanac

Qwen1.5-110B

Qwen1.5-110B.

Qwen Released 25 Apr 2024
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Apr 2024

Qwen1.5-110B

Open weights

No Epoch Capabilities Index score yet
  • MathBench 58.4% #6 /21

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
EQ-Bench v2 83.7 #8 of 85 Official leaderboard
MMLU-Pro 49.9% #134 of 212 Official leaderboard
LMArena (Elo) 1,234 #267 of 333 Official leaderboard

Math and science

BenchmarkScoreRankSource
ForecastBench 55.2 #12 of 86 Official leaderboard
MathBench 58.4% #6 of 21 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Lite 55.0 #32 of 71 Official leaderboard