Benchmark Almanac

Qwen2-1.5B-Instruct

Qwen2-1.5B-Instruct.

Qwen Released 7 Jun 2024 Family Qwen2 The lab's model card
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Jun 2024

Qwen2-1.5B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • KOR-Bench 14.3% #32 /33
  • AlGhafa 53.1% #23 /39
  • ALRAGE 54.8% #31 /39

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
ArabicMMLU 49.2% #19 of 39 Official leaderboard
MadinahQA 45.5% #19 of 39 Official leaderboard
AlGhafa 53.1% #23 of 39 Official leaderboard
Open Arabic LLM Leaderboard v2 49.2% #23 of 39 Official leaderboard
ArbMMLU-HT 37.4% #24 of 39 Official leaderboard
ALRAGE 54.8% #31 of 39 Official leaderboard
MMLU-CF 47.1% #33 of 37 Official leaderboard
MMLU-Pro 22.6% #192 of 212 Official leaderboard

Math and science

BenchmarkScoreRankSource
KOR-Bench 14.3% #32 of 33 Official leaderboard

Safety and security

BenchmarkScoreRankSource
AraTrust 68.9% #24 of 39 Official leaderboard