Qwen2.5-Coder-32B
Qwen2.5-Coder-32B.
Qwen Released 18 Sep 2024 8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Sep 2024 Qwen2.5-Coder-32B
Open weights
119.4
#198 of 271
Epoch Capabilities Index
- LiveSQLBench 12.5% #32 /36
- AutoCodeBench 35.8% #25 /34
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| WinoGrande | 80.8% | #16 of 76 | Epoch AI | |
| HellaSwag | 83% | #16 of 74 | Epoch AI | |
| MMLU | 79.1% | #29 of 127 | Epoch AI | |
| ARC-Challenge | 70.5% | #22 of 75 | Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 91.1% | #6 of 82 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Aider-Edit | 72.9% | #6 of 37 | Official leaderboard | |
| AutoCodeBench | 35.8% | #25 of 34 | Official leaderboard | |
| LiveSQLBench | 12.5% | #32 of 36 | Official leaderboard |
Qwen's models over time
Qwen's models in color, against every other model on the Epoch Capabilities Index, by release date.