Qwen2.5-Coder-14B-Instruct
Qwen2.5-Coder-14B-Instruct places in the top three on GSM8K.
Released 6 Nov 2024
4
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Unknown lab Nov 2024
Qwen2.5-Coder-14B-Instruct
No Epoch Capabilities Index score yet
- BigCodeBench-Hard 26.6% #35 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 94.2% | #2 of 82 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 52.5% | #11 of 69 | Official leaderboard | |
| Aider-Edit | 69.2% | #13 of 37 | Official leaderboard | |
| BigCodeBench-Hard | 26.6% | #35 of 96 | Official leaderboard |