CodeQwen1.5-7B
CodeQwen1.5-7B.
Released 15 Apr 2024
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Apr 2024
CodeQwen1.5-7B
94.8
#254 of 271
Epoch Capabilities Index
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 40.5% | #110 of 127 | Epoch AI | |
| WinoGrande | 59.8% | #68 of 76 | Epoch AI | |
| ARC-Challenge | 35.7% | #68 of 75 | Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 37.7% | #46 of 82 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MBPP+ | 60.8% | #21 of 35 | Official leaderboard | |
| HumanEval+ | 45.7% | #32 of 46 | Official leaderboard |
The lab's models over time
's models in color, against every other model on the Epoch Capabilities Index, by release date.