Code Llama 34B Instruct
Code Llama 34B Instruct.
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Aug 2023 Code Llama 34B Instruct
Open weights Mid-size
No Epoch Capabilities Index score yet
- BigCodeBench-Hard 9.80% #84 /96
- RepoQA 41.6% #18 /22
- GSM1k 37.5% #15 /15
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| RepoQA | 41.6% | #18 of 22 | Official leaderboard | |
| LMArena (Elo) | 1,137 | #312 of 333 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM1k | 37.5% | #15 of 15 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 32.3% | #60 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 9.80% | #84 of 96 | Official leaderboard | |
| SEAL Coding | 598 | #26 of 26 | Official leaderboard | |
| CodeEditorBench | 21.1% | #7 of 7 | Official leaderboard |