SWE-Llama 7B
SWE-Llama 7B.
3
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Princeton University Oct 2023 SWE-Llama 7B
Open weights Small
No Epoch Capabilities Index score yet
- SWE-bench Lite 1.33% #14 /15
- SWE-bench 0.70% #9 /9
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SWE-bench Lite | 1.33% | #14 of 15 | Official leaderboard | |
| SWE-bench Verified | 1.40% | #59 of 60 | Official leaderboard | |
| SWE-bench | 0.70% | #9 of 9 | Official leaderboard |