mistral-small-2402
mistral-small-2402.
Released 26 Feb 2024
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Feb 2024
mistral-small-2402
No Epoch Capabilities Index score yet
- TaxEval v2 49.1% #124 /129
- BigCodeBench-Hard 13.9% #73 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 80.4 | #24 of 85 | Official leaderboard | |
| MMLU | 68.7% | #64 of 127 | Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DTBench | 53% | #151 of 177 | Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 36.7% | #52 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 13.9% | #73 of 96 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| TaxEval v2 | 49.1% | #124 of 129 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OR-Bench | 13.3% | #7 of 28 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 28.8 | #62 of 71 | Official leaderboard |