InternLM3-8B-Instruct.
Shanghai AI Lab Jan 2025 Open weights Small
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HellaSwag | 91.2% | #6 of 47 | Model card | |
| DROP | 83.1% | #21 of 40 | Model card | |
| AlpacaEval 2.0 | 51.1% | #9 of 16 | Model card | |
| Vectara Hallucination Leaderboard (HHEM) | 4.00% | #87 of 148 | Official leaderboard | |
| RULER | 87.9% | #23 of 38 | Model card | |
| MMLU | 76.6% | #87 of 127 | Model card | |
| CMMLU | 83.1% | #12 of 17 | Model card | |
| IFEval | 79.3% | #100 of 126 | Model card | |
| MMLU-Pro | 57.6% | #133 of 151 | Model card | |
| WildBench | 33.1 | #4 of 4 | Model card | |
| MT-Bench-101 | 8.59 | #1 of 1 | Model card |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH-500 | 83% | #58 of 67 | Model card | |
| GPQA Diamond | 37.4% | #263 of 284 | Model card | |
| AIME 2024 | 20% | #84 of 87 | Model card | |
| KOR-Bench | 56.4% | #4 of 4 | Model card |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval | 82.3% | #48 of 95 | Model card | |
| LiveCodeBench | 17.8% | #69 of 73 | Model card |
The benchmarks the lab chose to headline, with the scores it gave.