- IF Eval 0-shot (IT) 51.2
- BIG-Bench Hard few-shot (IT) 26.7
- HellaSwag 0-shot (IT) 37.7
- PIQA 0-shot (IT) 66.2
- ARC-c 0-shot (IT) 28.2
- WinoGrande 0-shot (IT) 52.3
Gemma 3 270M
Gemma 3 270M.
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Gemma 3 270M
Open weights
No Epoch Capabilities Index score yet
- CritPt 0% #140 /160
- IFEval 51.2% #126 /126
- BIG-Bench Hard 26.7% #71 /71
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| IFEval | 51.2% | #126 of 126 | Model card | |
| BIG-Bench Hard | 26.7% | #71 of 71 | Model card | |
| HellaSwag | 37.7% | #47 of 47 | Model card | |
| ARC-Challenge | 28.2% | #45 of 45 | Model card | |
| WinoGrande | 52.3% | #42 of 42 | Model card | |
| PIQA | 66.2% | #33 of 33 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CritPt | 0% | #140 of 160 | Epoch AI |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.