- MMLU (thinking) 91
- MMLU-Pro (thinking) 78.5
- GPQA - Diamond (thinking) 60.6
- GSM8K (thinking) 96.4
- MATH (thinking) 83.3
- MMMLU (thinking) 80.5
- MGSM (thinking) 92.7
Cogito v1 Preview 70B
Cogito v1 Preview 70B places in the top three on 2 benchmarks.
7
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
Cogito v1 Preview 70B
Open weights Flagship
No Epoch Capabilities Index score yet
- MMLU-Pro 78.5% #83 /151
- MMMLU 80.5% #40 /62
- MMLU 91% #5 /127
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 96.4% | #3 of 87 | Model card | |
| MATH | 83.3% | #14 of 93 | Model card | |
| GPQA Diamond | 60.6% | #207 of 284 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.