Announcing Grok 3 Nov 2023
Grok-1
Grok-1.
5
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
xAI Nov 2023
Grok-1
Flagship
No Epoch Capabilities Index score yet
- MMLU 73% #90 /127
- HumanEval 63.2% #72 /95
- MATH 23.9% #86 /93
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 73% | #90 of 127 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Hungarian National High-School Exam | 59% | #1 of 2 | Model card | |
| GSM8K | 62.9% | #72 of 87 | Model card | |
| MATH | 23.9% | #86 of 93 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval | 63.2% | #72 of 95 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.