Grok 2 Vision (1212)
Grok 2 Vision (1212).
11
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
xAI Dec 2024
Grok 2 Vision (1212)
Closed weights Flagship
No Epoch Capabilities Index score yet
- Point-Bench 20.5% #15 /17
- Vectara Hallucination Leaderboard (HHEM) 2.90% #108 /148
- A-Bench 76.3% #21 /116
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 82.5% | #30 of 178 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 2.90% | #108 of 148 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MortgageTax | 3.46% | #86 of 86 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench | 85.3% | #17 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 83.3% | #28 of 178 | Official leaderboard | |
| MMStar | 65.2% | #29 of 173 | Official leaderboard | |
| A-Bench | 76.3% | #21 of 116 | Official leaderboard | |
| MMVU | 62.7% | #7 of 28 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 57.3% | #44 of 152 | Official leaderboard | |
| Point-Bench | 20.5% | #15 of 17 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 66.9 | #50 of 173 | Official leaderboard |