LLaVA-OneVision 72B
LLaVA-OneVision 72B.
Released 6 Aug 2024
18
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Aug 2024
LLaVA-OneVision 72B
No Epoch Capabilities Index score yet
- VisualPuzzles 30.8% #20 /29
- HumanEval-V 6.30% #11 /24
- Point-Bench 18% #16 /17
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 83.9% | #20 of 178 | Official leaderboard | |
| Creation-MMBench | -39.87 | #16 of 19 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval-V | 6.30% | #11 of 24 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench | 85.8% | #14 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 85% | #18 of 178 | Official leaderboard | |
| MMStar | 65.8% | #28 of 173 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 63.9% | #33 of 152 | Official leaderboard | |
| CharXiv | 36.4% | #31 of 77 | Official leaderboard | |
| Video-MME | 69.6% | #11 of 26 | Official leaderboard | |
| MEGA-Bench | 33.8% | #10 of 22 | Official leaderboard | |
| MMMU | 56.8% | #68 of 136 | Official leaderboard | |
| Video-MMMU | 48.3% | #12 of 23 | Official leaderboard | |
| VisualPuzzles | 30.8% | #20 of 29 | Official leaderboard | |
| MMMU-Pro | 31% | #42 of 57 | Official leaderboard | |
| MATH-Vision (MathVision) | 25.3% | #80 of 105 | Official leaderboard | |
| MME-CoT | 36.3% | #10 of 11 | Official leaderboard | |
| Point-Bench | 18% | #16 of 17 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 68.0 | #44 of 173 | Official leaderboard |