Ovis1.5-Llama3-8B
Ovis1.5-Llama3-8B.
Alibaba International Digital Commerce (AIDC-AI) Released 24 Jul 2024 Family Ovis1.5 The lab's model card 9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Alibaba International Digital Commerce (AIDC-AI) Jul 2024 Ovis1.5-Llama3-8B
Open weights Small
No Epoch Capabilities Index score yet
- A-Bench 75.1% #34 /116
- VCR (Visual Caption Restoration) 24.2% #20 /42
- MMBench-EN v1.1 78.1% #71 /178
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 75.1% | #78 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| A-Bench | 75.1% | #34 of 116 | Official leaderboard | |
| MMBench | 80.8% | #48 of 155 | Official leaderboard | |
| MMStar | 57.3% | #68 of 173 | Official leaderboard | |
| MMBench-EN v1.1 | 78.1% | #71 of 178 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 24.2% | #20 of 42 | Official leaderboard | |
| CharXiv | 28.2% | #50 of 77 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 36.7% | #100 of 152 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 61.9 | #74 of 173 | Official leaderboard |