Qwen-VL-Plus
Qwen-VL-Plus places in the top three on MME.
13
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Qwen Jan 2024 Qwen-VL-Plus
Closed weights Mid-size
No Epoch Capabilities Index score yet
- MMMU 45.2% #103 /136
- MMBench-EN v1.1 64.3% #148 /178
- MMBench-CN v1.1 68.2% #108 /178
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 68.2% | #108 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MME | 1681.3 | #3 of 16 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 55.1% | #50 of 152 | Official leaderboard | |
| MTVQA-Test | 17.8% | #12 of 18 | Official leaderboard | |
| MMMU | 45.2% | #103 of 136 | Official leaderboard | |
| MMBench | 67% | #125 of 155 | Official leaderboard | |
| MathVista | 43.3% | #35 of 43 | Official leaderboard | |
| MMBench-EN v1.1 | 64.3% | #148 of 178 | Official leaderboard | |
| MMStar | 39.7% | #144 of 173 | Official leaderboard | |
| MathVerse | 11.8% | #8 of 9 | Official leaderboard | |
| CharXiv | 16% | #74 of 77 | Official leaderboard | |
| MATH-Vision (MathVision) | 10.7% | #103 of 105 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 52.3 | #119 of 173 | Official leaderboard |