InternVL2-40B
InternVL2-40B.
Shanghai AI Lab Released 8 Jul 2024 14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Shanghai AI Lab Jul 2024 InternVL2-40B
Open weights
No Epoch Capabilities Index score yet
- A-Bench 75.2% #31 /116
- VCR (Visual Caption Restoration) 47.5% #6 /42
- OlympicArena 20% #15 /25
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 84.9% | #17 of 178 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OlympicArena | 20% | #15 of 25 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CCBench (MMBench Chinese Culture) | 80.2% | #8 of 152 | Official leaderboard | |
| MMBench | 86.8% | #11 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 85.1% | #17 of 178 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 47.5% | #6 of 42 | Official leaderboard | |
| MMStar | 64.7% | #34 of 173 | Official leaderboard | |
| A-Bench | 75.2% | #31 of 116 | Official leaderboard | |
| TOMATO | 29% | #6 of 22 | Official leaderboard | |
| MMMU | 55.2% | #73 of 136 | Official leaderboard | |
| Video-MME | 61.2% | #27 of 50 | Epoch AI | |
| MMMU-Pro | 34.2% | #40 of 57 | Official leaderboard | |
| LVBench | 39.6% | #7 of 9 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 69.7 | #38 of 173 | Official leaderboard |