Benchmark Almanac

InternVL2.5-8B

InternVL2.5-8B.

Shanghai AI Lab Released 5 Dec 2024 Family InternVL2.5 The lab's model card
14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Shanghai AI Lab Dec 2024

InternVL2.5-8B

Open weights Small

No Epoch Capabilities Index score yet
  • OCRBench v2 40.5% #42 /65
  • HumanEval-V 0.80% #20 /24
  • MME-CoT 41.1% #8 /11

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 81.7% #34 of 178 Official leaderboard
Creation-MMBench -25.42 #12 of 19 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 0.80% #20 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMBench-EN v1.1 83.2% #29 of 178 Official leaderboard
MMStar 63.2% #43 of 173 Official leaderboard
KRETA 70.8% #6 of 17 Official leaderboard
CharXiv 32.9% #37 of 77 Official leaderboard
MMMU 56% #71 of 136 Official leaderboard
OCRBench v2 40.5% #42 of 65 Official leaderboard
MMVU 41.1% #19 of 28 Official leaderboard
MMMU-Pro 34.3% #39 of 57 Official leaderboard
MME-CoT 41.1% #8 of 11 Official leaderboard
MATH-Vision (MathVision) 19.7% #88 of 105 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 68.1 #43 of 173 Official leaderboard