Benchmark Almanac

MiniCPM-V-2_6

MiniCPM-V-2_6.

Released 3 Aug 2024
19
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Aug 2024

MiniCPM-V-2_6

No Epoch Capabilities Index score yet
  • OCRBench v2 33% #51 /65
  • A-Bench 74.6% #36 /116
  • VCR (Visual Caption Restoration) 33.7% #13 /42

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 76.9% #66 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMBench 81.5% #43 of 155 Official leaderboard
CCBench (MMBench Chinese Culture) 55.7% #47 of 152 Official leaderboard
VCR (Visual Caption Restoration) 33.7% #13 of 42 Official leaderboard
A-Bench 74.6% #36 of 116 Official leaderboard
MME 1668.0 #5 of 16 Official leaderboard
MMBench-EN v1.1 79% #61 of 178 Official leaderboard
MMStar 57.5% #66 of 173 Official leaderboard
Video-MME 63.7% #15 of 26 Official leaderboard
MMMU 49.8% #87 of 136 Official leaderboard
MEGA-Bench 25.4% #15 of 22 Official leaderboard
MATH-Vision (MathVision) 23.4% #82 of 105 Official leaderboard
OCRBench v2 33% #51 of 65 Official leaderboard
MMMU-Pro 27.2% #45 of 57 Official leaderboard
MME-CoT 39.8% #9 of 11 Official leaderboard
Vision Arena 962 #133 of 136 Official leaderboard
KRETA 41% #17 of 17 Official leaderboard
OVBench 39.1% #7 of 7 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 65.2 #54 of 173 Official leaderboard