Benchmark Almanac

MiniCPM-V 2.0

MiniCPM-V 2.0.

OpenBMB (ModelBest) Released 9 Apr 2024 Family MiniCPM-V The lab's model card
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenBMB (ModelBest) Apr 2024

MiniCPM-V 2.0

Open weights Small

No Epoch Capabilities Index score yet
  • A-Bench 68% #86 /116
  • MMMU 37.1% #121 /136
  • MMBench-EN v1.1 67% #138 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 64.5% #127 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
CCBench (MMBench Chinese Culture) 45.3% #75 of 152 Official leaderboard
A-Bench 68% #86 of 116 Official leaderboard
MMBench 69.1% #118 of 155 Official leaderboard
MMBench-EN v1.1 67% #138 of 178 Official leaderboard
MathVista 40.6% #36 of 43 Official leaderboard
MMStar 39.1% #147 of 173 Official leaderboard
MME 1443.2 #14 of 16 Official leaderboard
MMMU 37.1% #121 of 136 Official leaderboard
CharXiv 18.5% #69 of 77 Official leaderboard
MTVQA-Test 7.40% #17 of 18 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 47.9 #135 of 173 Official leaderboard