Benchmark Almanac

Molmo-7B-O

Molmo-7B-O places in the top three on Point-Bench.

Ai2 Released 25 Sep 2024 Family Molmo The lab's model card
9
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Ai2 Sep 2024

Molmo-7B-O

Open weights Small

No Epoch Capabilities Index score yet
  • Point-Bench 63.3% #3 /17
  • A-Bench 66% #93 /116
  • MMBench-EN v1.1 69.1% #125 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 56.8% #153 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
Point-Bench 63.3% #3 of 17 Official leaderboard
MMStar 50.1% #103 of 173 Official leaderboard
MMBench 72.2% #102 of 155 Official leaderboard
MMBench-EN v1.1 69.1% #125 of 178 Official leaderboard
CharXiv 24.3% #59 of 77 Official leaderboard
A-Bench 66% #93 of 116 Official leaderboard
CCBench (MMBench Chinese Culture) 20.6% #137 of 152 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 52.0 #121 of 173 Official leaderboard