Benchmark Almanac

Molmo-7B-D

Molmo-7B-D.

Ai2 Released 25 Sep 2024 Family Molmo The lab's model card
11
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Ai2 Sep 2024

Molmo-7B-D

Open weights Small

No Epoch Capabilities Index score yet
  • HumanEval-V 0.40% #21 /24
  • Point-Bench 61.6% #5 /17
  • A-Bench 73.8% #43 /116

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 71.6% #91 of 178 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 0.40% #21 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
Point-Bench 61.6% #5 of 17 Official leaderboard
A-Bench 73.8% #43 of 116 Official leaderboard
MMStar 56.1% #74 of 173 Official leaderboard
MMBench 73.6% #93 of 155 Official leaderboard
MMBench-EN v1.1 70.3% #117 of 178 Official leaderboard
CCBench (MMBench Chinese Culture) 36.7% #101 of 152 Official leaderboard
CharXiv 26.4% #53 of 77 Official leaderboard
Vision Arena 994 #130 of 136 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 57.4 #97 of 173 Official leaderboard