Benchmark Almanac

Cambrian-1-8B

Cambrian-1-8B.

New York University Released 16 Jun 2024 Family Cambrian-1 The lab's model card
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
New York University Jun 2024

Cambrian-1-8B

Open weights Small

No Epoch Capabilities Index score yet
  • OCRBench v2 32.3% #52 /65
  • VisualPuzzles 28.9% #25 /29
  • A-Bench 68.6% #81 /116

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 64.9% #125 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMBench 74.6% #82 of 155 Official leaderboard
MMStar 50.7% #100 of 173 Official leaderboard
MMBench-EN v1.1 71.6% #110 of 178 Official leaderboard
A-Bench 68.6% #81 of 116 Official leaderboard
OCRBench v2 32.3% #52 of 65 Official leaderboard
MMMU 42.7% #110 of 136 Official leaderboard
VisualPuzzles 28.9% #25 of 29 Official leaderboard
CCBench (MMBench Chinese Culture) 23.7% #132 of 152 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 52.9 #118 of 173 Official leaderboard