Benchmark Almanac

Cambrian-1-34B

Cambrian-1-34B.

New York University Released 16 Jun 2024 Family Cambrian-1 The lab's model card
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
New York University Jun 2024

Cambrian-1-34B

Open weights Mid-size

No Epoch Capabilities Index score yet
  • A-Bench 72.3% #58 /116
  • VCR (Visual Caption Restoration) 35.1% #12 /42
  • MMMU 49.7% #88 /136

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 77.3% #63 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
VCR (Visual Caption Restoration) 35.1% #12 of 42 Official leaderboard
MMBench 80.4% #51 of 155 Official leaderboard
MMBench-EN v1.1 78.3% #69 of 178 Official leaderboard
CCBench (MMBench Chinese Culture) 49.2% #67 of 152 Official leaderboard
A-Bench 72.3% #58 of 116 Official leaderboard
MMStar 54.2% #90 of 173 Official leaderboard
MMMU 49.7% #88 of 136 Official leaderboard
CharXiv 27.3% #51 of 77 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 58.3 #92 of 173 Official leaderboard