Benchmark Almanac

Chameleon-30B

Chameleon-30B.

Meta Released 18 Jun 2024 Family Chameleon The lab's model card
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Jun 2024

Chameleon-30B

Open weights Mid-size

No Epoch Capabilities Index score yet
  • HumanEval-V 0% #22 /24
  • VCR (Visual Caption Restoration) 0.30% #42 /42
  • MMBench-EN v1.1 37.6% #173 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 27.8% #172 of 178 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 0% #22 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMStar 31.8% #168 of 173 Official leaderboard
MMBench-EN v1.1 37.6% #173 of 178 Official leaderboard
CCBench (MMBench Chinese Culture) 5.90% #148 of 152 Official leaderboard
MMBench 32.5% #152 of 155 Official leaderboard
VCR (Visual Caption Restoration) 0.30% #42 of 42 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 26.5 #171 of 173 Official leaderboard