Benchmark Almanac

Chameleon-7B

Chameleon-7B.

Meta Released 18 Jun 2024 Family Chameleon The lab's model card
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Jun 2024

Chameleon-7B

Open weights Small

No Epoch Capabilities Index score yet
  • HumanEval-V 0% #23 /24
  • VCR (Visual Caption Restoration) 3.30% #41 /42
  • MMBench-EN v1.1 19.9% #175 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 19.6% #173 of 178 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 0% #23 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
VCR (Visual Caption Restoration) 3.30% #41 of 42 Official leaderboard
MMStar 31.1% #169 of 173 Official leaderboard
MMBench-EN v1.1 19.9% #175 of 178 Official leaderboard
MMBench 15.4% #153 of 155 Official leaderboard
CCBench (MMBench Chinese Culture) 1.40% #151 of 152 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 21.0 #173 of 173 Official leaderboard