Benchmark Almanac

SmolVLM-Instruct

SmolVLM-Instruct.

Hugging Face Released 18 Nov 2024 Family SmolVLM The lab's model card
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Nov 2024

SmolVLM-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • A-Bench 65% #96 /116
  • MMBench-EN v1.1 64.4% #146 /178
  • MMBench-CN v1.1 50.3% #163 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 50.3% #163 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMStar 41.7% #135 of 173 Official leaderboard
MMBench 67.5% #124 of 155 Official leaderboard
MMBench-EN v1.1 64.4% #146 of 178 Official leaderboard
A-Bench 65% #96 of 116 Official leaderboard
CCBench (MMBench Chinese Culture) 20.8% #136 of 152 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 48.1 #133 of 173 Official leaderboard