Benchmark Almanac

DeepSeek-VL-7B-Chat

DeepSeek-VL-7B-Chat.

DeepSeek Released 7 Mar 2024 Family DeepSeek-VL The lab's model card
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
DeepSeek Mar 2024

DeepSeek-VL-7B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • OCRBench v2 24.5% #57 /65
  • A-Bench 69.1% #78 /116
  • VCR (Visual Caption Restoration) 21.2% #24 /42

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 69.7% #100 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
CCBench (MMBench Chinese Culture) 52.4% #61 of 152 Official leaderboard
VCR (Visual Caption Restoration) 21.2% #24 of 42 Official leaderboard
MMBench 73.8% #89 of 155 Official leaderboard
MMBench-EN v1.1 71.7% #107 of 178 Official leaderboard
A-Bench 69.1% #78 of 116 Official leaderboard
MMStar 40.5% #140 of 173 Official leaderboard
OCRBench v2 24.5% #57 of 65 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 46.2 #143 of 173 Official leaderboard