Benchmark Almanac

CogVLM2-19B-Chat

CogVLM2-19B-Chat.

Z.ai Released 16 May 2024 Family CogVLM The lab's model card
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Z.ai May 2024

CogVLM2-19B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • A-Bench 72.3% #57 /116
  • MMBench-EN v1.1 72.7% #99 /178
  • MMBench-CN v1.1 68.6% #107 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 68.6% #107 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
A-Bench 72.3% #57 of 116 Official leaderboard
MMBench-EN v1.1 72.7% #99 of 178 Official leaderboard
MMBench 73.9% #88 of 155 Official leaderboard
MMStar 50.5% #101 of 173 Official leaderboard
CCBench (MMBench Chinese Culture) 38.8% #91 of 152 Official leaderboard
Vision Arena 964 #132 of 136 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 56.3 #101 of 173 Official leaderboard