Benchmark Almanac

GPT-4V

GPT-4V ranks first on 2 of the 18 benchmarks it has scores on.

OpenAI Released 6 Nov 2023
18
Benchmarks with a score
2
Ranked first, out of five or more models
3
In the top three
OpenAI Nov 2023

GPT-4V

Closed weights

No Epoch Capabilities Index score yet
  • A-Bench 70.4% #69 /116
  • OlympicArena 33.2% #7 /25
  • OlympiadBench 18% #2 /7

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 72.2% #86 of 178 Official leaderboard

Math and science

BenchmarkScoreRankSource
OlympicArena 33.2% #7 of 25 Official leaderboard
OlympiadBench 18% #2 of 7 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
BLINK 51.3% #1 of 11 Official leaderboard
MathVerse 39.4% #1 of 9 Official leaderboard
CCBench (MMBench Chinese Culture) 57.3% #43 of 152 Official leaderboard
MMBench 81% #46 of 155 Official leaderboard
CharXiv 37.1% #28 of 77 Official leaderboard
MMStar 56% #76 of 173 Official leaderboard
MTVQA-Test 22% #8 of 18 Official leaderboard
MMMU 56.8% #67 of 136 Official leaderboard
MMBench-EN v1.1 75.3% #88 of 178 Official leaderboard
A-Bench 70.4% #69 of 116 Official leaderboard
Video-MME 63.3% #16 of 26 Official leaderboard
MathVista 49.9% #27 of 43 Official leaderboard
MATH-Vision (MathVision) 22.8% #84 of 105 Official leaderboard
MME 1409.4 #16 of 16 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 63.5 #68 of 173 Official leaderboard