Benchmark Almanac

Gemini 1.0 Pro Vision

Gemini 1.0 Pro Vision places in the top three on ScienceQA.

Google DeepMind Released 4 Jan 2024
6
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Google DeepMind Jan 2024

Gemini 1.0 Pro Vision

Closed weights

No Epoch Capabilities Index score yet
  • ZeroBench 2.00% #52 /66
  • OlympicArena 21% #13 /25
  • OlympiadBench 4.22% #5 /7

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Math and science

BenchmarkScoreRankSource
OlympicArena 21% #13 of 25 Official leaderboard
OlympiadBench 4.22% #5 of 7 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
ScienceQA 79.7% #3 of 23 Epoch AI
Image2Struct 47.4 #10 of 18 Official leaderboard
VHELM 32.1 #31 of 41 Official leaderboard
ZeroBench 2.00% #52 of 66 Official leaderboard