Benchmark Almanac

Phi-3-vision-128k-instruct

Phi-3-vision-128k-instruct.

Microsoft Released 21 May 2024 Family Phi-3 The lab's model card
11
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Microsoft May 2024

Phi-3-vision-128k-instruct

Open weights Small

No Epoch Capabilities Index score yet
  • A-Bench 68.2% #85 /116
  • MMBench-EN v1.1 70.5% #114 /178
  • MMBench-CN v1.1 59.8% #142 /178

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 59.8% #142 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
LongVideoBench 49.9% #5 of 13 Official leaderboard
CharXiv 31.6% #41 of 77 Official leaderboard
MMBench 73.6% #92 of 155 Official leaderboard
MMBench-EN v1.1 70.5% #114 of 178 Official leaderboard
MMStar 47.7% #112 of 173 Official leaderboard
A-Bench 68.2% #85 of 116 Official leaderboard
MathVista 44.5% #33 of 43 Official leaderboard
CCBench (MMBench Chinese Culture) 24.1% #130 of 152 Official leaderboard
Vision Arena 881 #136 of 136 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 53.6 #113 of 173 Official leaderboard