Benchmark Almanac

ODinW-13

Qwen 3.6 Plus 51.8% leads since Apr 2026 Fading

Models detect objects in 13 varied real-world datasets, such as aquarium and aerial images, from text category names. Scored by mean average precision.

A 13-dataset subset of the 35-task ODinW benchmark in ELEVATER.

Made by Microsoft Research Released Dec 2021 Detection and captioning All tasks public Last in a launch post Jun 2026 , dropped before it saturated Last model added Jun 2026
Level
Everyday Most adults, without training
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Short answer A number, word or short string matched to a key.
microsoft/GLIP 2,613 stars Paper
9
Models scored in lab cards
8
Launch posts list it, from 1 lab
4
System cards report it, from 1 lab

Qwen 3.6 Plus leads with 51.8% among models released by Jun 2026

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

The newest model with a score here came out in Jun 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 51.8 Qwen 3.6 Plus
  2. 51.1 Qwen3.7-Plus
  3. 50.8 Qwen 3.6 35B-A3B
  4. 49.5 Qwen3.5-Omni-Plus
  5. 47.0 Qwen3.5 397B-A17B
  6. 44.5 Qwen3.5-122B-A10B
  7. 43.2 Qwen3-VL-235B-A22B
  8. 43.1 Qwen2.5-VL-72B
  9. 42.4 Qwen2.5-Omni-7B
  1. 1 Qwen 3.6 Plus 51.8%
  2. 2 Qwen3.7-Plus 51.1%
  3. 3 Qwen 3.6 35B-A3B 50.8%
  4. 4 Qwen3.5-Omni-Plus 49.5%
  5. 5 Qwen3.5 397B-A17B 47%
  6. 6 Qwen3.5-122B-A10B 44.5%
  7. 7 Qwen3-VL-235B-A22B 43.2%
  8. 8 Qwen2.5-VL-72B 43.1%
  9. 9 Qwen2.5-Omni-7B 42.4%
#ModelScoreSettingDateSource
1 Qwen 3.6 Plus 51.8% Apr 2026 Model card
2 Qwen3.7-Plus 51.1% Jun 2026 Model card
3 Qwen 3.6 35B-A3B 50.8% Apr 2026 Model card
4 Qwen3.5-Omni-Plus 49.5% Mar 2026 Model card
5 Qwen3.5 397B-A17B 47% Feb 2026 Model card
6 Qwen3.5-122B-A10B 44.5% Feb 2026 Model card
7 Qwen3-VL-235B-A22B 43.2% Sep 2025 Model card
8 Qwen2.5-VL-72B 43.1% Feb 2025 Model card
9 Qwen2.5-Omni-7B 42.4% Mar 2025 Model card

5 models have held number one since 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

Qwen
Lab claims Not tested since Jun 2026
Qwen 3.6 Plus 51.8%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card Best so far
0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Qwen 3.6 Plus Qwen3.5 397B-A17B Qwen3-VL-235B-A22B Qwen2.5-VL-72B 0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Qwen 3.6 Plus Qwen3-VL-235B-A22B

Labs headline it less often now, last in Jun 2026

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Qwen
DateLaunch postScoreAs the post writes it
1 Jun 2026 Qwen3.7-Plus 51.1 ODinW13
15 Apr 2026 Qwen 3.6 35B-A3B 50.8 ODInW13
2 Apr 2026 Qwen 3.6 Plus 51.8 ODinW13
30 Mar 2026 Qwen3.5-Omni-Plus 49.5 ODInW13
24 Feb 2026 Qwen3.5-122B-A10B 44.5 ODInW13
16 Feb 2026 Qwen3.5 397B-A17B 47 ODInW13
23 Sep 2025 Qwen3-VL-235B-A22B 43.2 ODinW13
27 Mar 2025 Qwen2.5-Omni-7B 42.4 ODinW

4 system cards report it, from 1 lab

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
17 Apr 2026 Qwen3.5-Omni-Plus technical report 49.5 ODInW13 (Table 6) Capabilities
26 Nov 2025 Qwen3-VL-235B-A22B technical report 43.2 ODinW-13 (Table 2) Capabilities
26 Mar 2025 Qwen2.5-Omni-7B technical report 42.2 ODinW, mAP (Table 6 and text) Capabilities
19 Feb 2025 Qwen2.5-VL-72B technical report 43.1 ODinW, mAP (Table 6) Capabilities

More in Vision

All 234 in Vision
  • MMMU In use 11.5K college-level multimodal questions across 30 subjects. Multiple-choice and open accuracy. GPT-5.1 85.4%
  • MMMU-Pro In use Harder MMMU: college-level multimodal questions with more options and vision-only inputs to remove text shortcuts. Kimi K3.1 Pro 84.1%
  • CharXiv In use Chart understanding on real arXiv figures. Reasoning questions require synthesizing information from complex charts. Claude Fable 5 93.5%
  • MATH-Vision (MathVision) In use 3,040 competition math problems with visual context. Answer accuracy. Qwen 3.8 Max 97.7%
  • ChartQA In use Models answer human-written and generated questions about chart images that need visual and arithmetic reasoning. Scored by relaxed accuracy with a 5 percent numeric tolerance. Command A Vision 90.9%
  • DocVQA In use Models answer 50,000 questions about 12,000 scanned document images by reading their text and layout. Scoring is ANLS, a string similarity to reference answers. Seed1.5-VL 96.9%