Benchmark Almanac

VBVR-Bench

SenseNova-U1.5-8B-MoT 0.68 tops its leaderboard Seedream 5.0 Pro 0.56 leads the models we track
Not in model cards

Video generation models solve visual reasoning tasks by generating a video from a starting image and instruction. Rule-based scorers check the result instead of a judge model. Tasks cover abstraction, knowledge, perception, spatial reasoning and transformation, with in-domain and out-of-domain splits.

The existing importer reads VBVR-Pro. Move those rows to proposed vbvr-pro and restore original VBVR scope independently.

Released
February 2026
Kind
Video world models
Level
Everyday
Scored
Checked automatically
Answers
Open-ended
Tasks
All public
Last model added
July 2025
Scores refreshed
November 12th, 2026

In the authors’ words

Rapid progress in video models has largely focused on visual quality, leaving their reasoning capabilities underexplored. Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can naturally capture, enabling intuitive reasoning over spatiotemporal structure such as continuity, interaction, and causality. However, systematically studying video reasoning and its scaling behavior is hindered by the lack of large-scale training data. To address this gap, we introduce the Very Big Video Reasoning (VBVR) Dataset, an unprecedentedly large-scale resource spanning 200 curated reasoning tasks following a principled taxonomy and over one million video clips, approximately three orders of magnitude larger than existing datasets. We further present VBVR-Bench, a verifiable evaluation framework that moves beyond model-based judging by incorporating rule-based, human-aligned scorers, enabling reproducible and interpretable diagnosis of video reasoning capabilities. Leveraging the VBVR suite, we conduct one of the first large-scale scaling studies of video reasoning and observe early signs of emergent generalization to unseen reasoning tasks. Together, VBVR lays a foundation for the next stage of research in generalizable video reasoning. The data, benchmark toolkit, and models are publicly available at https://video-reason.com/?v=vbvr .

Abstract of A Very Big Video Reasoning Suite (arXiv:2602.20159, CC0)
30
Entries on its own leaderboard, 8 models we track

SenseNova-U1.5-8B-MoT tops the leaderboard with 0.68

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Seedream 5.0 Pro, at 0.56.

The newest model with a score here came out in July 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 1 SenseNova-U1.5-8B-MoT VBVR-Pro; Open Source; Interleaved 0.68
  2. 2 VBVR-Pro-Wan2.2-I2V-A14B VBVR-Pro; Pro Baseline; Video 0.67
  3. 3 VBVR-Pro-SenseNova-U1 VBVR-Pro; Pro Baseline; Interleaved 0.64
  4. 4 SenseNova-U1-8B-MoT VBVR-Pro; Open Source; Interleaved 0.56
  5. 5 Nano Banana Pro VBVR-Pro; Proprietary; Interleaved 0.56
  6. 6 VBVR-Pro-Wan2.1-I2V-14B VBVR-Pro; Pro Baseline; Video 0.56
  7. 7 Seedream 5.0 Pro VBVR-Pro; Proprietary; Image 0.56
  8. 8 VBVR-Wan2.2 VBVR-Pro; Open Source; Video 0.52
  9. 9 GPT-Image-2 VBVR-Pro; Proprietary; Interleaved 0.51
  10. 10 Seedance 2.0 VBVR-Pro; Proprietary; Video 0.50
  11. 11 VBVR-Pro-Wan2.2-TI2V-5B VBVR-Pro; Pro Baseline; Video 0.47
  12. 12 VBVR-Pro-LTX2.3 VBVR-Pro; Pro Baseline; Video 0.42
  13. 13 VBVR-SenseNova-U1 VBVR-Pro; Open Source; Interleaved 0.41
  14. 14 VBVR-Pro-FLUX.2 VBVR-Pro; Pro Baseline; Image 0.41
  15. 15 Kling VIDEO 3.0 VBVR-Pro; Proprietary; Video 0.39
  16. 16 VBVR-Pro-ThinkMorph VBVR-Pro; Pro Baseline; Interleaved 0.37
  17. 17 VBVR-Pro-Qwen-Image-Edit VBVR-Pro; Pro Baseline; Image 0.32
  18. 18 Qwen-Image-2.0 VBVR-Pro; Proprietary; Image 0.31
  19. 19 Veo 3.1 VBVR-Pro; Proprietary; Video 0.31
  20. 20 Wan2.2-I2V-A14B VBVR-Pro; Open Source; Video 0.18
  21. 21 VBVR-Pro-BAGEL VBVR-Pro; Pro Baseline; Image 0.17
  22. 22 FLUX.2 [dev] VBVR-Pro; Open Source; Image 0.16
  23. 23 ThinkMorph-7B VBVR-Pro; Open Source; Interleaved 0.15
  24. 24 Qwen-Image-Edit VBVR-Pro; Open Source; Image 0.13
  25. 25 LTX-2.3-I2AV VBVR-Pro; Open Source; Video 0.11
  26. 26 Wan2.1-I2V-14B-720P VBVR-Pro; Open Source; Video 0.10
  27. 27 Wan2.2-TI2V-5B VBVR-Pro; Open Source; Video 0.09
  28. 28 BAGEL-7B-MoT VBVR-Pro; Open Source; Image 0.09
  29. 29 CogVideoX1.5-5B-I2V VBVR-Pro; Open Source; Video 0.09
  30. 30 HunyuanVideo-I2V VBVR-Pro; Open Source; Video 0.05

Source: Official VBVR-Bench leaderboard

#EntryScoreSettingDateSource
1 SenseNova-U1.5-8B-MoT 0.68 VBVR-Pro; Open Source; Interleaved Official leaderboard
2 VBVR-Pro-Wan2.2-I2V-A14B 0.67 VBVR-Pro; Pro Baseline; Video Official leaderboard
3 VBVR-Pro-SenseNova-U1 0.64 VBVR-Pro; Pro Baseline; Interleaved Official leaderboard
4 SenseNova-U1-8B-MoT 0.56 VBVR-Pro; Open Source; Interleaved Official leaderboard
5 Nano Banana Pro 0.56 VBVR-Pro; Proprietary; Interleaved Official leaderboard
6 VBVR-Pro-Wan2.1-I2V-14B 0.56 VBVR-Pro; Pro Baseline; Video Official leaderboard
7 Seedream 5.0 Pro 0.56 VBVR-Pro; Proprietary; Image Official leaderboard
8 VBVR-Wan2.2 0.52 VBVR-Pro; Open Source; Video Official leaderboard
9 GPT-Image-2 0.51 VBVR-Pro; Proprietary; Interleaved Official leaderboard
10 Seedance 2.0 0.50 VBVR-Pro; Proprietary; Video Official leaderboard
11 VBVR-Pro-Wan2.2-TI2V-5B 0.47 VBVR-Pro; Pro Baseline; Video Official leaderboard
12 VBVR-Pro-LTX2.3 0.42 VBVR-Pro; Pro Baseline; Video Official leaderboard
13 VBVR-SenseNova-U1 0.41 VBVR-Pro; Open Source; Interleaved Official leaderboard
14 VBVR-Pro-FLUX.2 0.41 VBVR-Pro; Pro Baseline; Image Official leaderboard
15 Kling VIDEO 3.0 0.39 VBVR-Pro; Proprietary; Video Official leaderboard
16 VBVR-Pro-ThinkMorph 0.37 VBVR-Pro; Pro Baseline; Interleaved Official leaderboard
17 VBVR-Pro-Qwen-Image-Edit 0.32 VBVR-Pro; Pro Baseline; Image Official leaderboard
18 Qwen-Image-2.0 0.31 VBVR-Pro; Proprietary; Image Official leaderboard
19 Veo 3.1 0.31 VBVR-Pro; Proprietary; Video Official leaderboard
20 Wan2.2-I2V-A14B 0.18 VBVR-Pro; Open Source; Video Jul 2025 Official leaderboard
21 VBVR-Pro-BAGEL 0.17 VBVR-Pro; Pro Baseline; Image Official leaderboard
22 FLUX.2 [dev] 0.16 VBVR-Pro; Open Source; Image Official leaderboard
23 ThinkMorph-7B 0.15 VBVR-Pro; Open Source; Interleaved Official leaderboard
24 Qwen-Image-Edit 0.13 VBVR-Pro; Open Source; Image Official leaderboard
25 LTX-2.3-I2AV 0.11 VBVR-Pro; Open Source; Video Official leaderboard
26 Wan2.1-I2V-14B-720P 0.10 VBVR-Pro; Open Source; Video Feb 2025 Official leaderboard
27 Wan2.2-TI2V-5B 0.09 VBVR-Pro; Open Source; Video Jul 2025 Official leaderboard
28 BAGEL-7B-MoT 0.09 VBVR-Pro; Open Source; Image May 2025 Official leaderboard
29 CogVideoX1.5-5B-I2V 0.09 VBVR-Pro; Open Source; Video Official leaderboard
30 HunyuanVideo-I2V 0.05 VBVR-Pro; Open Source; Video Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

Alibaba Group
Own leaderboard Not tested since Feb 2026

Source: Official VBVR-Bench leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard
0.10 0.13 0.15 0.17 0.20 2025 0.10 0.13 0.15 0.17 0.20 2025

Source: Official VBVR-Bench leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in World models

All 39 in World models
  • AgentWorldBench In use Language world models predict the next environment observation after an agent action, in 7 domains from MCP and search to Android and desktop OS. A judge model scores each prediction against the real observation on five dimensions. GPT-5.4 58.3
  • IntPhys 2 In use Models watch simulated videos and judge whether each event is physically possible, testing object permanence, immutability, continuity and solidity. Scored by accuracy. Muse Spark Open 68.3%
  • QwenWorldBench Fading Models act as world models that simulate agent environments in 7 domains, such as terminal, web, and Android. A rubric judge scores five dimensions. Qwen3.7-Plus 62.1%
  • VPCT Fading Models view an image of a ball, ramps, and three buckets and predict which bucket the ball falls into. Scored by accuracy on 100 problems. Gemini 3 Pro 91%
  • ContPhy Fading Models infer physical properties such as mass and density of fluids and soft bodies from videos and predict their dynamics. Seed2.0 Pro 67.4%
  • RBench Only in system cards 650 image+text prompts for robot video generation (tasks and embodiments). MLLM judge scores task completion, physical plausibility, stability. Wan 2.6 60.7%