VBVR-Bench
Video generation models solve visual reasoning tasks by generating a video from a starting image and instruction. Rule-based scorers check the result instead of a judge model. Tasks cover abstraction, knowledge, perception, spatial reasoning and transformation, with in-domain and out-of-domain splits.
The existing importer reads VBVR-Pro. Move those rows to proposed vbvr-pro and restore original VBVR scope independently.
- Released
- February 2026
- Kind
- Video world models
- Level
- Everyday
- Scored
- Checked automatically
- Answers
- Open-ended
- Tasks
- All public
- Last model added
- July 2025
- Scores refreshed
- November 12th, 2026
In the authors’ words
Rapid progress in video models has largely focused on visual quality, leaving their reasoning capabilities underexplored. Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can naturally capture, enabling intuitive reasoning over spatiotemporal structure such as continuity, interaction, and causality. However, systematically studying video reasoning and its scaling behavior is hindered by the lack of large-scale training data. To address this gap, we introduce the Very Big Video Reasoning (VBVR) Dataset, an unprecedentedly large-scale resource spanning 200 curated reasoning tasks following a principled taxonomy and over one million video clips, approximately three orders of magnitude larger than existing datasets. We further present VBVR-Bench, a verifiable evaluation framework that moves beyond model-based judging by incorporating rule-based, human-aligned scorers, enabling reproducible and interpretable diagnosis of video reasoning capabilities. Leveraging the VBVR suite, we conduct one of the first large-scale scaling studies of video reasoning and observe early signs of emergent generalization to unseen reasoning tasks. Together, VBVR lays a foundation for the next stage of research in generalizable video reasoning. The data, benchmark toolkit, and models are publicly available at https://video-reason.com/?v=vbvr .
SenseNova-U1.5-8B-MoT tops the leaderboard with 0.68
Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Seedream 5.0 Pro, at 0.56.
The newest model with a score here came out in July 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- Claude Opus 5.5
- and 16 more
- 0.68 SenseNova-U1.5-8B-MoT
- 0.67 VBVR-Pro-Wan2.2-I2V-A14B
- 0.64 VBVR-Pro-SenseNova-U1
- 0.56 SenseNova-U1-8B-MoT
- 0.56 Nano Banana Pro
- 0.56 VBVR-Pro-Wan2.1-I2V-14B
- 0.56
Seedream 5.0 Pro
- 0.52 VBVR-Wan2.2
- 0.51 GPT-Image-2
- 0.50 Seedance 2.0
- 0.47 VBVR-Pro-Wan2.2-TI2V-5B
- 0.42 VBVR-Pro-LTX2.3
- 0.41 VBVR-SenseNova-U1
- 0.41 VBVR-Pro-FLUX.2
- 0.39 Kling VIDEO 3.0
- 0.37 VBVR-Pro-ThinkMorph
- 0.32 VBVR-Pro-Qwen-Image-Edit
- 0.31 Qwen-Image-2.0
- 0.31 Veo 3.1
- 0.18
Wan2.2-I2V-A14B
- 0.17 VBVR-Pro-BAGEL
- 0.16 FLUX.2 [dev]
- 0.15 ThinkMorph-7B
- 0.13
Qwen-Image-Edit
- 0.11 LTX-2.3-I2AV
- 0.10
Wan2.1-I2V-14B-720P
- 0.09
Wan2.2-TI2V-5B
- 0.09
BAGEL-7B-MoT
- 0.09 CogVideoX1.5-5B-I2V
- 0.05 HunyuanVideo-I2V
- 1 SenseNova-U1.5-8B-MoT VBVR-Pro; Open Source; Interleaved 0.68
- 2 VBVR-Pro-Wan2.2-I2V-A14B VBVR-Pro; Pro Baseline; Video 0.67
- 3 VBVR-Pro-SenseNova-U1 VBVR-Pro; Pro Baseline; Interleaved 0.64
- 4 SenseNova-U1-8B-MoT VBVR-Pro; Open Source; Interleaved 0.56
- 5 Nano Banana Pro VBVR-Pro; Proprietary; Interleaved 0.56
- 6 VBVR-Pro-Wan2.1-I2V-14B VBVR-Pro; Pro Baseline; Video 0.56
- 7
Seedream 5.0 Pro VBVR-Pro; Proprietary; Image 0.56
- 8 VBVR-Wan2.2 VBVR-Pro; Open Source; Video 0.52
- 9 GPT-Image-2 VBVR-Pro; Proprietary; Interleaved 0.51
- 10 Seedance 2.0 VBVR-Pro; Proprietary; Video 0.50
- 11 VBVR-Pro-Wan2.2-TI2V-5B VBVR-Pro; Pro Baseline; Video 0.47
- 12 VBVR-Pro-LTX2.3 VBVR-Pro; Pro Baseline; Video 0.42
- 13 VBVR-SenseNova-U1 VBVR-Pro; Open Source; Interleaved 0.41
- 14 VBVR-Pro-FLUX.2 VBVR-Pro; Pro Baseline; Image 0.41
- 15 Kling VIDEO 3.0 VBVR-Pro; Proprietary; Video 0.39
- 16 VBVR-Pro-ThinkMorph VBVR-Pro; Pro Baseline; Interleaved 0.37
- 17 VBVR-Pro-Qwen-Image-Edit VBVR-Pro; Pro Baseline; Image 0.32
- 18 Qwen-Image-2.0 VBVR-Pro; Proprietary; Image 0.31
- 19 Veo 3.1 VBVR-Pro; Proprietary; Video 0.31
- 20
Wan2.2-I2V-A14B VBVR-Pro; Open Source; Video 0.18
- 21 VBVR-Pro-BAGEL VBVR-Pro; Pro Baseline; Image 0.17
- 22 FLUX.2 [dev] VBVR-Pro; Open Source; Image 0.16
- 23 ThinkMorph-7B VBVR-Pro; Open Source; Interleaved 0.15
- 24
Qwen-Image-Edit VBVR-Pro; Open Source; Image 0.13
- 25 LTX-2.3-I2AV VBVR-Pro; Open Source; Video 0.11
- 26
Wan2.1-I2V-14B-720P VBVR-Pro; Open Source; Video 0.10
- 27
Wan2.2-TI2V-5B VBVR-Pro; Open Source; Video 0.09
- 28
BAGEL-7B-MoT VBVR-Pro; Open Source; Image 0.09
- 29 CogVideoX1.5-5B-I2V VBVR-Pro; Open Source; Video 0.09
- 30 HunyuanVideo-I2V VBVR-Pro; Open Source; Video 0.05
Source: Official VBVR-Bench leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | SenseNova-U1.5-8B-MoT | 0.68 | VBVR-Pro; Open Source; Interleaved | Official leaderboard | |
| 2 | VBVR-Pro-Wan2.2-I2V-A14B | 0.67 | VBVR-Pro; Pro Baseline; Video | Official leaderboard | |
| 3 | VBVR-Pro-SenseNova-U1 | 0.64 | VBVR-Pro; Pro Baseline; Interleaved | Official leaderboard | |
| 4 | SenseNova-U1-8B-MoT | 0.56 | VBVR-Pro; Open Source; Interleaved | Official leaderboard | |
| 5 | Nano Banana Pro | 0.56 | VBVR-Pro; Proprietary; Interleaved | Official leaderboard | |
| 6 | VBVR-Pro-Wan2.1-I2V-14B | 0.56 | VBVR-Pro; Pro Baseline; Video | Official leaderboard | |
| 7 | | 0.56 | VBVR-Pro; Proprietary; Image | Official leaderboard | |
| 8 | VBVR-Wan2.2 | 0.52 | VBVR-Pro; Open Source; Video | Official leaderboard | |
| 9 | GPT-Image-2 | 0.51 | VBVR-Pro; Proprietary; Interleaved | Official leaderboard | |
| 10 | Seedance 2.0 | 0.50 | VBVR-Pro; Proprietary; Video | Official leaderboard | |
| 11 | VBVR-Pro-Wan2.2-TI2V-5B | 0.47 | VBVR-Pro; Pro Baseline; Video | Official leaderboard | |
| 12 | VBVR-Pro-LTX2.3 | 0.42 | VBVR-Pro; Pro Baseline; Video | Official leaderboard | |
| 13 | VBVR-SenseNova-U1 | 0.41 | VBVR-Pro; Open Source; Interleaved | Official leaderboard | |
| 14 | VBVR-Pro-FLUX.2 | 0.41 | VBVR-Pro; Pro Baseline; Image | Official leaderboard | |
| 15 | Kling VIDEO 3.0 | 0.39 | VBVR-Pro; Proprietary; Video | Official leaderboard | |
| 16 | VBVR-Pro-ThinkMorph | 0.37 | VBVR-Pro; Pro Baseline; Interleaved | Official leaderboard | |
| 17 | VBVR-Pro-Qwen-Image-Edit | 0.32 | VBVR-Pro; Pro Baseline; Image | Official leaderboard | |
| 18 | Qwen-Image-2.0 | 0.31 | VBVR-Pro; Proprietary; Image | Official leaderboard | |
| 19 | Veo 3.1 | 0.31 | VBVR-Pro; Proprietary; Video | Official leaderboard | |
| 20 | | 0.18 | VBVR-Pro; Open Source; Video | Jul 2025 | Official leaderboard |
| 21 | VBVR-Pro-BAGEL | 0.17 | VBVR-Pro; Pro Baseline; Image | Official leaderboard | |
| 22 | FLUX.2 [dev] | 0.16 | VBVR-Pro; Open Source; Image | Official leaderboard | |
| 23 | ThinkMorph-7B | 0.15 | VBVR-Pro; Open Source; Interleaved | Official leaderboard | |
| 24 | | 0.13 | VBVR-Pro; Open Source; Image | Official leaderboard | |
| 25 | LTX-2.3-I2AV | 0.11 | VBVR-Pro; Open Source; Video | Official leaderboard | |
| 26 | | 0.10 | VBVR-Pro; Open Source; Video | Feb 2025 | Official leaderboard |
| 27 | | 0.09 | VBVR-Pro; Open Source; Video | Jul 2025 | Official leaderboard |
| 28 | | 0.09 | VBVR-Pro; Open Source; Image | May 2025 | Official leaderboard |
| 29 | CogVideoX1.5-5B-I2V | 0.09 | VBVR-Pro; Open Source; Video | Official leaderboard | |
| 30 | HunyuanVideo-I2V | 0.05 | VBVR-Pro; Open Source; Video | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official VBVR-Bench leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official VBVR-Bench leaderboard
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in World models
- AgentWorldBench In use Language world models predict the next environment observation after an agent action, in 7 domains from MCP and search to Android and desktop OS. A judge model scores each prediction against the real observation on five dimensions. GPT-5.4 58.3
- IntPhys 2 In use Models watch simulated videos and judge whether each event is physically possible, testing object permanence, immutability, continuity and solidity. Scored by accuracy.
Muse Spark Open 68.3%
- QwenWorldBench Fading Models act as world models that simulate agent environments in 7 domains, such as terminal, web, and Android. A rubric judge scores five dimensions.
Qwen3.7-Plus 62.1%
- VPCT Fading Models view an image of a ball, ramps, and three buckets and predict which bucket the ball falls into. Scored by accuracy on 100 problems.
Gemini 3 Pro 91%
- ContPhy Fading Models infer physical properties such as mass and density of fluids and soft bodies from videos and predict their dynamics.
Seed2.0 Pro 67.4%
- RBench Only in system cards 650 image+text prompts for robot video generation (tasks and embodiments). MLLM judge scores task completion, physical plausibility, stability.
Wan 2.6 60.7%