CausalVQA
Not in model cards
Models answer questions about real egocentric videos that probe physical cause and effect, in counterfactual, hypothetical, anticipation, planning and descriptive types.
Released with V-JEPA 2. Videos need an Ego4D license. The leaderboard scores a held-out split of 793 question pairs with private answers.
- Level
- Everyday Most adults, without training
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Multiple choice
No scores here yet
We have no scores for CausalVQA yet.
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in World models
- AgentWorldBench In use Language world models predict the next environment observation after an agent action, in 7 domains from MCP and search to Android and desktop OS. A judge model scores each prediction against the real observation on five dimensions.
Qwen-AgentWorld-35B-A3B 56.4 - IntPhys 2 In use Models watch simulated videos and judge whether each event is physically possible, testing object permanence, immutability, continuity and solidity. Scored by accuracy.
Muse Spark Open 68.3% - QwenWorldBench Fading Models act as world models that simulate agent environments in 7 domains, such as terminal, web, and Android. A rubric judge scores five dimensions. Qwen3.7-Plus 62.1%
- VPCT Fading Models view an image of a ball, ramps, and three buckets and predict which bucket the ball falls into. Scored by accuracy on 100 problems.
Gemini 3 Pro 91% - ContPhy Fading Models infer physical properties such as mass and density of fluids and soft bodies from videos and predict their dynamics.
Seed2.0 Pro 67.4% - MVPBench Dropped Models answer video questions on spatial, temporal and intuitive physics. Each question comes in a pair of near-identical videos with opposite answers, so text or single-frame shortcuts fail. gemini-robotics-er-1.5-preview 72.5%