Benchmark Almanac

WorldArena

Not in model cards

Embodied world models generate RoboTwin 2.0 task videos from first frame plus text or actions. 15 video metrics (EWMScore) plus utility tracks.

Compressed: top 40 Track-1 entries within 68.9-73.6 EWMScore. Policy-evaluator track saturated (14 of 19 above 85). Extended by WorldArena 2.0.

In the authors’ words

While world models have emerged as a cornerstone of embodied intelligence by enabling agents to reason about environmental dynamics through action-conditioned prediction, their evaluation remains fragmented. Current evaluation of embodied world models has largely focused on perceptual fidelity (e.g., video generation quality), overlooking the functional utility of these models in downstream decision-making tasks. In this work, we introduce WorldArena, a unified benchmark designed to systematically evaluate embodied world models across both perceptual and functional dimensions. WorldArena assesses models through three dimensions: video perception quality, measured with 16 metrics across six sub-dimensions; embodied task functionality, which evaluates world models as data engines, policy evaluators, and action planners integrating with subjective human evaluation. Furthermore, we propose EWMScore, a holistic metric integrating multi-dimensional performance into a single interpretable index. Through extensive experiments on 14 representative models, we reveal a significant perception-functionality gap, showing that high visual quality does not necessarily translate into strong embodied task capability. WorldArena benchmark with the public leaderboard is released at https://world-arena.ai, providing a framework for tracking progress toward truly functional world models in embodied AI.

Abstract of WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models (arXiv:2602.08971, CC0)
Made by Tsinghua FIB Lab Released Feb 2026 Video world models All tasks public
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Open-ended Free-form text, documents, designs or media judged as a whole.

No scores here yet

We have no scores for WorldArena yet.

See the live leaderboard on huggingface.co

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

Versions

More in World models

All 34 in World models
  • AgentWorldBench In use Language world models predict the next environment observation after an agent action, in 7 domains from MCP and search to Android and desktop OS. A judge model scores each prediction against the real observation on five dimensions. Qwen-AgentWorld-35B-A3B 56.4
  • IntPhys 2 In use Models watch simulated videos and judge whether each event is physically possible, testing object permanence, immutability, continuity and solidity. Scored by accuracy. Muse Spark Open 68.3%
  • QwenWorldBench Fading Models act as world models that simulate agent environments in 7 domains, such as terminal, web, and Android. A rubric judge scores five dimensions. Qwen3.7-Plus 62.1%
  • VPCT Fading Models view an image of a ball, ramps, and three buckets and predict which bucket the ball falls into. Scored by accuracy on 100 problems. Gemini 3 Pro 91%
  • ContPhy Fading Models infer physical properties such as mass and density of fluids and soft bodies from videos and predict their dynamics. Seed2.0 Pro 67.4%
  • MVPBench Dropped Models answer video questions on spatial, temporal and intuitive physics. Each question comes in a pair of near-identical videos with opposite answers, so text or single-frame shortcuts fail. gemini-robotics-er-1.5-preview 72.5%