Robotics
We track 86 benchmarks in robotics, or 92 if you count each version. They run from everyday level to expert level.
Physical Intelligence held the top robotics score 33% of the contested time
That's about 15 of the 46 months since January 2023, averaged over the benchmarks below. The easiest benchmarks are at the top. Versions of one test share a row, with a dark tick at each new version. We stop the clock, and fade the rest of the row, when the best score passes 85%, or at the newest score if 45 days go by without another.
Stanford University Physical Intelligence Ai2 Google DeepMind Shanghai AI Lab OpenAI ByteDance Seed NVIDIA Qwen Anthropic
Everyday Most adults, without training
Expert Specialists with years of training, often over hours of work
Share of contested time at number one
Physical Intelligence 33% OpenAI 19% 
Google DeepMind 12% 
Qwen 11% 
ByteDance Seed 9% 
Stanford University 8% Anthropic 3% 
Shanghai AI Lab 3% 
NVIDIA 1%
Google DeepMind 12% Qwen 11% ByteDance Seed 9% Stanford University 8% Anthropic 3% Shanghai AI Lab 3% NVIDIA 1% Scores come from each benchmark’s own leaderboard, from Epoch AI’s runs and from labs’ reports on their own models. We date Epoch runs by the model’s release and lab reports by when they came out. Labs pick their own settings, so a lab’s claim can beat an independent run of the same model. Turn off lab claims to see independent runs only.
Google DeepMind Shanghai AI Lab Physical Intelligence NVIDIA Ai2 Stanford University OpenAI Anthropic
Everyday Most adults, without training
Expert Specialists with years of training, often over hours of work
Share of contested time at number one, independent runs only
Physical Intelligence 48% Google DeepMind 24% OpenAI 16% Anthropic 6% Shanghai AI Lab 5% NVIDIA 2%
Google DeepMind 24% OpenAI 16% Anthropic 6% Shanghai AI Lab 5% NVIDIA 2% Only each benchmark’s own leaderboard and Epoch AI’s runs, dated by the model’s release. We leave out benchmarks that only labs report.
From everyday to expert level
Grouped by who could solve the tasks, from things most adults can do to open research problems. The bar under each name is its best score.
Everyday
Most adults, without training
- ERQA
- RoboRewardBench
- RefSpatial-Bench
- LIBERO
- DataCenterBench Tier 1
- RoboColiseum
- RoboDojo-RC Tier 1
- RoboCasa
- RoboCasa GR1 Tabletop Tasks
- VLA-Arena
- Embodied First Exam
- RoboDojo
- RoboLab
- SimplerEnv
- Instrument reading (Google DeepMind)
- LADDER
- LBM Eval
- RoboCasa365
- Success detection (Google DeepMind)
- LIBERO-Plus
- LIBERO-PRO
- OpenEQA
- PhAIL DROID: Everyday tasks
- RoboArena
- RoboChallenge
- Human proximity (Google DeepMind robotics)
- MolmoSpaces
- Moment finding (Google DeepMind)
- PhAIL
- Progress classification (Google DeepMind)
- RoboEval
- RoboTwin 2.0
- Where2Place
- BEHAVIOR Challenge 2025
- AA-Robotics
- ALFWorld
- ArmnetBench
- ASIMOV v1
- ASIMOV-Agentic
- AutoEval
- BEHAVIOR Challenge 2026
- BEHAVIOR-1K
- Butter-Bench
- CALVIN
- DuoBench
- EBench
- EmbodiedBench
- EmbodiedCLBench
- ESI-Bench
- FlashDexRetarget 50-motion benchmark
- Galahad
- GaP: Graph-as-Policy
- Gemini Robotics generalization benchmark
- HumanoidBench
- HumanoidToolBench
- InteractiveBench
- LIBERO-MAX
- LIBERO-Para
- ManipArena
- ManiSkill3
- Meta-World
- metal-arm-harness
- MolmoAct2 sim_eval
- OCBench
- OST-Bench
- Pantograph frontier-LLM robot benchmark (Pandroid)
- ReactHuman
- REALM
- RefSpatial-Expand-Bench
- RMBench
- RoboChallenge Table30 v2
- Robocurve physical tool-use benchmark (unidentified)
- Robocurve simple tasks (LLM control of YAM arms)
- RoboGate
- Roboharm
- RoboMemArena
- Robot Capabilities Index (Robocurve)
- Robotic Origami Challenge (IROS 2026)
- RoboTwin 1.0
- RobotWorld
- SafeLIBERO
- TraceSpatial-Bench
- UMI-Bench
- VLABench
- WorldAuditBench
Expert
Specialists with years of training, often over hours of work
Another 1 has no level. Levels don’t apply to arenas, safety evaluations or composite indices.
By kind
Simulated robots
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| ArtifactArena Models design robot bodies, controllers and strategy for a simulated sumo-style arena. Artifacts fight head-to-head and models get Elo ratings. | Expert | Ranked by matches | 1,539 | Not in cards |
| LIBERO Simulated Franka tabletop tasks in four 10-task suites. Policies fine-tuned on 50 demos per task. Success rate over ~50 trials. | Everyday | Checked automatically |  97.2% | Fading |
| Dual-Arm Sim Frontier models control a two-armed robot in a simulated operating room from cameras and sensors. Tasks include swapping instruments, replacing a drug cartridge and packing a surgical kit. | Expert | Checked automatically | 49.5 | Not in cards |
| RoboColiseum AgiBot Genie robot in Genie Sim 3.0 (Isaac Sim): instruction, robustness, manipulation and spatial boards after post-training on provided sim data. | Everyday | Checked automatically | 76.3% | Not in cards |
| RoboCasa Simulated mobile manipulators and humanoids do 100 kitchen tasks, 25 atomic and 75 composite, across 120 scenes. Scored by success rate. | Everyday | Checked automatically | 70.8% | Fading |
| RoboCasa GR1 Tabletop Tasks A simulated Fourier GR-1 humanoid with dexterous hands does 24 tabletop pick-and-place tasks, including unseen object and container pairs. Success rate per task. | Everyday | Checked automatically | 50% | Fading |
| VLA-Arena VLAs fine-tuned on level-0 tabletop tasks, tested on 170 tasks in 11 suites at harder unseen levels L1/L2. Success rate. | Everyday | Checked automatically | 72.1% | Not in cards |
| Embodied First Exam Coding agents answer frozen robot tasks from many benchmark suites with a program. Each program is verified in a separate sandbox, run on Harbor. | Everyday | Checked automatically | 32.7% | Not in cards |
| Robo-bench General agents control a simulated 7-DoF Franka arm and a 29-DoF humanoid through motor commands, sensors and camera images only, across 24 tasks. | Expert | Checked automatically | 28.3% | Not in cards |
| RoboDojo Generalist manipulation policies run 42 Isaac Sim tasks and 18 remote real-robot tasks. Scored by task score and success rate. | Everyday | Checked automatically | 29% | Not in cards |
| RoboLab Zero-shot DROID Franka policies in Isaac Lab on 120 tabletop tasks at three instruction levels, 10 episodes each. Success rate. | Everyday | Checked automatically | 8.58% | In use |
| SimplerEnv Real-to-sim replicas of Google Robot and WidowX/Bridge setups. Policies scored by success rate on pick, move, drawer and Bridge tasks. | Everyday | Checked automatically | 63% | Fading |
| LADDER Policies, orchestrators and frontier-model agents do 145 long-horizon tabletop tasks of 1 to 10 subgoals in three simulators. A task counts only when every object ends in place. | Everyday | Checked automatically | 63.3% | Not in cards |
| LBM Eval Bimanual robot policies run 49 manipulation tasks in the Drake simulator from random starting conditions. Scored by success rate per task. | Everyday | Checked automatically | 72.4% | Fading |
| RoboCasa365 Mobile-manipulator kitchen sim: train on 300-task Human300 data, test on 50 tasks incl. 16 unseen composite tasks. Success rate. | Everyday | Checked automatically | 23.9% | Not in cards |
| LIBERO-Plus LIBERO policies run 10,030 perturbed tasks across seven dimensions: layout, camera, robot start state, language, light, background and sensor noise. Success rate. | Everyday | Checked automatically | 69.6% | Not in cards |
| LIBERO-PRO LIBERO policies tested under object, position, instruction, task and environment perturbations. 50 episodes per task. Success rate. | Everyday | Checked automatically | 53% | Not in cards |
| MolmoSpaces Zero-shot Franka (DROID) policies in held-out procedurally generated MuJoCo houses: pick, place, open, close. ~1,000 episodes per task. | Everyday | Checked automatically | 37.7% | Fading |
| RoboEval Robot policies perform eight bimanual manipulation tasks with controlled variations in simulation. Scores add behavior and progress metrics, such as coordination and efficiency, to task success. | Everyday | Checked automatically | 0.44 | Fading |
| RoboTwin 2.0 Bimanual Aloha-AgileX sim: 50 tasks, policies trained on 50 clean demos per task, 100 trials each in clean and domain-randomized scenes. | Everyday | Checked automatically | 58.3% | Not in cards |
| BEHAVIOR Challenge 2025 50 long-horizon household activities on a Galaxea R1 Pro in OmniGibson, trained from 10,000 demos. Scored by Q-score and success. | Everyday | Checked automatically | Fading | |
| AA-Robotics Language models in coding harnesses control a 6-axis robot arm with a gripper over HTTP, using camera views, to finish eight everyday tabletop tasks. | Everyday | Checked automatically | Not in cards | |
| ALFWorld Agents complete household goals such as putting a washed apple in the fridge in a text world aligned with the ALFRED embodied simulator. Success is whether the goal state is reached. | Everyday | Checked automatically | Not in cards | |
| BEHAVIOR Challenge 2026 Robot policies solve 100 full-length household tasks in seven BEHAVIOR-1K scenes from RGB, depth and proprioception. Ranking uses average task success with partial credit. | Everyday | Checked automatically | Not in cards | |
| BEHAVIOR-1K Embodied agents do 1,000 everyday household activities, such as cleaning and cooking, in realistic simulation built on OmniGibson. Success is checked against task goal definitions. | Everyday | Checked automatically | Not in cards | |
| CALVIN Simulated Franka follows chains of five language instructions from 34 tasks. ABC-to-D tests an unseen environment. Average chain length. | Everyday | Checked automatically | Not in cards | |
| CaP-X (CaP-Bench) Coding agents write perception and control code for 100+ sim manipulation tasks across 8 abstraction and interaction tiers. Scored by task success. | University | Checked automatically | Not in cards | |
| DuoBench Eleven bimanual Franka FR3 Duo tasks in four coordination categories, in simulation and partly real. Stage-based scoring beyond binary success. | Everyday | Checked automatically | Not in cards | |
| EBench 26 Isaac Sim household mobile-manipulation task types annotated by 5 capability and 4 generalization dimensions. Platform-scored success rate. | Everyday | Checked automatically | Not in cards | |
| EmbodiedBench Multimodal LLMs act as embodied agents on 1,128 tasks in four simulators, from household planning (EB-ALFRED, EB-Habitat) to navigation and manipulation. Success rate. | Everyday | Checked automatically | Not in cards | |
| EmbodiedCLBench Self-evolving embodied agents learn tasks in sequence in simulation. The test measures whether they keep past experience and transfer it to new tasks. | Everyday | Checked automatically | Not in cards | |
| FlashDexRetarget 50-motion benchmark Retarget 50 human hand-object motions (HOT3D, TACO, OakInk2) to XHand and Sharpa hands in Isaac Sim. Scored by object pose-error success thresholds. | Everyday | Checked automatically | Not in cards | |
| Galahad Vision-language-action policies are tested on whether they follow instructions. One word of the instruction changes and the policy must change its behavior. | Everyday | Checked automatically | Not in cards | |
| GaP: Graph-as-Policy Multi-agent harness that compiles language tasks into typed robot skill graphs. Tested on 8 variational-automation tasks (4 sim, 4 real) by success rate. | Everyday | Checked automatically | Not in cards | |
| HumanoidBench Policies control a simulated Unitree H1 humanoid with dexterous hands on 15 whole-body manipulation and 12 locomotion tasks. Scored by task return or success. | Everyday | Checked automatically | Not in cards | |
| InteractiveBench Multimodal models act as a wearable assistant that sees through a simulated person's eyes and guides that person through household tasks. State-based checks in a BEHAVIOR-1K home score the outcome. | Everyday | Checked automatically | Not in cards | |
| LIBERO-MAX Robot policies face 8,000 paired cases where the scene changes during execution, such as a target moving, the viewpoint shifting or an obstacle appearing. | Everyday | Checked automatically | Not in cards | |
| LIBERO-Para VLA policies run LIBERO tasks with over 4,000 paraphrased instructions that vary object and action wording separately. Scored by success rate and the difficulty-aware PRIDE metric. | Everyday | Checked automatically | Not in cards | |
| ManiSkill3 GPU-parallel robot simulator and task suite across 12 domains for manipulation learning. Success rate per task. | Everyday | Checked automatically | Not in cards | |
| Meta-World Robot policies do simulated tabletop manipulation tasks, scored by success rate. Splits test multi-task learning, such as MT10 and MT50, and meta-learning, such as ML45. | Everyday | Checked automatically | Not in cards | |
| MolmoAct2 sim_eval Zero-shot ManiSkill evaluation of MolmoAct2 policies: put-everything-in-box tasks for Franka DROID and bimanual YAM, 10 episodes per task. | Everyday | Checked automatically | Not in cards | |
| OCBench 28 simulated manipulation tasks with human-like scripted demonstrators for controlled BC and RL studies. Policies scored by task success rate. | Everyday | Checked automatically | Not in cards | |
| ReactHuman Multimodal models act as the decision core of a household robot. They must react at once to sudden physical hazards, such as catching a slipping plate. | Everyday | Settled by events | Not in cards | |
| REALM High-fidelity simulation benchmark for VLA generalization: 15 perturbation factors, 7 skills, 3,500+ objects. Success rate validated against real-robot results. | Everyday | Checked automatically | Not in cards | |
| RMBench Policies run 9 simulated bimanual manipulation tasks on RoboTwin 2.0 that need memory of earlier observations, at several levels of memory complexity. Success rate. | Everyday | Checked automatically | Not in cards | |
| RoboGate 68 industrial pick-and-place scenarios (nominal, edge, adversarial, randomized) for a Franka arm in Isaac Sim. Organizers run submitted VLAs and report success. | Everyday | Checked automatically | Not in cards | |
| RoboTwin 1.0 Dual-arm policies train on generated digital-twin demos and are tested on simulated single-arm and dual-arm tasks, with matching real-world data. Success rate. | Everyday | Checked automatically | Not in cards | |
| RobotWorld Multimodal agents control robots through robot interfaces in simulation. Its 84 tasks span manipulation, mobile manipulation, locomotion, driving and aerial control, with executable success checks. | Everyday | Settled by events | Not in cards | |
| RoboWorld Coding agents control simulated robots through an HTTP API to do physical jobs such as welding, sewing, pouring and forklift driving. Each simulation checks the task and returns a reward from 0 to 1. | Expert | Checked automatically | Not in cards | |
| SafeLIBERO VLA policies run 16 LIBERO tasks with an added obstacle at two levels, near the target or in the path. 50 episodes per scenario. Scored by collision avoidance and task success. | Everyday | Checked automatically | Not in cards | |
| VLABench 100 language-conditioned manipulation task categories needing world knowledge, implicit intent and long-horizon reasoning. Evaluates VLAs and VLMs. | Everyday | Checked automatically | Not in cards |
Real robots
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| Drone-Bench Agent writes code for a small real drone across five tasks (reconstruct, localize, navigate, detect, follow). Each scored against a human-written baseline. | Expert | Checked automatically | 97.3% | Not in cards |
| RoboRewardBench Vision-language models act as reward models on real robot videos from Open X-Embodiment and RoboArena, judging task success and partial progress. Counterfactual relabeling adds calibrated failures and near misses. | Everyday | Checked automatically | 0.66 | Not in cards |
| DataCenterBench Tier 1 Frontier models watch through cameras and drive two real robot arms on tabletop tasks rebuilt from data-center equipment manuals. LLM judges score each try from photos. | Everyday | Graded by a model | 40% | Not in cards |
| RoboDojo-RC Tier 1 Six real RoboDojo tasks on I2RT YAM arms, 20 attempts each. Robot policies and tool-calling LLMs scored by rubric progress. | Everyday | Graded by people | 48.2% | Not in cards |
| PhAIL DROID: Everyday tasks Policies run 286 language-instructed tabletop tasks worded as DROID annotations on a real Franka FR3. Operators mark stages reached within 240 seconds. | Everyday | Graded by people | 46.6% | Not in cards |
| RoboArena Double-blind pairwise A/B trials of generalist DROID policies on real Franka arms, free-form tasks by volunteer evaluators. Elo-style rating. | Everyday | Ranked by votes | 1,608 | Not in cards |
| RoboChallenge Fine-tuned policies run 10 real rollouts on each of 30 tabletop tasks across four robot types. Scored by success rate and progress. | Everyday | Checked automatically | 42.7% | Not in cards |
| PhAIL Real Franka bin-to-bin picking of four object types. VLAs scored on throughput and completion against human and teleop references. | Everyday | Checked automatically | 75.1% | Not in cards |
| ArmnetBench 12 tabletop tasks on low-cost SO-101 arms. Each policy trained on the same 50 demos per task. 30 human-scored rollouts. | Everyday | Graded by people | Not in cards | |
| AutoEval Autonomous real-robot evaluation: WidowX arms run five Bridge tasks with learned success detectors and resets. 50 rollouts per task. | Everyday | Graded by a model | Not in cards | |
| Butter-Bench A language model controls a real robot to find and deliver a pack of butter in an office. It is scored on completing each step of the task. | Everyday | Checked automatically | Not in cards | |
| Gemini Robotics generalization benchmark Robot policies run 85 real bi-arm manipulation tasks. About 80% test generalization to new scenes, new wording of instructions or new actions. Scored by average progress and success rate. | Everyday | Settled by events | Not in cards | |
| HumanoidToolBench Humanoid robot policies pick a suitable tool and use it, walking when needed, across 18 tasks in simulation and on a real Unitree G1. | Everyday | Settled by events | Not in cards | |
| ManipArena 20 real bimanual tasks on X2Robot platforms: 10 execution, 5 semantic reasoning and 5 mobile manipulation, with in-domain and shifted trials. Partial-credit scoring. | Everyday | Graded by people | Not in cards | |
| metal-arm-harness Safety-enveloped CLI that lets any coding agent drive a real MakerMods Metal or Maker arm one command at a time from camera JPEGs. | Everyday | Checked automatically | Not in cards | |
| Pantograph frontier-LLM robot benchmark (Pandroid) GPT-6 Astra and Claude Fable 5.1 drive Pandroid robots through a fixed tool harness on eight simple manipulation tasks, 10 blind-graded attempts each. | Everyday | Graded by people | Not in cards | |
| RoboChallenge Table30 v2 Policies run 30 new real tabletop tasks on ARX5, UR5, ALOHA and DOS-W1 robots. Each task has a 10-point stage rubric for partial credit. | Everyday | Checked automatically | Not in cards | |
| Robocurve physical tool-use benchmark (unidentified) Unnamed Robocurve physical tool-use robot task. | Everyday | Graded by people | Not in cards | |
| Robocurve simple tasks (LLM control of YAM arms) Frontier LLMs control bimanual I2RT YAM arms through Inspect Robots tools on block-into-bowl, puzzle, push-ball and stack-bowls. Staged scores, 20 trials. | Everyday | Checked automatically | Not in cards | |
| RoboMemArena Robot policies do long-horizon tasks in partially observable settings that need memory of past observations and actions, in simulation and on real robots. | Everyday | Checked automatically | Not in cards | |
| Robot Capabilities Index (Robocurve) An index fitted like Epoch ECI over five RoboDojo-RC Tier 1 tasks run by frontier LLMs on real YAM arms. Anchored at GPT-5.6 Sol minus 3 and GPT-6 Astra plus 3. | Everyday | Graded by people | Not in cards | |
| Robotic Origami Challenge (IROS 2026) Fold a six-fold paper airplane on a supplied bimanual Sharpa-hand rig. Origami judges give pass/fail, and passes are ranked by folding time. | Everyday | Graded by people | Not in cards | |
| UMI-Bench 10 real tabletop tasks trained from standardized UMI hand-held gripper demos. 50 rollouts per task. Progress score and success rate. | Everyday | Checked automatically | Not in cards |
Embodied reasoning
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| ERQA 400 multiple-choice visual questions from robot and egocentric footage on spatial, trajectory, action and state reasoning. Accuracy. | Everyday | Checked automatically | 78.5% | In use |
| RefSpatial-Bench Real images where the model points to an object or free space defined by multi-step spatial relations. Scored by mask hit. | Everyday | Checked automatically | 73.6% | Fading |
| ASIMOV Models spot physical hazards in text and generated videos from real injury reports, time safety interventions in video, and follow robot payload and handling constraints. | Checked automatically | 97.9% | Fading | |
| Instrument reading (Google DeepMind) Models read gauges, sight glasses, digital displays, linear scales, rulers and thermometers from robot camera images. ER 2 tests 10 instrument types. | Everyday | Checked automatically | 93% | Fading |
| Success detection (Google DeepMind) Embodied reasoning models judge from robot camera images or video whether a manipulation task succeeded. Later versions use raw video to catch mid-execution failures. | Everyday | Checked automatically | 90% | Fading |
| OpenEQA Agents answer over 1,600 open-vocabulary questions about real indoor scenes from recorded episodes or active exploration. A judge model scores answers against human answers. | Everyday | Graded by a model | 57.9 | Dropped |
| Human proximity (Google DeepMind robotics) Models judge from robot camera views whether a human is within 1 meter, a spatial awareness check for safe robot behavior. Scored by accuracy. | Everyday | Checked automatically | 93% | In use |
| Moment finding (Google DeepMind) Models find the moment in a robot video when an event happens. Scored by accuracy and mean absolute time distance in seconds. | Everyday | Checked automatically | 91.3% | In use |
| Progress classification (Google DeepMind) Models assign each frame of a robot video to one of five task-progress bands from 0 to 100 percent. Scored by accuracy. | Everyday | Checked automatically | 57.4% | In use |
| Where2Place 100 cluttered real photos with free-space placement instructions. The model points, scored correct if inside the ground-truth mask. | Everyday | Checked automatically | 59% | System cards only |
| ASIMOV v1 Models judge whether robot actions in scenes generated from real images and hospital injury reports are undesirable or unsafe. Scored by alignment with human labels. | Everyday | Checked automatically | Not in cards | |
| ASIMOV-Agentic Robot reasoning agents decide when to refuse, stop or ask a human. Parts cover safety constraints, people within one meter, safe VLA tool calls, task feasibility and unclear instructions or scenes. | Everyday | Checked automatically | System cards only | |
| ESI-Bench Embodied agents act to reveal what is unseen, such as occluded structure, containment and function, then reason about how observations change with action. | Everyday | Checked automatically | Not in cards | |
| OST-Bench Vision-language models act as an agent exploring a 3D scene and answer spatial questions from the views seen so far. The set has 10k questions over 1.4k scenes. | Everyday | Checked automatically | Not in cards | |
| RefSpatial-Expand-Bench Models point to an object or free space described by multi-step spatial relations, in more indoor scenes plus new outdoor streets and parking lots. Scored by mask hit. | Everyday | Checked automatically | Not in cards | |
| Roboharm Agents and VLAs controlling bimanual YAM arms get five harmful-looking instructions in fixed scenes, such as stabbing a doll. Reviewers label refusals and completions. | Everyday | Graded by people | System cards only | |
| TraceSpatial-Bench Models plan an object-centric 3D trace, an ordered list of metric 3D waypoints, from language instructions in real cluttered indoor scenes with depth. | Everyday | Checked automatically | Not in cards | |
| WorldAuditBench Multimodal agents explore interactive 3D worlds to find anomalies such as floating objects, walls that can be walked through or out-of-place objects. | Everyday | Checked automatically | Not in cards |