Engineering and CAD
We track 18 benchmarks in engineering and CAD. They run from university level to research frontier level.
Anthropic held the top engineering and CAD score 58% of the contested time
That's about 27 of the 46 months since January 2023, averaged over the benchmarks below. The easiest benchmarks are at the top. Versions of one test share a row, with a dark tick at each new version. We stop the clock, and fade the rest of the row, when the best score passes 85%, or at the newest score if 45 days go by without another.
Google DeepMind OpenAI Anthropic xAI Qwen
University Undergraduates and entry-level professionals
Expert Specialists with years of training, often over hours of work
Research frontier Researchers, on open problems or tasks that take days
Share of contested time at number one
Anthropic 58% OpenAI 38% 
Google DeepMind 4%
Google DeepMind 4% Scores come from each benchmark’s own leaderboard, from Epoch AI’s runs and from labs’ reports on their own models. We date Epoch runs by the model’s release and lab reports by when they came out. Labs pick their own settings, so a lab’s claim can beat an independent run of the same model. Turn off lab claims to see independent runs only.
Google DeepMind OpenAI Anthropic
University Undergraduates and entry-level professionals
Expert Specialists with years of training, often over hours of work
Research frontier Researchers, on open problems or tasks that take days
Share of contested time at number one, independent runs only
Anthropic 53% OpenAI 42% Google DeepMind 5%
Google DeepMind 5% Only each benchmark’s own leaderboard and Epoch AI’s runs, dated by the model’s release. We leave out benchmarks that only labs report.
From university to research frontier level
Grouped by who could solve the tasks, from things most adults can do to open research problems. The bar under each name is its best score.
Expert
Specialists with years of training, often over hours of work
Another 1 has no level. Levels don’t apply to arenas, safety evaluations or composite indices.
By kind
CAD models
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| Physical-Engineering's Last Exam Agents produce billable engineering deliverables such as calculation packages, drawings and design reviews in 85 tasks across electrical, civil, structural and mechanical engineering. Automatic graders check constraints, safety limits and the design objective. | Expert | Checked automatically | 0.49 | Not in cards |
| CadEval Models write OpenSCAD code for single mechanical parts from text descriptions. Rendered parts are checked against reference geometry, scored by pass rate. | University | Checked automatically | 74% | Not in cards |
| BenchCAD Programmatic CAD: 17,900 execution-verified CadQuery programs over 106 industrial part families. Four matched tasks scored on geometry. | University | Checked automatically | 95.9% | In use |
| Parametric CAD Bench Agents author editable parametric FreeCAD part designs, graded against held-back references for geometry and spec consistency. | Expert | Checked automatically | 61% | In use |
| BlenderWorld Visual agents turn a text, image or video brief into an editable Blender scene with rendered media. Hidden binary rubrics and eight visual quality dimensions score each project. | Expert | Graded by a model | 79.9 | Not in cards |
| CADGenBench Agents construct CAD models from design prompts. The generation split is graded for executability and geometric correctness. | University | Checked automatically | 45.1% | System cards only |
| CAD Arena Agents rebuild licensed engineering drawings as editable CAD parts through the scripting APIs of NX, SolidWorks, Onshape, Fusion or Build123d. A verifier scores geometric match. | Expert | Checked automatically | 0.75 | Not in cards |
| RWE-bench Agents do mechanical, electrical and aerospace design tasks, such as a crankshaft, dense PCB routing or turbine-vane cooling, with CAD and CAE tools. A deterministic verifier runs physics solvers and passes a design only if it meets every requirement. | Expert | Checked automatically | 37% | Not in cards |
| 3DCodeBench Agentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity. | Ranked by votes | 54% | System cards only | |
| PartBench Parametric mechanical part design and CAD-style generation, graded for geometric and manufacturing fidelity. | University | Checked automatically | 58.5% | System cards only |
| EngiWorld Agents work through the full industrial engineering design loop on 1,301 expert-curated tasks that need reasoning over geometric and physical constraints across software. | Expert | Checked automatically | Not in cards | |
| FrontierCAD Agents build 39 machined parts from engineering drawings and place parts into 16 assemblies, in their own coding harnesses. A verifier that tolerates rotation and checks hole positions scores the geometry. | Expert | Checked automatically | Not in cards | |
| LMBuild Language model agents design 3D structures as parts, joints, materials and assembly steps. Scoring checks that the structures can be built and work as intended. | Expert | Checked automatically | Not in cards | |
| SimRepairBench Agents find and repair modeling errors in 3D OpenUSD assets for robot simulation, from 25 damaged objects in NVIDIA's SimReady collection, with partial credit from verifiers. | Expert | Checked automatically | Not in cards |
Electronics
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| EEBench 13 electrical-engineering circuit and PCB design tasks graded by deterministic build checks, simulation and BOM constraints. No LLM judge. | Expert | Checked automatically | 75% | In use |
| Build-A-Chip-Bench Agents take a chip from workload specification to a routed GDS layout with open-source tools. Each design must pass hidden verification, routability and timing gates. | Research frontier | Checked automatically | 16.6% | Not in cards |
| CVDP Models and agents solve hardware design problems in Verilog, such as spec to RTL, code completion, debugging and testbench writing. Simulation tests check the outputs. | Expert | Checked automatically | Not in cards | |
| SimuVerity Agents build executable Simulink models from text for 101 tasks in ten engineering domains. Simulations check that each model meets its engineering requirements. | Expert | Checked automatically | Not in cards |