Hy4 preview model card (Hugging Face) 28 Aug 2026
- SWE-bench Multilingual 82.9
- SWE-bench Pro 65.7
- DeepSWE 64.3
- Mean of SWE Atlas Codebase Q&A 64.0 / SWE Atlas Test Writing 57.8 / SWE Atlas Refactoring 53.3 58.4
- SWE-Marathon 31.9
- Terminal-Bench 2.1 85.4
- NL2Repo-Bench 58.9
- CyberGym 78.4
- ProgramBench 17.5
- PostTrainBench V1.1 35.6
- Harbor-Index 39.6
- Hy-Backend 2.0 (Internal) 35.2
- Hy-SWE Max Verified (Internal) 64.2
- Hy-CompanyBench V2 (Internal) 62.4
- WideSearch 83.9
- OneMillionBench (with tools) 65.4
- DRACO 77.2
- Hy-LifeSearch (Internal) 49.2
- Hy-BrowseComp-Pro2 (Internal) 56.1
- OfficeQA Pro 66.2
- MCP-Atlas (public) 83.7
- Toolathlon-Verified 74.1
- APEX-Agents (pass@1) 37.1
- SkillsBench (79, text-only) 62.9
- JobBench 61.7
- WorkspaceBench 60.2
- Agents' Last Exam (ALE-CLI) 22.8
- GDPval-AA V2 (Elo, official) 1678
- AutomationBench (v1.0.6) 32.1
- BankerToolBench 78.6
- E-Bench (Internal) 77.1
- E-Bench-Code (Internal) 79
- Hy-FinAgentBench (Internal) 79.7
- Hy-FinmodelBench v2 (Internal) 57
- BioMysteryBench 71.3
- Best of HLE (with tools, text-only) 55.4 / HLE (no tools, text-only) 43.4 55.4
- CritPt (official) 16.9
- GPQA Diamond 92.3
- SUPERChem 66.4
- ArXivMath 66.6
- HorizonMath (pass@4) 8.8
- MathArena Apex 2025 74.2
- BrokenArXiv 54.6