EngiWorld: What Can Frontier Agents Deliver in Professional Engineering Environments?

arXiv:2609.37686 · cs.AI, cs.CL · Submitted 2026-09-29 · Read on arXiv

cs.AI, cs.CL

Submitted: 2026-09-29

Updated: 2026-09-29

Project page: https://engiworld.github.io

Terminology

• Benchmark — 35× in this paper · explained in 2 episodes
• Verifier — 28× in this paper · explained in 2 episodes
• Ablation — 8× in this paper · explained in 1 episode
• Benchmarking — 6× in this paper · explained in 3 episodes
• Consistency — 5× in this paper · explained in 3 episodes
• Failure Modes — 3× in this paper · explained in 3 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Calibration — 2× in this paper · explained in 7 episodes
• Verification — 2× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Action Space — 1× in this paper · explained in 1 episode
• Agentic Workflows — 1× in this paper · explained in 1 episode
• Aperture — 1× in this paper · explained in 1 episode
• Conference on Computer Vision and Pattern Recognition — 1× in this paper
• Core — 1× in this paper · explained in 2 episodes
• Failure Taxonomy — 1× in this paper · explained in 2 episodes
• Feature Selection — 1× in this paper · explained in 4 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Iterative Refinement — 1× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Multi-Agent Framework — 1× in this paper · explained in 3 episodes
• Physical Constraints — 1× in this paper · explained in 7 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Structural Constraints — 1× in this paper · explained in 2 episodes

Sources

• MetaOpenFOAM: an LLM-based multi-agent framework for CFD
• CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design
• SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
• Using GUI Agent for Electronic Design Automation
• Text-to-CAD Evaluation with CADTests
• FEABench: Evaluating Language Models on Multiphysics Reasoning Ability
• BIM-Edit: Benchmarking Large Language Models for IFC-Based Building Information Modeling
• AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
• CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulation
• ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows
• Agents' Last Exam
• OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
• Foam-Agent 2.0: An End-to-End Composable Multi-Agent Framework for Automating CFD Simulation in OpenFOAM
• WebArena: A Realistic Web Environment for Building Autonomous Agents

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection