Natural-Language to SysMLv2 Translation via Conformance-Driven Iterative Refinement

arXiv:2607.14162 · cs.SE, cs.AI · Submitted 2026-07-14 · Read on arXiv

cs.SE, cs.AI

Submitted: 2026-07-14

Updated: 2026-07-14

Comments: Accepted for presentation and publication in the Proceedings of the ASME 2026 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2026)

Code: https://github.com/cmuchancel/NL-to-SysMLv2-via-Conformance-Driven-Refinement

Project page: https://valerio-terragni.github.io/assets/pdf/ravi-icsme-2025.pdf

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 17× in this paper · explained in 2 episodes
• Model-Based Systems Engineering — 8× in this paper
• Verifier — 7× in this paper · explained in 2 episodes
• Trace — 6× in this paper · explained in 2 episodes
• Consistency — 5× in this paper · explained in 3 episodes
• Generative AI — 5× in this paper · explained in 2 episodes
• Verification — 5× in this paper · explained in 2 episodes
• Alignment — 4× in this paper · explained in 1 episode
• Semantic Alignment — 4× in this paper · explained in 3 episodes
• Department of Defense — 3× in this paper
• Failure Modes — 3× in this paper · explained in 3 episodes
• Formal Methods — 3× in this paper · explained in 3 episodes
• Iterative Refinement — 3× in this paper · explained in 3 episodes
• Abstraction — 2× in this paper · explained in 1 episode
• Model-Agnostic — 2× in this paper · explained in 2 episodes
• Ontology — 2× in this paper · explained in 2 episodes
• Robustness — 2× in this paper · explained in 5 episodes
• Agentic Loop — 1× in this paper · explained in 1 episode
• Convergence Guarantees — 1× in this paper · explained in 3 episodes
• Cooperation — 1× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Formal Methods in Computer-Aided Design — 1× in this paper
• Grounding — 1× in this paper · explained in 3 episodes
• Hallucination — 1× in this paper · explained in 4 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Multi-Agent System — 1× in this paper · explained in 6 episodes
• Nadia — 1× in this paper · explained in 2 episodes
• Structured Prompting — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• A System Model Generation Benchmark from Natural Language Requirements
• Compiler generated feedback for Large Language Models
• Intelligent requirements engineering from natural language and their chaining toward CAD models
• Text to model via SysML: Automated generation of dynamical system computational models from unstructured natural language text via enhanced System Modeling Language diagrams
• Grammar-Aligned Decoding
• VeCoGen: Automating Generation of Formally Verified C Code with Large Language Models
• Counterexample Guided Program Repair Using Zero-Shot Learning and MaxSAT-based Fault Localization
• VerMCTS: Synthesizing Multi-Step Programs using a Verifier, a Large Language Model, and Tree Search

Related papers

• Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
• GitSkills: A Dataset of Agent Skills on GitHub
• SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
• PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
• IntentCoding: Amplifying User Intent in Code Generation
• Incentives and Outcomes in Bug Bounties