DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?

arXiv:2609.15122 · cs.SE, cs.AI · Submitted 2026-09-14 · Read on arXiv

cs.SE, cs.AI

Submitted: 2026-09-14

Updated: 2026-09-14

Comments: 29 pages, 3 figures, 20 tables. Preprint

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Calibration — 94× in this paper · explained in 7 episodes
• Computer Vision and Pattern Recognition — 10× in this paper
• Regret — 9× in this paper · explained in 3 episodes
• Benchmark — 8× in this paper · explained in 2 episodes
• Point Clouds — 8× in this paper · explained in 2 episodes
• Abstraction — 6× in this paper · explained in 1 episode
• Accuracy — 5× in this paper · explained in 1 episode
• Verification — 3× in this paper · explained in 2 episodes
• Alignment — 2× in this paper · explained in 1 episode
• CVF International Conference on Computer Vision — 2× in this paper
• Consistency — 2× in this paper · explained in 3 episodes
• Diffusion Model — 2× in this paper · explained in 8 episodes
• Exchangeability — 2× in this paper · explained in 2 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Instance Segmentation — 2× in this paper · explained in 3 episodes
• Representation Learning — 2× in this paper · explained in 2 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Accountability — 1× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Deep Reinforcement Learning — 1× in this paper · explained in 2 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Longitudinal Data — 1× in this paper · explained in 2 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Selection Bias — 1× in this paper · explained in 4 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generation
• BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD

Related papers

• Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
• GitSkills: A Dataset of Agent Skills on GitHub
• SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
• PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
• IntentCoding: Amplifying User Intent in Code Generation
• Incentives and Outcomes in Bug Bounties