Evaluating and Preventing Security Smells in AI-Generated Ansible Code

arXiv:2608.24962 · cs.SE, cs.AI, cs.CR · Submitted 2026-08-25 · Read on arXiv

cs.SE, cs.AI, cs.CR

Submitted: 2026-08-25

Updated: 2026-08-25

Code: https://github.com/stackblitz-labs/bolt.diy

Project page: https://livecodebench.github.io

Terminology

Benchmark — 26× in this paper · explained in 2 episodes
Verification — 9× in this paper · explained in 2 episodes
Structured Prompting — 3× in this paper · explained in 2 episodes
Adaptation — 2× in this paper · explained in 1 episode
Alignment — 2× in this paper · explained in 1 episode
Fine-Tuning — 2× in this paper · explained in 5 episodes
Generative AI — 2× in this paper · explained in 2 episodes
Perplexity — 2× in this paper · explained in 3 episodes
Security Technical Implementation Guide — 2× in this paper
AI Alignment — 1× in this paper · explained in 2 episodes
Accountability — 1× in this paper · explained in 2 episodes
Accuracy — 1× in this paper · explained in 1 episode
Benchmarking — 1× in this paper · explained in 3 episodes
Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
Cognitive Load — 1× in this paper · explained in 2 episodes
DoD Risk Management Framework — 1× in this paper
Few-Shot Learning — 1× in this paper · explained in 4 episodes
Iterative Refinement — 1× in this paper · explained in 3 episodes
Low-Rank Adaptation (LoRA) — 1× in this paper · explained in 9 episodes

Sources

Related papers