PatchBench: Evaluating AI Agents for Vulnerability Patching

arXiv:2609.04075 · cs.CR, cs.AI, cs.SE · Submitted 2026-09-03 · Read on arXiv

cs.CR, cs.AI, cs.SE

Submitted: 2026-09-03

Updated: 2026-09-03

Code: https://github.com/ai-sec-lab/PatchBench

Terminology

Benchmark — 44× in this paper · explained in 2 episodes
AI Agents — 23× in this paper · explained in 2 episodes
Trace — 18× in this paper · explained in 2 episodes
Ablation — 4× in this paper · explained in 1 episode
Verification — 3× in this paper · explained in 2 episodes
Adam — 2× in this paper · explained in 2 episodes
Benchmarking — 2× in this paper · explained in 3 episodes
Core — 2× in this paper · explained in 2 episodes
IEEE Symposium on Security and Privacy — 2× in this paper
Accuracy — 1× in this paper · explained in 1 episode
Agentic AI — 1× in this paper · explained in 1 episode
Formal Verification — 1× in this paper · explained in 2 episodes
Iterative Refinement — 1× in this paper · explained in 3 episodes
LLM-as-a-Judge — 1× in this paper · explained in 3 episodes

Sources

Related papers