Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal

arXiv:2505.15738 · cs.CR, cs.AI, cs.CL, cs.LG · Submitted 2025-05-21 · Read on arXiv

cs.CR, cs.AI, cs.CL, cs.LG

Submitted: 2025-05-21

Updated: 2026-10-08

Terminology

• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Agentic System — 1× in this paper · explained in 2 episodes
• Attack Success Rate (ASR) — 1× in this paper · explained in 2 episodes
• Greedy Coordinate Gradient — 1× in this paper
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Robustness — 1× in this paper · explained in 5 episodes

Related papers

• SoK: AI-Augmented Binary Reversing
• Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
• Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
• Efficient Fuzzy PSI under One-Sided Assumptions
• Sealing the Audit-Runtime Gap for LLM Skills
• Token Composition: A Graph Based on EVM Logs