Data Leakage Prevention in Agentic Applications via Preemptive Hardening

arXiv:2607.18847 · cs.CR, cs.AI · Submitted 2026-07-21 · Read on arXiv

Akansha Shukla, Emily Bellov, Parth Atulbhai Gandhi, Yuval Elovici, Asaf Shabtai

cs.CR, cs.AI

Submitted: 2026-07-21

Code: https://github.com/langchain-ai/langchain

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Analyzer — 20× in this paper · explained in 1 episode
• Agentic System — 11× in this paper · explained in 2 episodes
• Benchmark — 11× in this paper · explained in 2 episodes
• Hallucination — 4× in this paper · explained in 3 episodes
• Generalization — 3× in this paper · explained in 13 episodes
• Multi-Agent System — 3× in this paper · explained in 6 episodes
• Provenance — 3× in this paper · explained in 4 episodes
• AI Agents — 2× in this paper · explained in 2 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Agentic AI — 2× in this paper · explained in 1 episode
• Attack Success Rate — 2× in this paper
• Attack Success Rate (ASR) — 2× in this paper · explained in 2 episodes
• Consistency — 2× in this paper · explained in 3 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Adaptive Safety — 1× in this paper · explained in 1 episode
• Adversarial Attacks — 1× in this paper · explained in 1 episode
• Adversarial scenarios — 1× in this paper · explained in 1 episode
• Agent Interactions — 1× in this paper · explained in 1 episode
• Agent Skills — 1× in this paper · explained in 1 episode
• Agentic Components — 1× in this paper · explained in 1 episode
• Chain-of-Thought (CoT) — 1× in this paper · explained in 4 episodes
• Computational overhead — 1× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Data Provenance — 1× in this paper · explained in 2 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Information Leakage — 1× in this paper · explained in 2 episodes
• Iterative Refinement — 1× in this paper · explained in 3 episodes
• LLM judge — 1× in this paper · explained in 2 episodes
• Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• State Management — 1× in this paper · explained in 3 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Utility Under Attack — 1× in this paper

Sources

• AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
• Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
• Identifying the Risks of LM Agents with an LM-Emulated Sandbox
• A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?
• "Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild
• Fault-Tolerant Sandboxing for AI Coding Agents: A Transactional Approach to Safe Autonomous Execution
• Proactive defense against LLM Jailbreak
• Defending Against Prompt Injection With a Few DefensiveTokens
• Defense Against Prompt Injection Attack by Leveraging Attack Techniques
• StruQ: Defending Against Prompt Injection with Structured Queries
• PromptShield: Deployable Detection for Prompt Injection Attacks
• LlamaFirewall: An open source guardrail system for building secure AI agents
• Securing AI Agents with Information-Flow Control
• Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents
• Permissive Information-Flow Analysis for Large Language Models
• RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage
• AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection
• Progent: Securing AI Agents with Privilege Control
• Defeating Prompt Injections by Design
• IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems

Related papers

• SoK: AI-Augmented Binary Reversing
• Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
• Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
• Efficient Fuzzy PSI under One-Sided Assumptions
• Sealing the Audit-Runtime Gap for LLM Skills
• Token Composition: A Graph Based on EVM Logs