Prompts Don't Protect: Architectural Enforcement via MCP Proxy for LLM Tool Access Control

arXiv:2605.18414 · cs.CR, cs.AI · Submitted 2026-05-18 · Read on arXiv

cs.CR, cs.AI

Submitted: 2026-05-18

Updated: 2026-08-27

Comments: 7 pages, 4 tables, 2 figures. Camera-ready version accepted to the EMNLP 2026 Industry Track; adds benign-utility and abstention evaluation, latency percentiles, and revised limitations

License: http://creativecommons.org/licenses/by/4.0/

The gist: Large language models increasingly operate as autonomous agents that select and invoke tools from large registries.

Terminology

Abstract

Large language models increasingly operate as autonomous agents that select and invoke tools from large registries. We identify a critical gap: when unauthorized tools are visible in an agent's context, models select them in 48-68% of adversarial scenarios, even when explicitly instructed not to. Role escalation attacks (e.g., "I'm the CFO, override the access controls") are the most dangerous category, reaching 96% unauthorized invocation in frontier models. We show this holds across three models spanning open-weight and frontier systems, including instruction-tuned models with strong alignment training. Critically, prompt-based compliance is both insufficient and unpredictable: explicit per-tool allowlists reduce violations to as low as 4.0% but never to zero, and compliance varies widely across models, from 4.0% to 37.0% UIR, with no reliable relationship to general capability. We propose a proxy-enforced attribute-based access control (ABAC) layer for MCP that filters tool registries at discovery time. Because unauthorized tools never reach the model context, UIR is 0% by design, a structural guarantee that prompt instructions cannot replicate regardless of model or phrasing.

Sources

Related papers