When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agents

arXiv:2609.37153 · cs.AI, cs.CR · Submitted 2026-09-29 · Read on arXiv

cs.AI, cs.CR

Submitted: 2026-09-29

Updated: 2026-09-29

Project page: https://allisonhorst.github.io

Terminology

• Verification — 60× in this paper · explained in 2 episodes
• Core — 14× in this paper · explained in 2 episodes
• Benchmark — 12× in this paper · explained in 2 episodes
• Trace — 6× in this paper · explained in 2 episodes
• Accuracy — 5× in this paper · explained in 1 episode
• Benchmarking — 4× in this paper · explained in 4 episodes
• Abstention — 3× in this paper · explained in 1 episode
• Generalization — 3× in this paper · explained in 13 episodes
• Generative AI — 3× in this paper · explained in 2 episodes
• Validated Poison Adoption — 3× in this paper
• Annotator Agreement — 2× in this paper · explained in 1 episode
• Anomaly Detection Rate — 2× in this paper
• Blind Compliance Rate — 2× in this paper
• Calibration — 2× in this paper · explained in 7 episodes
• Recovery Rate — 2× in this paper
• Robustness — 2× in this paper · explained in 5 episodes
• Validation Rate — 2× in this paper
• Verifier — 2× in this paper · explained in 2 episodes
• Adaptivity — 1× in this paper · explained in 1 episode
• EMMA — 1× in this paper · explained in 2 episodes
• Hallucination — 1× in this paper · explained in 4 episodes
• Iterative Refinement — 1× in this paper · explained in 3 episodes
• LLM judge — 1× in this paper · explained in 2 episodes
• Poison Adoption Rate — 1× in this paper
• Poison Delivery Rate — 1× in this paper
• Provenance — 1× in this paper · explained in 4 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes

Sources

• Auditing Automated Evaluation, Error Propagation, and Runtime Mitigation in Tool-Using Language Agents
• MCP-ITP: An Automated Framework for Implicit Tool Poisoning in MCP
• AgentAtlas: Beyond Outcome Leaderboards for LLM Agents
• Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
• PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Cases
• The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection