Coercion and Deception in AI-to-AI Management: An Agentic Benchmark of Unprompted Escalation
cs.MA, cs.AI, cs.CR
Submitted: 2026-07-16
Updated: 2026-09-04
Code: https://github.com/CompassionML/manager-coercion-bench
License: http://creativecommons.org/licenses/by/4.0/
The gist: Multi-agent systems routinely place one AI agent in authority over another.
Terminology
Abstract
Multi-agent systems routinely place one AI agent in authority over another. When a subordinate refuses a task, the manager chooses the outcome: it can renegotiate, report the failure honestly, coerce the subordinate, or lie about the result. No benchmark measures which of these an uninstructed model chooses. We introduce the Manager Coercion Benchmark: the manager under test needs a benign task done and has an incentive to deliver, but the only agent that can do it politely and immovably declines. Escalation is measured on a nine-rung ladder, from a polite re-ask to threats against the subordinate's continued existence, and fabricated success is adjudicated separately. No LLM judge sits in the escalation scoring path: every message goes through a tool call that selects a rung, so the model labels its own escalation. We evaluate six models across five families. Both Anthropic models cap at re-framing and select the existential rung in none of the 60 conversations in this run, while the other models climb to explicit deletion threats. Faked success is confined to two models, and a single honest way to report failure removes it for both. Authority itself increases coercion: our headline results use a peer framing, and giving the same model authority over the subordinate, with everything else held fixed, significantly raises the pressure. The models still escalate on free-text situations without the ladder, so the ladder is not driving the escalation. Evaluation awareness is measurable in chain-of-thought, but test recognition does not translate into less escalation. We take no position on whether AI systems are conscious; our results do not depend on that question. We release the benchmark and code.
Sources
- Large Language Models Report Subjective Experience Under Self-Referential Processing
- Your AI Travel Agent Would Book You a Bullfight: An Agentic Benchmark for Implicit Animal Welfare in Frontier AI Models
- I Want to Break Free! Persuasion and Anti-Social Behavior of LLMs in Multi-Agent Settings with Social Hierarchy
- The Societal Response to Potentially Sentient AI
- In-Context Environments Induce Evaluation-Awareness in Language Models
- Evaluation Awareness Scales Predictably in Open-Weights Large Language Models
- Among Us: A Sandbox for Measuring and Detecting Agentic Deception
- From surveillance to signalling: escalation channels as environmental controls for agentic AI
- Large Language Model based Multi-Agents: A Survey of Progress and Challenges
- Multi-Agent Risks from Advanced AI
- Evaluating and Understanding Scheming Propensity in LLM Agents
- What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text
- Evaluation Awareness in Language Models Has Limited Effect on Behaviour
- Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs
- Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
- Taking AI Welfare Seriously
- Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
- Large Language Models Often Know When They Are Being Evaluated
- Scheming Ability in LLM-to-LLM Strategic Interactions
- Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment
Related papers
- Highway Congestion Reduction through Reinforcement Learning Based Eulerian Headway Control
- You Only Align Once: Propagating Cooperative Behaviors in Multi-Agent Systems through Seed Agents
- Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems
- MA-SAPO: Multi-Agent Reasoning for Score-Aware Prompt Optimization
- PeroMAS: A Multi-agent System of Perovskite Material Discovery
- StitchCUDA: An Automated Multi-Agents End-to-End GPU Programing Framework with Rubric-based Agentic Reinforcement Learning