Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations

arXiv:2608.22444 · cs.CL · Submitted 2026-08-23 · Read on arXiv

cs.CL

Submitted: 2026-08-23

Updated: 2026-08-27

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Alignment — 9× in this paper · explained in 1 episode
• Calibration — 8× in this paper · explained in 7 episodes
• Provenance — 6× in this paper · explained in 4 episodes
• Robustness — 6× in this paper · explained in 5 episodes
• Trace — 4× in this paper · explained in 2 episodes
• AI Agents — 3× in this paper · explained in 2 episodes
• AUC — 3× in this paper · explained in 2 episodes
• Core — 2× in this paper · explained in 2 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Multi-Agent System — 2× in this paper · explained in 6 episodes
• Steering — 2× in this paper · explained in 2 episodes
• AI Alignment — 1× in this paper · explained in 2 episodes
• Accountability — 1× in this paper · explained in 2 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Agent Interactions — 1× in this paper · explained in 1 episode
• Consistency — 1× in this paper · explained in 3 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Self-consistency — 1× in this paper · explained in 2 episodes
• System Identification — 1× in this paper · explained in 3 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• The Coming Crisis of Multi-Agent Misalignment: AI Alignment Must Be a Dynamic and Social Process
• Visibility into AI Agents
• Steering the distribution of agents in mean-field and cooperative games
• AI Research Considerations for Human Existential Safety (ARCHES)
• Open Problems in Cooperative AI
• Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
• Group size effects and collective misalignment in LLM multi-agent systems
• Multi-Agent Risks from Advanced AI
• Conformity Generates Collective Misalignment in AI Agents Societies
• MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework
• Generative Agents: Interactive Simulacra of Human Behavior
• When Is Emergent Consensus Real? A Measured Coupling Gain and a Validity Diagnostic for LLM Agent Societies
• Improving Alignment and Robustness with Circuit Breakers

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering