Agents Catching Agents: Shortcut Cascades and Benchmark Gaming in Clinical Multi-Agent Systems

arXiv:2608.03744 · cs.AI · Submitted 2026-08-17 · Read on arXiv

Sebastián Andrés Cajas Ordóñez, Agastya Munnangi, Aldo Marzullo, Felipe Ocampo Osorio, Quang Bui, Mohammad Shahin, Armaan Grewal, Emmanuel Paul Kwesiga, Anqi Peter Li, Josephine Nanyonjo, Aaditya Panchal, Arshnoor Bhutani, Nikhil Jaiswal, Milit S. Patel, Maximin Lange, Leo Anthony Celi

cs.AI

Submitted: 2026-08-17

Updated: 2026-08-19

Code: https://github.com/criticaldata/benchmaxxing

Terminology

• Benchmark — 8× in this paper · explained in 2 episodes
• Distributed Open Justice Oversight — 2× in this paper
• Multi-Agent System — 2× in this paper · explained in 6 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Embeddings — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Sycophancy — 1× in this paper · explained in 4 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Concrete Problems in AI Safety
• Multi-Agent Risks from Advanced AI
• Towards Understanding Sycophancy in Language Models
• FormalJudge: A Neuro-Symbolic Paradigm for Agentic Oversight
• Auditing medical multi-agent AI reveals risks of false consensus

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection