Does Graph Structure Earn Its Place in Microservice Root-Cause Analysis? A Controlled Study on RCAEval, and What the Benchmark Was Really Measuring

arXiv:2609.27069 · cs.SE, cs.LG · Submitted 2026-09-22 · Read on arXiv

cs.SE, cs.LG

Submitted: 2026-09-22

Updated: 2026-09-22

Code: https://github.com/phamquiluan/RCAEval

Terminology

• Benchmark — 23× in this paper · explained in 2 episodes
• Ablation — 9× in this paper · explained in 1 episode
• Accuracy — 5× in this paper · explained in 1 episode
• Reinforcement Learning — 3× in this paper · explained in 4 episodes
• Hypergraph — 2× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Deep Reinforcement Learning — 1× in this paper · explained in 2 episodes
• Entanglement — 1× in this paper · explained in 3 episodes
• GNNs — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Are GNNs Actually Effective for Multimodal Fault Diagnosis in Microservice Systems?
• Graph-Free Root Cause Analysis
• Rethinking the Evaluation of Microservice RCA with a Fault Propagation-Aware Benchmark
• RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data
• CHASE: A Causal Hypergraph based Framework for Root Cause Analysis in Multimodal Microservice Systems
• LEMMA-RCA: A Large Multi-modal Multi-domain Dataset for Root Cause Analysis
• Accounting for Variance in Machine Learning Benchmarks
• Deep Reinforcement Learning that Matters
• Deep Reinforcement Learning at the Edge of the Statistical Precipice

Related papers

• Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
• GitSkills: A Dataset of Agent Skills on GitHub
• SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
• PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
• IntentCoding: Amplifying User Intent in Code Generation
• Incentives and Outcomes in Bug Bounties