Where MLLMs Fail and Why: Causal Task Decomposition for Capability Failure Diagnosis
cs.CL, cs.AI, cs.CV, cs.LG
Submitted: 2026-09-30
Updated: 2026-09-30
Code: https://github.com/anuragxel/roadwork-dataset
Terminology
Sources
- CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures
- BabyVision: Visual Reasoning Beyond Language
- Reasoning Models Don't Always Say What They Think
- Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark
- Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs
- Causal Agent Replay: Counterfactual Attribution for LLM-Agent Failures
- Kimi K2.5: Visual Agentic Intelligence
- From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems
- Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting
- Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering