FaulT-Bench: Towards Benchmarking Network Troubleshooting LLM Agents under Unreliable User Tickets

arXiv:2608.27021 · cs.NI, cs.AI · Submitted 2026-08-27 · Read on arXiv

cs.NI, cs.AI

Submitted: 2026-08-27

Updated: 2026-08-27

Code: https://github.com/Overlxrd-uwu/FaulT-Bench

Terminology

Benchmark — 32× in this paper · explained in 2 episodes
Accuracy — 9× in this paper · explained in 1 episode
LLM judge — 9× in this paper · explained in 2 episodes
Core — 6× in this paper · explained in 2 episodes
AI Agents — 5× in this paper · explained in 2 episodes
Benchmarking — 5× in this paper · explained in 3 episodes
Grounding — 5× in this paper · explained in 3 episodes
Trace — 3× in this paper · explained in 2 episodes
Agentic Framework — 2× in this paper · explained in 6 episodes
Agentic System — 2× in this paper · explained in 2 episodes
Diagnostic Tools — 2× in this paper · explained in 2 episodes
Failure Modes — 2× in this paper · explained in 3 episodes
Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
Robustness — 2× in this paper · explained in 5 episodes
Sycophancy — 2× in this paper · explained in 4 episodes
Twelfth International Conference on Learning Representations — 2× in this paper
Agent Memory — 1× in this paper · explained in 1 episode
Alignment — 1× in this paper · explained in 1 episode
European Telecommunications Standards Institute — 1× in this paper
Fidelity — 1× in this paper · explained in 2 episodes
Generative AI — 1× in this paper · explained in 2 episodes
LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
Verification — 1× in this paper · explained in 2 episodes

Sources

Related papers