CredLeakBench: Evaluating Credential Leakage and Recovery in LLM Agents

arXiv:2610.08871 · cs.CR, cs.AI · Submitted 2026-10-06 · Read on arXiv

cs.CR, cs.AI

Submitted: 2026-10-06

Updated: 2026-10-06

Terminology

Leak Rate — 16× in this paper
Verification — 16× in this paper · explained in 2 episodes
Benchmark — 13× in this paper · explained in 2 episodes
False-Refusal Rate — 10× in this paper
Scaffolding — 6× in this paper · explained in 3 episodes
Accuracy — 4× in this paper · explained in 1 episode
Benchmarking — 3× in this paper · explained in 3 episodes
Agentic System — 2× in this paper · explained in 2 episodes
Deferral — 2× in this paper · explained in 2 episodes
Information Leakage — 2× in this paper · explained in 2 episodes
Trace — 2× in this paper · explained in 2 episodes
AI Agents — 1× in this paper · explained in 2 episodes
Accuracy and the Matthews Correlation Coefficient — 1× in this paper
Action Bias — 1× in this paper · explained in 1 episode
Agent Harness — 1× in this paper · explained in 2 episodes
Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
Scaffolding System — 1× in this paper · explained in 2 episodes
True Negative — 1× in this paper
True Positive — 1× in this paper

Sources

Related papers