KC-Bench: A Dynamic Interactive Benchmark for Evaluating Knowledge Conflicts in LLM Agents
cs.AI
Submitted: 2026-09-03
Updated: 2026-09-03
Code: https://github.com/ASTAR123/KC-Bench
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- GhostEI-Bench: Do Mobile Agents Resilience to Environmental Injection in Dynamic On-Device Environments?
- Towards Verifiably Safe Tool Use for LLM Agents
- Large Language Model based Multi-Agents: A Survey of Progress and Challenges
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
- AgentBench: Evaluating LLMs as Agents
- Large Language Model Agent: A Survey on Methodology, Applications and Challenges
- From LLMs to MLLMs to Agents: A Survey of Emerging Paradigms in Jailbreak Attacks and Defenses within LLM Ecosystem
- Prompt Injection Attack to Tool Selection in LLM Agents
- ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM
- AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents
- Resolving Knowledge Conflicts in Large Language Models
- Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworks
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection