An Empirical Study of Automating Agent Evaluation

arXiv:2605.11378 · cs.CL · Submitted 2026-05-12 · Read on arXiv

cs.CL

Submitted: 2026-05-12

Updated: 2026-09-23

Code: https://github.com/awslabs/Agent-EvalKit

Terminology

• Trace — 103× in this paper · explained in 2 episodes
• Alignment — 24× in this paper · explained in 1 episode
• Benchmark — 18× in this paper · explained in 2 episodes
• Metric Relevance — 16× in this paper
• Consistency — 13× in this paper · explained in 3 episodes
• Plan-Code Alignment — 13× in this paper
• User Requirement Fulfillment — 11× in this paper
• Plan Quality — 10× in this paper
• Aggregation — 5× in this paper · explained in 1 episode
• Core — 5× in this paper · explained in 2 episodes
• Scaffolding — 5× in this paper · explained in 3 episodes
• Ablation — 4× in this paper · explained in 1 episode
• Accuracy — 4× in this paper · explained in 1 episode
• Generalizability — 4× in this paper · explained in 6 episodes
• LLM judge — 4× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 4× in this paper · explained in 3 episodes
• Robustness — 4× in this paper · explained in 5 episodes
• Annotator Agreement — 3× in this paper · explained in 1 episode
• Benchmarking — 3× in this paper · explained in 3 episodes
• Calibration — 3× in this paper · explained in 7 episodes
• Evaluation Dimensions — 3× in this paper · explained in 3 episodes
• RAG — 3× in this paper · explained in 3 episodes
• Two-Stage Architecture — 3× in this paper · explained in 2 episodes
• AI Agents — 2× in this paper · explained in 2 episodes
• Ablation Studies — 2× in this paper · explained in 1 episode
• Abstraction — 2× in this paper · explained in 1 episode
• Agentic Reasoning — 2× in this paper · explained in 1 episode
• Analyzer — 2× in this paper · explained in 1 episode
• Embeddings — 2× in this paper · explained in 2 episodes
• Multi-Agent System — 2× in this paper · explained in 6 episodes
• Pairwise Comparisons — 2× in this paper · explained in 2 episodes
• Redundancy — 2× in this paper · explained in 2 episodes
• Agent Skills — 1× in this paper · explained in 1 episode
• Agent-as-Judge — 1× in this paper · explained in 1 episode
• Agentic Evaluation — 1× in this paper · explained in 1 episode
• Agentic System — 1× in this paper · explained in 2 episodes
• Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
• Iterative Refinement — 1× in this paper · explained in 3 episodes
• Knowledge Graph — 1× in this paper · explained in 7 episodes
• Knowledge graphs — 1× in this paper · explained in 2 episodes
• Ontology — 1× in this paper · explained in 2 episodes
• Progressive Disclosure — 1× in this paper · explained in 2 episodes
• Semantic Similarity — 1× in this paper · explained in 2 episodes
• Semantic Understanding — 1× in this paper · explained in 2 episodes
• Standardized Metrics — 1× in this paper · explained in 3 episodes

Sources

• ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
• Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation
• Evaluating Large Language Models Trained on Code
• ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
• TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Use
• Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agents
• API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs
• Let's Verify Step by Step
• AgentBench: Evaluating LLMs as Agents
• G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
• ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
• Identifying the Risks of LM Agents with an LM-Emulated Sandbox
• JudgeBench: A Benchmark for Evaluating LLM-based Judges
• A Survey on Large Language Model based Autonomous Agents
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents
• DeepResearchEval: An Automated Framework for Deep Research Task Construction and Agentic Evaluation
• The Rise and Potential of Large Language Model Based Agents: A Survey
• TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
• Survey on Evaluation of LLM-based Agents
• Deep Research: A Survey of Autonomous Research Agents

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering