ATLAS: Dual-Horizon Diagnostic Evaluation for Industrial Tool-Use Agents
cs.AI
Submitted: 2026-08-31
Updated: 2026-08-31
Comments: 25 pages
Project page: https://atlas-eval.github.io
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscape
- Toward Holistic Evaluation of Recommender Systems Powered by Generative Models
- AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Tracking
- Auditing Automated Evaluation, Error Propagation, and Runtime Mitigation in Tool-Using Language Agents
- VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications
- Hallucination Cascade: Analyzing Error Propagation in Multi-Agent LLM Systems
- One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systems
- RUBAS: Rubric-Based Reinforcement Learning for Agent Safety
- ComplexConstraints and Beyond: Expert Rubrics for RLVR
- Boosting Virtual Agent Learning and Reasoning: A Step-Wise, Multi-Dimensional, and Generalist Reward Model with Benchmark
- Mind DeepResearch Technical Report
- CLQT: A Closed-Loop, Cost-Aware, Strategy-Consistent Benchmark for Diagnostic Evaluation of LLM Portfolio-Management Agents
- Multi-Dimensional Behavioral Evaluation of Agentic Stock Prediction Systems Using Large Language Model Judges with Closed-Loop Reinforcement Learning Feedback
- Toolformer: Language Models Can Teach Themselves to Use Tools
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- MobilityBench: A Benchmark for Evaluating Route-Planning Agents in Real-World Mobility Scenarios
- Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection