GroupTravelBench: Benchmarking LLM Agents on Multi-Person Travel Planning

arXiv:2605.25200 · cs.CL · Submitted 2026-05-24 · Read on arXiv

cs.CL

Submitted: 2026-05-24

Updated: 2026-09-22

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 47× in this paper · explained in 2 episodes
• Group Utility — 18× in this paper
• Archetype — 17× in this paper · explained in 1 episode
• LLM judge — 13× in this paper · explained in 2 episodes
• Plan Validity — 12× in this paper
• Hallucination — 10× in this paper · explained in 3 episodes
• Calibration — 9× in this paper · explained in 7 episodes
• Group Fairness — 9× in this paper
• Preference Completeness — 8× in this paper
• Benchmarking — 6× in this paper · explained in 3 episodes
• Consistency — 6× in this paper · explained in 3 episodes
• Core — 6× in this paper · explained in 2 episodes
• Reinforcement Learning — 6× in this paper · explained in 4 episodes
• Evaluation Dimensions — 5× in this paper · explained in 3 episodes
• Embeddings — 4× in this paper · explained in 2 episodes
• Grounding — 4× in this paper · explained in 3 episodes
• Combinatorial Optimization — 2× in this paper · explained in 2 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• RAG — 2× in this paper · explained in 3 episodes
• Thinking mode — 2× in this paper · explained in 2 episodes
• Trace — 2× in this paper · explained in 2 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Commentary — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Formal Verification — 1× in this paper · explained in 2 episodes
• In-Context Learning — 1× in this paper · explained in 4 episodes
• Personalization — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Temporal Reasoning — 1× in this paper · explained in 2 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
• Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning
• ReTool: Reinforcement Learning for Strategic Tool Use in LLMs
• TripScore: Aligning LLMs for Real-World Travel Planning via Expert-Calibrated Reward
• TripTide: A Benchmark for Adaptive Travel Planning under Disruptions
• TourPlanner: A Competitive Consensus Framework with Constraint-Gated Reinforcement Learning for Travel Planning
• DeepTravel: An End-to-End Agentic Reinforcement Learning Framework for Autonomous Travel Planning Agents
• WorldTravel: A Realistic Multimodal Travel-Planning Benchmark with Tightly Coupled Constraints
• Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe
• COMPASS: Benchmarking Constrained Optimization in LLM Agents
• Decoupled Travel Planning with Behavior Forest
• Revisiting the Travel Planning Capabilities of Large Language Models
• ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Ranking
• DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering