Benchmarking Autonomous Driving Planners Across Leaderboards: A Unified CARLA-Based Evaluation
cs.RO, cs.AI, cs.CV
Submitted: 2025-09-26
Updated: 2026-09-17
Comments: IROS 2026 - PPNIV Workshop
Code: https://github.com/OpenDriveLab/DriveLM
License: http://creativecommons.org/licenses/by/4.0/
The gist: Autonomous driving remains a highly active research domain that seeks to enable vehicles to perceive dynamic environments, predict the future trajectories of traffic agents such as vehicles,
Terminology
Abstract
Autonomous driving remains a highly active research domain that seeks to enable vehicles to perceive dynamic environments, predict the future trajectories of traffic agents such as vehicles, pedestrians, and cyclists and plan safe and efficient future motions. To advance the field, several competitive platforms and benchmarks have been established to provide standardized datasets and evaluation protocols. Each offers a unique dataset and challenging planning problems spanning a wide range of driving scenarios and conditions. In this study, we present a comparative case study of representative motion planning methods drawn from major benchmark ecosystems, including CARLA, nuPlan, and the Waymo Open Dataset. To ensure a fair and unified evaluation, we adopt CARLA Leaderboard v2.1 as our common evaluation platform and evaluate eight representative methods: TF++, InterFuser, TCP, PDM-Lite, MTR+MPC, CaRL, PlanT 2.0, Diffusion planner. By highlighting the strengths and weaknesses of current approaches, we identify prevailing trends, common challenges, and potential directions for advancing motion-planning research.
Sources
- Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Models
- Applications of Large Scale Foundation Models for Autonomous Driving
- GAIA-1: A Generative World Model for Autonomous Driving
- DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving
- Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities
- A Survey for Foundation Models in Autonomous Driving
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Prediction
- NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles
- Multiverse Transformer: 1st Place Solution for Waymo Open Sim Agents Challenge 2023
- ModeSeq: Taming Sparse Multimodal Motion Prediction with Sequential Mode Modeling
- Versatile Behavior Diffusion for Generalized Traffic Agent Simulation
- Model Predictive Simulation Using Structured Graphical Models and Transformers
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies
- Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving