English
Related papers

Related papers: Towards learning-based planning:The nuPlan benchma…

200 papers

Widespread development of driverless vehicles has led to the formation of autonomous racing, where technological development is accelerated by the high speeds and competitive environment of motorsport. A particular challenge for an…

Robotics · Computer Science 2021-09-16 Sam Garlick , Andrew Bradley

Motion planning is a fundamental problem in autonomous driving and perhaps the most challenging to comprehensively evaluate because of the associated risks and expenses of real-world deployment. Therefore, simulations play an important role…

Robotics · Computer Science 2025-02-25 Montgomery Alban , Ehsan Ahmadi , Randy Goebel , Amir Rasouli

Modeling traffic dynamics is a critical challenge for urban computing, with applications from real-time traffic management to infrastructure planning. However, progress in this area is fundamentally constrained by a lack of large-scale…

Machine Learning · Computer Science 2026-05-18 Fedor Velikonivtsev , Oleg Platonov , Ekaterina Alimaskina , Gleb Bazhenov , Liudmila Prokhorenkova

The efficacy of autonomous driving systems hinges critically on robust prediction and planning capabilities. However, current benchmarks are impeded by a notable scarcity of scenarios featuring dense traffic, which is essential for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Constantin Selzer , Fabian B. Flohr

Road traffic forecasting plays a critical role in smart city initiatives and has experienced significant advancements thanks to the power of deep learning in capturing non-linear patterns of traffic data. However, the promising results…

Machine Learning · Computer Science 2023-10-31 Xu Liu , Yutong Xia , Yuxuan Liang , Junfeng Hu , Yiwei Wang , Lei Bai , Chao Huang , Zhenguang Liu , Bryan Hooi , Roger Zimmermann

Large-scale driving datasets such as Waymo Open Dataset and nuScenes substantially accelerate autonomous driving research, especially for perception tasks such as 3D detection and trajectory forecasting. Since the driving logs in these…

Robotics · Computer Science 2023-10-31 Quanyi Li , Zhenghao Peng , Lan Feng , Zhizheng Liu , Chenda Duan , Wenjie Mo , Bolei Zhou

Motion planning in complex scenarios is the core challenge in autonomous driving. Conventional methods apply predefined rules or learn from driving data to plan the future trajectory. Recent methods seek the knowledge preserved in large…

Robotics · Computer Science 2024-06-12 Ruijun Zhang , Xianda Guo , Wenzhao Zheng , Chenming Zhang , Kurt Keutzer , Long Chen

The rise of multimodal large language models (MLLMs) has spurred interest in language-based driving tasks. However, existing research typically focuses on limited tasks and often omits key multi-view and temporal information which is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xinpeng Ding , Jinahua Han , Hang Xu , Xiaodan Liang , Wei Zhang , Xiaomeng Li

Visual-language reasoning, driving knowledge, and value alignment are essential for advanced autonomous driving systems. However, existing approaches largely rely on data-driven learning, making it difficult to capture the complex logic…

Robotics · Computer Science 2026-03-13 Zhongyu Xia , Wenhao Chen , Yongtao Wang , Ming-Hsuan Yang

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…

Due to the powerful vision-language reasoning and generalization abilities, multimodal large language models (MLLMs) have garnered significant attention in the field of end-to-end (E2E) autonomous driving. However, their application to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xueyi Liu , Zuodong Zhong , Yuxin Guo , Yun-Fu Liu , Zhiguo Su , Qichao Zhang , Junli Wang , Yinfeng Gao , Yupeng Zheng , Qiao Lin , Huiyong Chen , Dongbin Zhao

Driving scene generation is a critical domain for autonomous driving, enabling downstream applications, including perception and planning evaluation. Occupancy-centric methods have recently achieved state-of-the-art results by offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bohan Li , Xin Jin , Hu Zhu , Hongsi Liu , Ruikai Li , Jiazhe Guo , Kaiwen Cai , Chao Ma , Yueming Jin , Hao Zhao , Xiaokang Yang , Wenjun Zeng

World model-based searching and planning are widely recognized as a promising path toward human-level physical intelligence. However, current driving world models primarily rely on video diffusion models, which specialize in visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yuntao Chen , Yuqi Wang , Zhaoxiang Zhang

Evaluating the performance of perception modules in autonomous driving is one of the most critical tasks in developing the complex intelligent system. While module-level unit test metrics adopted from traditional computer vision tasks are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Wei-Xin Li , Xiaodong Yang

Modeling interactive driving behaviors in complex scenarios remains a fundamental challenge for autonomous driving planning. Learning-based approaches attempt to address this challenge with advanced generative models, removing the…

In this paper, we introduce the first learning-based planner to drive a car in dense, urban traffic using Inverse Reinforcement Learning (IRL). Our planner, DriveIRL, generates a diverse set of trajectory proposals, filters these…

Vision-Language Models (VLMs) offer a promising approach to end-to-end autonomous driving due to their human-like reasoning capabilities. However, troublesome gaps remains between current VLMs and real-world autonomous driving applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hao Jiang , Chuan Hu , Yukang Shi , Yuan He , Ke Wang , Xi Zhang , Zhipeng Zhang

Autonomous navigation through unknown environments is a challenging task that entails real-time localization, perception, planning, and control. UAVs with this capability have begun to emerge in the literature with advances in lightweight…

Robotics · Computer Science 2019-06-18 Jesus Tordesillas , Brett T. Lopez , John Carter , John Ware , Jonathan P. How

Autonomous vehicles require knowledge of the surrounding road layout, which can be predicted by state-of-the-art CNNs. This work addresses the current lack of data for determining lane instances, which are needed for various driving…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Brook Roberts , Sebastian Kaltwang , Sina Samangooei , Mark Pender-Bare , Konstantinos Tertikas , John Redford

Deep-learning-based techniques have been widely adopted for autonomous driving software stacks for mass production in recent years, focusing primarily on perception modules, with some work extending this method to prediction modules.…

Robotics · Computer Science 2024-06-03 Weijian Sun , Yanbo Jia , Qi Zeng , Zihao Liu , Jiang Liao , Yue Li , Xianfeng Li