English
Related papers

Related papers: TaCarla: A comprehensive benchmarking dataset for …

200 papers

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

Despite recent advances in autonomous driving systems, accidents such as the fatal Uber crash in 2018 show these systems are still susceptible to edge cases. Such systems must be thoroughly tested and validated before being deployed in the…

Machine Learning · Computer Science 2022-08-15 Shreyas Ramakrishna , Baiting Luo , Christopher Kuhn , Gabor Karsai , Abhishek Dubey

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily…

Artificial Intelligence · Computer Science 2026-05-12 Bin Sun , Boao Zhang , Jiayi Lu , Xinjie Feng , Jiachen Shang , Rui Cao , Mengchao Zheng , Chuanye Wang , Shichun Yang , Yaoguang Cao , Ziying Song

The release of nuPlan marks a new era in vehicle motion planning research, offering the first large-scale real-world dataset and evaluation schemes requiring both precise short-term planning and long-horizon ego-forecasting. Existing…

Robotics · Computer Science 2023-11-03 Daniel Dauner , Marcel Hallgarten , Andreas Geiger , Kashyap Chitta

A map, as crucial information for downstream applications of an autonomous driving system, is usually represented in lanelines or centerlines. However, existing literature on map learning primarily focuses on either detecting geometry-based…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Tianyu Li , Peijin Jia , Bangjun Wang , Li Chen , Kun Jiang , Junchi Yan , Hongyang Li

Vision-Language-Action (VLA) models for autonomous driving show promise but falter in unstructured corner case scenarios, largely due to a scarcity of targeted benchmarks. To address this, we introduce Impromptu VLA. Our core contribution…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Haohan Chi , Huan-ang Gao , Ziming Liu , Jianing Liu , Chenyu Liu , Jinwei Li , Kaisen Yang , Yangcheng Yu , Zeda Wang , Wenyi Li , Leichen Wang , Xingtao Hu , Hao Sun , Hang Zhao , Hao Zhao

Autonomous Driving (AD) systems have made notable progress, but their performance in long-tail, safety-critical scenarios remains limited. These rare cases contribute a disproportionate number of accidents. Vision-Language Action (VLA)…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Yiming Cui , Haoyang Liang , Chen Lv , Peng Hang , Jian Sun

The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixiao Chen , Ruining Yang , Xin Chen , Jia He , Dongliang Xu , Yue Yao

Autonomous driving has received a lot of attention in the automotive industry and is often seen as the future of transportation. Passenger vehicles equipped with a wide array of sensors (e.g., cameras, front-facing radars, LiDARs, and IMUs)…

Machine Learning · Computer Science 2022-05-27 Andrey Pak , Hemanth Manjunatha , Dimitar Filev , Panagiotis Tsiotras

Autonomous vehicles (AV) are expected to reshape future transportation systems, and decision-making is one of the critical modules toward high-level automated driving. To overcome those complicated scenarios that rule-based methods could…

Robotics · Computer Science 2023-09-25 Yuning Wang , Zeyu Han , Yining Xing , Shaobing Xu , Jianqiang Wang

Nowadays, autonomous vehicles are gaining traction due to their numerous potential applications in resolving a variety of other real-world challenges. However, developing autonomous vehicles need huge amount of training and testing before…

Robotics · Computer Science 2023-06-21 Jumman Hossain

In this work, we present a learning method for lateral and longitudinal motion control of an ego-vehicle for vehicle pursuit. The car being controlled does not have a pre-defined route, rather it reactively adapts to follow a target vehicle…

Robotics · Computer Science 2023-08-17 Jiaxin Pan , Changyao Zhou , Mariia Gladkova , Qadeer Khan , Daniel Cremers

End-to-end differentiable learning for autonomous driving (AD) has recently become a prominent paradigm. One main bottleneck lies in its voracious appetite for high-quality labeled data e.g. 3D bounding boxes and semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Han Lu , Xiaosong Jia , Yichen Xie , Wenlong Liao , Xiaokang Yang , Junchi Yan

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ruiyang Hao , Bowen Jing , Haibao Yu , Zaiqing Nie

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He

While several datasets for autonomous navigation have become available in recent years, they tend to focus on structured driving environments. This usually corresponds to well-delineated infrastructure such as lanes, a small number of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Girish Varma , Anbumani Subramanian , Anoop Namboodiri , Manmohan Chandraker , C V Jawahar

Despite the numerous successes of machine learning over the past decade (image recognition, decision-making, NLP, image synthesis), self-driving technology has not yet followed the same trend. In this paper, we study the history,…

Robotics · Computer Science 2021-08-10 Ashesh Jain , Luca Del Pero , Hugo Grimmett , Peter Ondruska

In this technical report, we present CarLLaVA, a Vision Language Model (VLM) for autonomous driving, developed for the CARLA Autonomous Driving Challenge 2.0. CarLLaVA uses the vision encoder of the LLaVA VLM and the LLaMA architecture as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Katrin Renz , Long Chen , Ana-Maria Marcu , Jan Hünermann , Benoit Hanotte , Alice Karnsund , Jamie Shotton , Elahe Arani , Oleg Sinavski

Evaluation methods for autonomous driving are crucial for algorithm optimization. However, due to the complexity of driving intelligence, there is currently no comprehensive evaluation method for the level of autonomous driving…

Robotics · Computer Science 2025-03-10 Shanhe You , Xuewen Luo , Xinhe Liang , Jiashu Yu , Chen Zheng , Jiangtao Gong

Recent research on Large Language Models for autonomous driving shows promise in planning and control. However, high computational demands and hallucinations still challenge accurate trajectory prediction and control signal generation.…

Robotics · Computer Science 2024-10-03 Ziang Guo , Zakhar Yagudin , Artem Lykov , Mikhail Konenkov , Dzmitry Tsetserukou