English
Related papers

Related papers: Traffic Regulation-aware Path Planning with Regula…

200 papers

We study how vision-language models (VLMs) trained on web-scale data can be integrated into end-to-end driving systems to boost generalization and enable interactivity with human users. While recent approaches adapt VLMs to driving via…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Chonghao Sima , Katrin Renz , Kashyap Chitta , Li Chen , Hanxue Zhang , Chengen Xie , Jens Beißwenger , Ping Luo , Andreas Geiger , Hongyang Li

Vision-Language Models (VLMs) and Multi-Modal Language models (MMLMs) have become prominent in autonomous driving research, as these models can provide interpretable textual reasoning and responses for end-to-end autonomous driving safety…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Akshay Gopalkrishnan , Ross Greer , Mohan Trivedi

Developing autonomous driving systems (ADSs) involves generating and storing extensive log data from test drives, which is essential for verification, research, and simulation. However, these high-frequency logs, recorded over varying…

Software Engineering · Computer Science 2025-06-16 Simin Sun , Yuchuan Jin , Miroslaw Staron

Large Language Models (LLMs) are increasingly used for decision-making and planning in autonomous driving, showing promising reasoning capabilities and potential to generalize across diverse traffic situations. However, current LLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Fabian Schmidt , Noushiq Mohammed Kayilan Abdul Nazar , Markus Enzweiler , Abhinav Valada

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Autonomous driving requires reliable perception and safe decision-making in complex scenarios. Recent vision-language models (VLMs) demonstrate reasoning and generalization abilities, opening new possibilities for autonomous driving;…

Artificial Intelligence · Computer Science 2026-05-27 Zecong Tang , Zixu Wang , Yifei Wang , Weitong Lian , Tianjian Gao , Haoran Li , Tengju Ru , Lingyi Meng , Zhejun Cui , Yichen Zhu , Qi Kang , Kaixuan Wang , Yu Zhang

Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with…

Robotics · Computer Science 2025-05-23 Augusto Luis Ballardini , Miguel Ángel Sotelo

End-to-end autonomous driving has emerged as a promising paradigm integrating perception, decision-making, and control within a unified learning framework. Recently, Vision-Language Models (VLMs) have gained significant attention for their…

Robotics · Computer Science 2026-02-05 Yuxuan Han , Kunyuan Wu , Qianyi Shao , Renxiang Xiao , Zilu Wang , Cansen Jiang , Yi Xiao , Liang Hu , Yunjiang Lou

The growing number of ADAS-equipped vehicles has led to a dramatic increase in driving data, yet most of them capture routine driving behavior. Identifying and understanding safety-critical corner cases within this vast dataset remains a…

Artificial Intelligence · Computer Science 2025-07-23 Yin Wu , Daniel Slieter , Vivek Subramanian , Ahmed Abouelazm , Robin Bohn , J. Marius Zöllner

Autonomous driving has gained much attention from both industry and academia. Currently, Deep Neural Networks (DNNs) are widely used for perception and control in autonomous driving. However, several fatal accidents caused by autonomous…

Software Engineering · Computer Science 2022-09-28 Yao Deng , Xi Zheng , Tianyi Zhang , Guannan Lou , Huai liu , Miryung Kim , Tsong Yueh Chen

Autonomous driving functions (ADFs) in public traffic have to comply with complex system requirements that are based on knowledge of experts from different disciplines, e.g., lawyers, safety experts, psychologists. In this paper, we present…

Logic in Computer Science · Computer Science 2022-09-29 Dominik Grundt , Anna Köhne , Ishan Saxena , Ralf Stemmer , Bernd Westphal , Eike Möhlmann

Motivated by the emergent reasoning capabilities of Vision Language Models (VLMs) and their potential to improve the comprehensibility of autonomous driving systems, this paper introduces a closed-loop autonomous driving controller called…

Robotics · Computer Science 2024-10-04 Keke Long , Haotian Shi , Jiaxi Liu , Xiaopeng Li

The safe deployment of autonomous driving systems (ADSs) relies on comprehensive testing and evaluation. However, safety-critical scenarios that can effectively expose system vulnerabilities are extremely sparse in the real world. Existing…

Robotics · Computer Science 2025-12-03 Xinzheng Wu , Junyi Chen , Naiting Zhong , Yong Shen

Vehicle-to-everything (V2X) cooperation has emerged as a promising paradigm to overcome the perception limitations of classical autonomous driving by leveraging information from both ego-vehicle and infrastructure sensors. However,…

Robotics · Computer Science 2025-06-23 Junwei You , Haotian Shi , Zhuoyu Jiang , Zilin Huang , Rui Gan , Keshu Wu , Xi Cheng , Xiaopeng Li , Bin Ran

Approval of ADS depends on evaluating its behavior within representative real-world traffic scenarios. A common way to obtain such scenarios is to extract them from real-world data recordings. These can then be grouped and serve as basis on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Niklas Roßberg , Sinan Hasirlioglu , Mohamed Essayed Bouzouraa , Wolfgang Utschick , Michael Botsch

Merging into dense highway traffic for an autonomous vehicle is a complex decision-making task, wherein the vehicle must identify a potential gap and coordinate with surrounding human drivers, each of whom may exhibit diverse driving…

The way of analyzing, designing and building of real-time projects has been changed due to the rapid growth of internet, mobile technologies and intelligent applications. Most of these applications are intelligent, tiny and distributed…

Multiagent Systems · Computer Science 2011-08-03 Venkatesh. M , K. Kumar , Srinivas. V

The advent of Vision-Language Models (VLMs) has significantly advanced end-to-end autonomous driving, demonstrating powerful reasoning abilities for high-level behavior planning tasks. However, existing methods are often constrained by a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Weicheng Zheng , Xiaofei Mao , Nanfei Ye , Pengxiang Li , Kun Zhan , Xianpeng Lang , Hang Zhao

In the field of autonomous driving, two important features of autonomous driving car systems are the explainability of decision logic and the accuracy of environmental perception. This paper introduces DME-Driver, a new autonomous driving…

Robotics · Computer Science 2024-01-09 Wencheng Han , Dongqian Guo , Cheng-Zhong Xu , Jianbing Shen

Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpretation, and action generation, these systems enable more…

Robotics · Computer Science 2026-03-19 Gerhard Yu , Fuyuki Ishikawa , Oluwafemi Odu , Alvine Boaye Belle