English
Related papers

Related papers: Foundation Models for Autonomous Driving Perceptio…

200 papers

Generative models have fundamentally reshaped the landscape of decision-making, reframing the problem from pure scalar reward maximization to high-fidelity trajectory generation and distribution matching. This paradigm shift addresses…

Collaborative perception has attracted growing interest from academia and industry due to its potential to enhance perception accuracy, safety, and robustness in autonomous driving through multi-agent information fusion. With the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Naibang Wang , Deyong Shang , Yan Gong , Xiaoxi Hu , Ziying Song , Lei Yang , Yuhan Huang , Xiaoyu Wang , Jianli Lu

This comprehensive survey examines the integration of knowledge-based approaches in autonomous driving systems, specifically focusing on trajectory prediction and planning. We extensively analyze various methodologies for incorporating…

Artificial Intelligence · Computer Science 2025-05-23 Kumar Manas , Adrian Paschke

This paper explores the emerging knowledge-driven autonomous driving technologies. Our investigation highlights the limitations of current autonomous driving systems, in particular their sensitivity to data bias, difficulty in handling…

Perception is one of the crucial module of the autonomous driving system, which has made great progress recently. However, limited ability of individual vehicles results in the bottleneck of improvement of the perception performance. To…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Shunli Ren , Siheng Chen , Wenjun Zhang

Simulation-based design, optimization, and validation of autonomous vehicles have proven to be crucial for their improvement over the years. Nevertheless, the ultimate measure of effectiveness is their successful transition from simulation…

Robotics · Computer Science 2025-11-21 Chinmay Vilas Samak , Tanmay Vilas Samak , Bing Li , Venkat Krovi

Roadside perception systems are increasingly crucial in enhancing traffic safety and facilitating cooperative driving for autonomous vehicles. Despite rapid technological advancements, a major challenge persists for this newly arising…

Robotics · Computer Science 2024-01-24 Rusheng Zhang , Depu Meng , Shengyin Shen , Tinghan Wang , Tai Karir , Michael Maile , Henry X. Liu

With the growing interest in autonomous driving, there is an increasing demand for accurate and reliable road perception technologies. In complex environments without high-definition map support, autonomous vehicles must independently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xuewei Tang , Mengmeng Yang , Tuopu Wen , Peijin Jia , Le Cui , Mingshang Luo , Kehua Sheng , Bo Zhang , Diange Yang , Kun Jiang

Multimodal foundation models offer a promising framework for robotic perception and planning by processing sensory inputs to generate actionable plans. However, addressing uncertainty in both perception (sensory interpretation) and…

Robotics · Computer Science 2025-04-18 Neel P. Bhatt , Yunhao Yang , Rohan Siva , Daniel Milan , Ufuk Topcu , Zhangyang Wang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Collaborative perception is essential to address occlusion and sensor failure issues in autonomous driving. In recent years, theoretical and experimental investigations of novel works for collaborative perception have increased…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yushan Han , Hui Zhang , Huifang Li , Yi Jin , Congyan Lang , Yidong Li

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

In real-world scenarios, achieving domain adaptation and generalization poses significant challenges, as models must adapt to or generalize across unknown target distributions. Extending these capabilities to unseen multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hao Dong , Moru Liu , Kaiyang Zhou , Eleni Chatzi , Juho Kannala , Cyrill Stachniss , Olga Fink

The perception module of self-driving vehicles relies on a multi-sensor system to understand its environment. Recent advancements in deep learning have led to the rapid development of approaches that integrate multi-sensory measurements to…

Robotics · Computer Science 2023-07-14 Xi Zhu , Likang Wang , Caifa Zhou , Xiya Cao , Yue Gong , Lei Chen

Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Tao Huang , Jianan Liu , Xi Zhou , Dinh C. Nguyen , Mostafa Rahimi Azghadi , Yuxuan Xia , Qing-Long Han , Sumei Sun

Foundational models have caused a paradigm shift in the way artificial intelligence (AI) systems are built. They have had a major impact in natural language processing (NLP), and several other domains, not only reducing the amount of…

Networking and Internet Architecture · Computer Science 2022-11-15 Franck Le , Mudhakar Srivatsa , Raghu Ganti , Vyas Sekar

Accurate trajectory prediction has long been a major challenge for autonomous driving (AD). Traditional data-driven models predominantly rely on statistical correlations, often overlooking the causal relationships that govern traffic…

Artificial Intelligence · Computer Science 2025-05-13 Bonan Wang , Haicheng Liao , Chengyue Wang , Bin Rao , Yanchen Guan , Guyang Yu , Jiaxun Zhang , Songning Lai , Chengzhong Xu , Zhenning Li

Radar is a key component of the suite of perception sensors used for safe and reliable navigation of autonomous vehicles. Its unique capabilities include high-resolution velocity imaging, detection of agents in occlusion and over long…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Arvind Srivastav , Soumyajit Mandal

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool…