English
Related papers

Related papers: Foundation Models in Autonomous Driving: A Survey …

200 papers

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…

Autonomous driving promises safer roads, reduced congestion, and improved mobility, yet validating these systems across diverse conditions remains a major challenge. Real-world testing is expensive, time-consuming, and sometimes unsafe,…

To guarantee the safety and reliability of autonomous vehicle (AV) systems, corner cases play a crucial role in exploring the system's behavior under rare and challenging conditions within simulation environments. However, current…

Robotics · Computer Science 2024-12-03 Qiujing Lu , Meng Ma , Ximiao Dai , Xuanhan Wang , Shuo Feng

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans.…

Autonomous systems, such as self-driving vehicles, quadrupeds, and robot manipulators, are largely enabled by the rapid development of artificial intelligence. However, such systems involve several trustworthy challenges such as safety,…

Robotics · Computer Science 2023-05-02 Wenhao Ding

Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs,…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Yining Ma , Wei Jiang , Lingtong Zhang , Junyi Chen , Hong Wang , Chen Lv , Xuesong Wang , Lu Xiong

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Scenario-based testing is considered state-of-the-art to verify and validate Advanced Driver Assistance Systems or Automated Driving Systems. Due to the official launch of the SOTIF-standard (ISO 21448), scenario-based testing becomes more…

Software Engineering · Computer Science 2023-08-09 Lukas Birkemeyer , Christian King , Ina Schaefer

The safety and reliability of Automated Driving Systems (ADS) are paramount, necessitating rigorous testing methodologies to uncover potential failures before deployment. Traditional testing approaches often prioritize either natural…

Several scenario-based frameworks exist to aid in vehicle system development and safety assurance. However, there is a need for approaches that combine different types of datasets that offer varying levels of case severity, data richness,…

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

To operate safely, an automated vehicle (AV) must anticipate how the environment around it will evolve. For that purpose, it is important to know which prediction models are most appropriate for every situation. Currently, assessment of…

Artificial Intelligence · Computer Science 2022-10-14 Manuel Muñoz Sánchez , Jos Elfring , Emilia Silvas , René van de Molengraft

The growing advancements in Autonomous Vehicles (AVs) have emphasized the critical need to prioritize the absolute safety of AV maneuvers, especially in dynamic and unpredictable environments or situations. This objective becomes even more…

Robotics · Computer Science 2023-05-30 Dimia Iberraken , Lounis Adouane

Recent incidents with autonomous vehicles highlight the need for rigorous testing to ensure safety and robustness. Constructing test scenarios for autonomous driving systems (ADSs), however, is labor-intensive. We propose TARGET, an…

Software Engineering · Computer Science 2025-05-19 Yao Deng , Jiaohong Yao , Zhi Tu , Xi Zheng , Mengshi Zhang , Tianyi Zhang

Vision-language models have recently emerged as promising planners for autonomous driving, where success hinges on topology-aware reasoning over spatial structure and dynamic interactions from multimodal input. However, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fabian Schmidt , Markus Enzweiler , Abhinav Valada

Autonomous vehicles (AVs) are poised to revolutionize global transportation systems. However, its widespread acceptance and market penetration remain significantly below expectations. This gap is primarily driven by persistent challenges in…

Robotics · Computer Science 2026-02-10 Yuxin Zhang , Cheng Wang , Hubert P. H. Shum

Over recent decades, scenarios and scenario-based software/system engineering have been actively employed as essential tools to handle intricate problems, validate requirements, and support stakeholders' communication. However, despite the…

Software Engineering · Computer Science 2022-05-18 Young-Min Baek , Esther Cho , Donghwan Shin , Doo-Hwan Bae

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht