English
Related papers

Related papers: Foundation Models for Autonomous Driving System: A…

200 papers

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Autonomous Driving Systems (ADS) are safety-critical, where failures can be severe. While Metamorphic Testing (MT) is effective for fault detection in ADS, existing methods rely heavily on manual effort and lack automation. We present…

Software Engineering · Computer Science 2025-10-23 Linfeng Liang , Chenkai Tan , Yao Deng , Yingfeng Cai , T. Y Chen , Xi Zheng

Multi-agent Large Language Model (LLM) systems have been leading the way in applied LLM research across a number of fields. One notable area is software development, where researchers have advanced the automation of code implementation,…

Software Engineering · Computer Science 2025-11-25 Vali Tawosi , Keshav Ramani , Salwa Alamir , Xiaomo Liu

Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sheng Luo , Wei Chen , Wanxin Tian , Rui Liu , Luanxuan Hou , Xiubao Zhang , Haifeng Shen , Ruiqi Wu , Shuyi Geng , Yi Zhou , Ling Shao , Yi Yang , Bojun Gao , Qun Li , Guobin Wu

The emergence of Multimodal Large Language Models ((M)LLMs) has ushered in new avenues in artificial intelligence, particularly for autonomous driving by offering enhanced understanding and reasoning capabilities. This paper introduces…

Robotics · Computer Science 2024-04-15 Daocheng Fu , Wenjie Lei , Licheng Wen , Pinlong Cai , Song Mao , Min Dou , Botian Shi , Yu Qiao

Virtual development and prototyping has already become an integral part in the field of automated driving systems (ADS). There are plenty of software tools that are used for the virtual development of ADS. One such tool is CarMaker from IPG…

Robotics · Computer Science 2021-04-16 Philip Pannagger , Demin Nalic , Faris Orucevic , Arno Eichberger , Branko Rogic

Virtual testing of automated driving systems (ADS) has become an essential part of testing procedures for all automation levels. As ADS from automation level 3 and up are very complex, virtual testing for such systems is inevitable. The…

Software Engineering · Computer Science 2021-03-26 Demin Nalic , Aleksa Pandurevic , Arno Eichberger , Branko Rogic

In this era of technological advancements, several cutting-edge techniques are being implemented to enhance Autonomous Driving (AD) systems, focusing on improving safety, efficiency, and adaptability in complex driving environments.…

Computation and Language · Computer Science 2025-02-27 Md Robiul Islam

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

The continual assurance of safety and performance of automated driving systems (ADSs) poses significant challenges. ADSs operate in complex, dynamic, open-world environments allowing a wide range of scenarios, including ones that are rare…

Robotics · Computer Science 2026-05-14 Bastian Lampe , Lutz Eckstein

The advent of Large Multimodal Models (LMMs) offers a promising technology to tackle the limitations of modular design in autonomous driving, which often falters in open-world scenarios requiring sustained environmental understanding and…

Robotics · Computer Science 2026-01-21 Long Zhang , Yuchen Xia , Bingqing Wei , Zhen Liu , Shiwen Mao , Zhu Han , Mohsen Guizani

Automated Driving Systems (ADSs) have seen rapid progress in recent years. To ensure the safety and reliability of these systems, extensive testings are being conducted before their future mass deployment. Testing the system on the road is…

Software Engineering · Computer Science 2021-12-03 Ziyuan Zhong , Yun Tang , Yuan Zhou , Vania de Oliveira Neves , Yang Liu , Baishakhi Ray

Automated Driving Systems (ADS) have made great achievements in recent years thanks to the efforts from both academia and industry. A typical ADS is composed of multiple modules, including sensing, perception, planning, and control, which…

Software Engineering · Computer Science 2023-01-18 Shuncheng Tang , Zhenya Zhang , Yi Zhang , Jixiang Zhou , Yan Guo , Shuang Liu , Shengjian Guo , Yan-Fu Li , Lei Ma , Yinxing Xue , Yang Liu

Foundation models (FMs), including large language models, have become increasingly popular due to their wide-ranging applicability and ability to understand human-like semantics. While previous research has explored the use of FMs in…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Peiwen Jiang , Chao-Kai Wen , Xinping Yi , Xiao Li , Shi Jin , Jun Zhang

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

Testing autonomous driving systems (ADS) is critical to ensuring their reliability and safety. Existing ADS testing works focuses on designing scenarios to evaluate system-level behaviors, while fine-grained testing of ADS source code has…

Software Engineering · Computer Science 2025-01-20 Wenhan Wang , Xuan Xie , Yuheng Huang , Renzhi Wang , An Ran Chen , Lei Ma

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

Autonomous Driving Systems (ADS) use complex decision-making (DM) models with multimodal sensory inputs, making rigorous validation and verification (V&V) essential for safety and reliability. These models pose challenges in diagnosing…

Software Engineering · Computer Science 2025-10-07 Halit Eris , Stefan Wagner

To safely navigate intricate real-world scenarios, autonomous vehicles must be able to adapt to diverse road conditions and anticipate future events. World model (WM) based reinforcement learning (RL) has emerged as a promising approach by…

Robotics · Computer Science 2024-07-29 Dechen Gao , Shuangyu Cai , Hanchu Zhou , Hang Wang , Iman Soltani , Junshan Zhang

As Autonomous Driving Systems (ADS) progress towards commercial deployment, there is an increasing focus on ensuring their safety and reliability. While considerable research has been conducted on testing methods for detecting faults in…

Software Engineering · Computer Science 2026-01-09 Nathan Shaw , Sanjeetha Pennada , Robert M Hierons , Donghwan Shin