English
Related papers

Related papers: Enhancing Autonomous Vehicle Training with Languag…

200 papers

Safety-critical scenarios are essential for the development of autonomous vehicles (AVs) but are rare in real-world driving data. While simulation offers a way to generate such scenarios, manually designed test cases lack scalability, and…

Robotics · Computer Science 2026-05-07 Zimu Gong , Brian Zhaoning Zhang , Chris Zhang , Kelvin Wong , Raquel Urtasun

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl

Ensuring the safety of autonomous vehicles (AV) requires rigorous testing under both everyday driving and rare, safety-critical conditions. A key challenge lies in simulating environment agents, including background vehicles (BVs) and…

Machine Learning · Computer Science 2025-12-10 Qiujing Lu , Xuanhan Wang , Runze Yuan , Wei Lu , Xinyi Gong , Shuo Feng

Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefined or scripted BVs,…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Yining Ma , Wei Jiang , Lingtong Zhang , Junyi Chen , Hong Wang , Chen Lv , Xuesong Wang , Lu Xiong

Developing safety-critical automotive software presents significant challenges due to increasing system complexity and strict regulatory demands. This paper proposes a novel framework integrating Generative Artificial Intelligence (GenAI)…

Software Engineering · Computer Science 2025-06-05 Sven Kirchner , Alois C. Knoll

End-to-end autonomous driving frameworks face persistent challenges in generalization, training efficiency, and interpretability. While recent methods leverage Vision-Language Models (VLMs) through supervised learning on large-scale…

Robotics · Computer Science 2025-12-11 Lin Li , Yuxin Cai , Jianwu Fang , Jianru Xue , Chen Lv

Designing diverse and safety-critical driving scenarios is essential for evaluating autonomous driving systems. In this paper, we propose a novel framework that leverages Large Language Models (LLMs) for few-shot code generation to…

Robotics · Computer Science 2026-04-14 Yongjie Fu , Ruijian Zha , Pei Tian , Xuan Di

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to open-loop settings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Tianyuan Zhang , Ting Jin , Lu Wang , Jiangfan Liu , Siyuan Liang , Mingchuan Zhang , Aishan Liu , Xianglong Liu

To guarantee the safety and reliability of autonomous vehicle (AV) systems, corner cases play a crucial role in exploring the system's behavior under rare and challenging conditions within simulation environments. However, current…

Robotics · Computer Science 2024-12-03 Qiujing Lu , Meng Ma , Ximiao Dai , Xuanhan Wang , Shuo Feng

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

Simulation is an indispensable tool in the development and testing of autonomous vehicles (AVs), offering an efficient and safe alternative to road testing. An outstanding challenge with simulation-based testing is the generation of…

Robotics · Computer Science 2024-12-13 Peide Huang , Wenhao Ding , Benjamin Stoler , Jonathan Francis , Bingqing Chen , Ding Zhao

In the autonomous driving testing methods based on evolving scenarios, the construction method of the driver model, which determines the driving maneuvers of background vehicles (BVs) in the scenario, plays a critical role in generating…

Machine Learning · Computer Science 2025-08-05 Xinzheng Wu , Junyi Chen , Shaolingfeng Ye , Wei Jiang , Yong Shen

Recent reinforcement learning (RL) algorithms have demonstrated impressive results in simulated driving environments. However, autonomous vehicles trained in simulation often struggle to work well in the real world due to the fidelity gap…

Robotics · Computer Science 2025-01-17 Sang-Hyun Lee , Daehyeok Kwon , Seung-Woo Seo

Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic…

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Reinforcement learning (RL) has shown considerable potential in autonomous driving (AD), yet its vulnerability to perturbations remains a critical barrier to real-world deployment. As a primary countermeasure, adversarial training improves…

Machine Learning · Computer Science 2026-01-06 Qi Wei , Junchao Fan , Zhao Yang , Jianhua Wang , Jingkai Mao , Xiaolin Chang

Generating safety-critical scenarios is essential for testing and verifying the safety of autonomous vehicles. Traditional optimization techniques suffer from the curse of dimensionality and limit the search space to fixed parameter spaces.…

Machine Learning · Computer Science 2024-03-08 Haolan Liu , Liangjun Zhang , Siva Kumar Sastry Hari , Jishen Zhao

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno