English
Related papers

Related papers: SG-CADVLM: A Context-Aware Decoding Powered Vision…

200 papers

Autonomous driving (AD) testing constitutes a critical methodology for assessing performance benchmarks prior to product deployment. The creation of segmented scenarios within a simulated environment is acknowledged as a robust and…

Software Engineering · Computer Science 2025-03-06 Xuan Cai , Xuesong Bai , Zhiyong Cui , Danmu Xie , Daocheng Fu , Haiyang Yu , Yilong Ren

Simulation frameworks have been key enablers for the development and validation of autonomous driving systems. However, existing methods struggle to comprehensively address the autonomy-oriented requirements of balancing: (i) dynamical…

Robotics · Computer Science 2026-02-23 Tanmay Vilas Samak , Chinmay Vilas Samak , Bing Li , Venkat Krovi

The development of assessment methods for the performance of Automated Vehicles (AVs) is essential to enable the deployment of automated driving technologies, due to the complex operational domain of AVs. One candidate is scenario-based…

Ensuring the safety of autonomous vehicles (AV) requires rigorous testing under both everyday driving and rare, safety-critical conditions. A key challenge lies in simulating environment agents, including background vehicles (BVs) and…

Machine Learning · Computer Science 2025-12-10 Qiujing Lu , Xuanhan Wang , Runze Yuan , Wei Lu , Xinyi Gong , Shuo Feng

This work introduces a framework to diagnose the strengths and shortcomings of Autonomous Vehicle (AV) collision avoidance technology with synthetic yet realistic potential collision scenarios adapted from real-world, collision-free data.…

Optimization and Control · Mathematics 2024-09-18 Robert Dyro , Matthew Foutter , Ruolin Li , Luigi Di Lillo , Edward Schmerling , Xilin Zhou , Marco Pavone

The advent of Large Language Models (LLM) provides new insights to validate Automated Driving Systems (ADS). In the herein-introduced work, a novel approach to extracting scenarios from naturalistic driving datasets is presented. A…

Robotics · Computer Science 2024-07-19 Yongqi Zhao , Wenbo Xiao , Tomislav Mihalj , Jia Hu , Arno Eichberger

Scenario-based testing is essential for validating the performance of autonomous driving (AD) systems. However, such testing is limited by the scarcity of long-tailed, safety-critical scenarios in existing datasets collected in the real…

Robotics · Computer Science 2025-11-05 Yuxin Liu , Zhenghao Peng , Xuanhao Cui , Bolei Zhou

For a successful market launch of automated vehicles (AVs), proof of their safety is essential. Due to the open parameter space, an infinite number of traffic situations can occur, which makes the proof of safety an unsolved problem. With…

Robotics · Computer Science 2020-08-27 Thomas Ponn , Matthias Breitfuß , Xiao Yu , Frank Diermeyer

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

Artificial Intelligence · Computer Science 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

Autonomous driving is a complex and challenging task that aims at safe motion planning through scene understanding and reasoning. While vision-only autonomous driving methods have recently achieved notable performance, through enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chenbin Pan , Burhaneddin Yaman , Tommaso Nesti , Abhirup Mallik , Alessandro G Allievi , Senem Velipasalar , Liu Ren

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitivity (unjustified…

Computation and Language · Computer Science 2025-09-24 Zheyuan Liu , Zhangchen Xu , Guangyao Dou , Xiangchi Yuan , Zhaoxuan Tan , Radha Poovendran , Meng Jiang

Large language models (LLMs) have recently shown strong potential for Automated Program Repair (APR), yet most existing approaches remain unimodal and fail to leverage the rich diagnostic signals contained in visual artifacts such as…

Software Engineering · Computer Science 2026-02-09 Xiaoxuan Tang , Jincheng Wang , Liwei Luo , Jingxuan Xu , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

Traffic scene understanding is essential for intelligent transportation systems and autonomous driving, ensuring safe and efficient vehicle operation. While recent advancements in VLMs have shown promise for holistic scene understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Qingyao Xu , Siheng Chen , Guang Chen , Yanfeng Wang , Ya Zhang

Scene understanding and risk-aware attentions are crucial for human drivers to make safe and effective driving decisions. To imitate this cognitive ability in urban autonomous driving while ensuring the transparency and interpretability, we…

Robotics · Computer Science 2025-07-22 Haichao Liu , Haoren Guo , Pei Liu , Benshan Ma , Yuxiang Zhang , Jun Ma , Tong Heng Lee

Accurately and promptly predicting accidents among surrounding traffic agents from camera footage is crucial for the safety of autonomous vehicles (AVs). This task presents substantial challenges stemming from the unpredictable nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haicheng Liao , Haoyu Sun , Huanming Shen , Chengyue Wang , Kahou Tam , Chunlin Tian , Li Li , Chengzhong Xu , Zhenning Li

Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV) a reality. It requires one to generate safety critical scenarios beyond what can be collected safely in the world, as many scenarios happen rarely…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Ze Yang , Yun Chen , Jingkang Wang , Sivabalan Manivasagam , Wei-Chiu Ma , Anqi Joyce Yang , Raquel Urtasun

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

Generating safety-critical scenarios is essential for testing and verifying the safety of autonomous vehicles. Traditional optimization techniques suffer from the curse of dimensionality and limit the search space to fixed parameter spaces.…

Machine Learning · Computer Science 2024-03-08 Haolan Liu , Liangjun Zhang , Siva Kumar Sastry Hari , Jishen Zhao