English
Related papers

Related papers: LLM-based Realistic Safety-Critical Driving Video …

200 papers

Autonomous Vehicle (AV) requires rigorous testing in safety-critical scenarios for safety validation, yet its validation is hindered by the high cost of field testing and the lack of fidelity in current simulations for rare safety-critical…

Robotics · Computer Science 2026-05-19 Hongyi Zhao , Shuo Wang , Qijie He , Ziyuan Pu

Simulators offer the possibility of safe, low-cost development of self-driving systems. However, current driving simulators exhibit na\"ive behavior models for background traffic. Hand-tuned scenarios are typically added during simulation…

Robotics · Computer Science 2022-04-29 Niklas Hanselmann , Katrin Renz , Kashyap Chitta , Apratim Bhattacharyya , Andreas Geiger

The advent of Large Language Models (LLM) provides new insights to validate Automated Driving Systems (ADS). In the herein-introduced work, a novel approach to extracting scenarios from naturalistic driving datasets is presented. A…

Robotics · Computer Science 2024-07-19 Yongqi Zhao , Wenbo Xiao , Tomislav Mihalj , Jia Hu , Arno Eichberger

Developing reliable autonomous driving algorithms poses challenges in testing, particularly when it comes to safety-critical traffic scenarios involving pedestrians. An open question is how to simulate rare events, not necessarily found in…

Robotics · Computer Science 2023-09-04 Yuhang Yang , Kalle Kujanpaa , Amin Babadi , Joni Pajarinen , Alexander Ilin

Automated Driving System (ADS) is a safety-critical software system responsible for the interpretation of the vehicle's environment and making decisions accordingly. The unbounded complexity of the driving context, including unforeseeable…

The manual design of scenarios for Air Traffic Control (ATC) training is a demanding and time-consuming bottleneck that limits the diversity of simulations available to controllers. To address this, we introduce a novel, end-to-end…

Artificial Intelligence · Computer Science 2025-08-18 Dewi Sid William Gould , George De Ath , Ben Carvell , Nick Pepper

Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic…

Autonomous driving systems have witnessed a significant development during the past years thanks to the advance in machine learning-enabled sensing and decision-making algorithms. One critical challenge for their massive deployment in the…

Robotics · Computer Science 2023-06-22 Wenhao Ding , Chejian Xu , Mansur Arief , Haohong Lin , Bo Li , Ding Zhao

Extracting interesting scenarios from real-world data as well as generating failure cases is important for the development and testing of autonomous systems. We propose efficient mechanisms to both characterize and generate testing…

Simulation is an indispensable tool in the development and testing of autonomous vehicles (AVs), offering an efficient and safe alternative to road testing. An outstanding challenge with simulation-based testing is the generation of…

Robotics · Computer Science 2024-12-13 Peide Huang , Wenhao Ding , Benjamin Stoler , Jonathan Francis , Bingqing Chen , Ding Zhao

Safety-critical scenarios are essential for the development of autonomous vehicles (AVs) but are rare in real-world driving data. While simulation offers a way to generate such scenarios, manually designed test cases lack scalability, and…

Robotics · Computer Science 2026-05-07 Zimu Gong , Brian Zhaoning Zhang , Chris Zhang , Kelvin Wong , Raquel Urtasun

Recent research on Large Language Models for autonomous driving shows promise in planning and control. However, high computational demands and hallucinations still challenge accurate trajectory prediction and control signal generation.…

Robotics · Computer Science 2024-10-03 Ziang Guo , Zakhar Yagudin , Artem Lykov , Mikhail Konenkov , Dzmitry Tsetserukou

This paper presents a scenario generation framework that creates diverse, parametrized, and safety-critical driving situations to validate the safety features of autonomous vehicles in simulation [15]. By modeling factors such as road…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Kiruthiga Chandra Shekar , Aliasghar Moj Arab

Software engineers in various industrial domains are already using Large Language Models (LLMs) to accelerate the process of implementing parts of software systems. When considering its potential use for ADAS or AD systems in the automotive…

Software Engineering · Computer Science 2025-05-27 Ali Nouri , Beatriz Cabrero-Daniel , Zhennan Fei , Krishna Ronanki , Håkan Sivencrona , Christian Berger

Recent incidents with autonomous vehicles highlight the need for rigorous testing to ensure safety and robustness. Constructing test scenarios for autonomous driving systems (ADSs), however, is labor-intensive. We propose TARGET, an…

Software Engineering · Computer Science 2025-05-19 Yao Deng , Jiaohong Yao , Zhi Tu , Xi Zheng , Mengshi Zhang , Tianyi Zhang

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Large-scale labelled driving video data is essential for training autonomous driving systems. Although simulation offers scalable and fully annotated data, the domain gap between synthetic and real-world driving videos significantly limits…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Haonan Zhao , Yiting Wang , Jingkun Chen , Valentina Donzella , Thomas Bashford-Rogers , Kurt Debattista

Developing autonomous driving systems (ADSs) involves generating and storing extensive log data from test drives, which is essential for verification, research, and simulation. However, these high-frequency logs, recorded over varying…

Software Engineering · Computer Science 2025-06-16 Simin Sun , Yuchuan Jin , Miroslaw Staron

The automated generation of diverse and complex training scenarios has been an important ingredient in many complex learning tasks. Especially in real-world application domains, such as autonomous driving, auto-curriculum generation is…

Robotics · Computer Science 2025-02-07 Axel Brunnbauer , Luigi Berducci , Peter Priller , Dejan Nickovic , Radu Grosu

Large Language Models (LLMs), capable of handling multi-modal input and outputs such as text, voice, images, and video, are transforming the way we process information. Beyond just generating textual responses to prompts, they can integrate…

Human-Computer Interaction · Computer Science 2024-09-17 Shuyang Li , Talha Azfar , Ruimin Ke