English
Related papers

Related papers: ScenePilot: Controllable Boundary-Driven Critical …

200 papers

Establishing trustworthy safety assurance for autonomous driving systems (ADSs) requires evidence that failures arise from avoidable system deficiencies rather than unavoidable traffic conflicts. Current adversarial simulation methods can…

Robotics · Computer Science 2026-05-14 Yizhuo Xiao , Haotian Yan , Ying Wang , Zhongpan Zhu , Yuxin Zhang , Xintao Yan , Mustafa Suphi Erden , Cheng Wang

As autonomous driving technology matures, safety and robustness of its key components, including trajectory prediction, is vital. Though real-world datasets, such as Waymo Open Motion, provide realistic recorded scenarios for model…

Robotics · Computer Science 2024-02-06 Benjamin Stoler , Ingrid Navarro , Meghdeep Jana , Soonmin Hwang , Jonathan Francis , Jean Oh

In the scenario-based evaluation of machine learning models, a key problem is how to construct test datasets that represent various scenarios. The methodology proposed in this paper is to construct a benchmark and attach metadata to each…

Software Engineering · Computer Science 2024-06-19 Debalina Ghosh Paul , Hong Zhu , Ian Bayley

In this paper, we introduce ScenePilot-4K, a large-scale first-person dataset for safety-aware vision-language learning and evaluation in autonomous driving. Built from public online driving videos, ScenePilot-4K contains 3,847 hours of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yujin Wang , Yutong Zheng , Wenxian Fan , Tianyi Wang , Hongqing Chu , Li Zhang , Bingzhao Gao , Daxin Tian , Jianqiang Wang , Hong Chen

Safety-critical scenarios are essential for the development of autonomous vehicles (AVs) but are rare in real-world driving data. While simulation offers a way to generate such scenarios, manually designed test cases lack scalability, and…

Robotics · Computer Science 2026-05-07 Zimu Gong , Brian Zhaoning Zhang , Chris Zhang , Kelvin Wong , Raquel Urtasun

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Roundabouts, characterized by frequent merging and yielding interactions, remain a safety-critical corner case for the development and testing of intelligent driving functions. However, extracting sufficient near-critical scenarios from…

Robotics · Computer Science 2026-05-19 Li Li , Till Temmen , Tobias Brinkmann , Björn Krautwig , Markus Eisenbarth , Jakob Andert

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

Training vision models to detect workplace hazards accurately requires realistic images of unsafe conditions that could lead to accidents. However, acquiring such datasets is difficult because capturing accident-triggering scenarios as they…

Artificial Intelligence · Computer Science 2025-11-19 Sanjay Acharjee , Abir Khan Ratul , Diego Patino , Md Nazmus Sakib

Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe…

Machine Learning · Computer Science 2023-10-20 Linrui Zhang , Zhenghao Peng , Quanyi Li , Bolei Zhou

Critical scenario generation requires the ability of sampling critical combinations from the infinite parameter space in the logic scenario. Existing solutions aim to explore the correlation of action parameters in the initial scenario…

Artificial Intelligence · Computer Science 2023-01-13 Shuting Kang , Heng Guo , Lijun Zhang , Guangzhen Liu , Yunzhi Xue , Yanjun Wu

A major challenge in autonomous driving is the "long tail" of safety-critical edge cases, which often emerge from unusual combinations of common traffic elements. Synthesizing these scenarios is crucial, yet current controllable generative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yifan Zhan , Zhengqing Chen , Qingjie Wang , Zhuo He , Muyao Niu , Xiaoyang Guo , Wei Yin , Weiqiang Ren , Qian Zhang , Yinqiang Zheng

Behavior prediction remains one of the most challenging tasks in the autonomous vehicle (AV) software stack. Forecasting the future trajectories of nearby agents plays a critical role in ensuring road safety, as it equips AVs with the…

Artificial Intelligence · Computer Science 2021-11-16 Francis Indaheng , Edward Kim , Kesav Viswanadha , Jay Shenoy , Jinkyu Kim , Daniel J. Fremont , Sanjit A. Seshia

Intelligent driving systems aim to achieve a zero-collision mobility experience, requiring interdisciplinary efforts to enhance safety performance. This work focuses on risk identification, the process of identifying and analyzing risks…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Chi-Hsi Kung , Chieh-Chi Yang , Pang-Yuan Pao , Shu-Wei Lu , Pin-Lun Chen , Hsin-Cheng Lu , Yi-Ting Chen

Ensuring the safety and reliability of Automated Driving Systems (ADS) remains a critical challenge, as traditional verification methods such as large-scale on-road testing are prohibitively costly and time-consuming.To address…

Software Engineering · Computer Science 2025-12-18 Ji Zhou , Yongqi Zhao , Yixian Hu , Hexuan Li , Zhengguo Gu , Nan Xu , Arno Eichberger

Testing and validating Autonomous Vehicle (AV) performance in safety-critical and diverse scenarios is crucial before real-world deployment. However, manually creating such scenarios in simulation remains a significant and time-consuming…

Robotics · Computer Science 2025-09-29 Efimia Panagiotaki , Georgi Pramatarov , Lars Kunze , Daniele De Martini

Automated creation of synthetic traffic scenarios is a key part of validating the safety of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating traffic scenarios that…

Machine Learning · Computer Science 2023-11-20 Ethan Pronovost , Meghana Reddy Ganesina , Noureldin Hendy , Zeyu Wang , Andres Morales , Kai Wang , Nicholas Roy

Generating controllable indoor scenes is fundamental to applications in game development, architectural visualization, and embodied AI. However, existing approaches either support a limited input modalities or rely on implicit generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Wentang Chen , Shougao Zhang , Yiman Zhang , Tianhao Zhou , Ruihui Li

Game-based interactive driving simulations have emerged as versatile platforms for advancing decision-making algorithms in road transport mobility. While these environments offer safe, scalable, and engaging settings for testing driving…

Robotics · Computer Science 2025-09-09 Zhihao Lin , Zhen Tian

This paper introduces CRITICAL, a novel closed-loop framework for autonomous vehicle (AV) training and testing. CRITICAL stands out for its ability to generate diverse scenarios, focusing on critical driving situations that target specific…