English
Related papers

Related papers: CrashAgent: Crash Scenario Generation via Multi-mo…

200 papers

Ensuring the safety of autonomous vehicles (AVs) in long-tail scenarios remains a critical challenge, particularly under high uncertainty and complex multi-agent interactions. To address this, we propose RiskNet, an interaction-aware risk…

Robotics · Computer Science 2025-04-23 Qichao Liu , Heye Huang , Shiyue Zhao , Lei Shi , Soyoung Ahn , Xiaopeng Li

The ability to perform causal and counterfactual reasoning are central properties of human intelligence. Decision-making systems that can perform these types of reasoning have the potential to be more generalizable and interpretable.…

Artificial Intelligence · Computer Science 2021-06-28 Daniel McDuff , Yale Song , Jiyoung Lee , Vibhav Vineet , Sai Vemprala , Nicholas Gyde , Hadi Salman , Shuang Ma , Kwanghoon Sohn , Ashish Kapoor

Generating representative rear-end crash scenarios is crucial for safety assessments of Advanced Driver Assistance Systems (ADAS) and Automated Driving systems (ADS). However, existing methods for scenario generation face challenges such as…

Robotics · Computer Science 2024-06-25 Jian Wu , Carol Flannagan , Ulrich Sander , Jonas Bärgman

Ensuring the safety of autonomous vehicles (AV) requires rigorous testing under both everyday driving and rare, safety-critical conditions. A key challenge lies in simulating environment agents, including background vehicles (BVs) and…

Machine Learning · Computer Science 2025-12-10 Qiujing Lu , Xuanhan Wang , Runze Yuan , Wei Lu , Xinyi Gong , Shuo Feng

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

Machine Learning · Computer Science 2021-11-01 Ashish Rana , Avleen Malhi

Common knowledge indicates that the process of constructing image datasets usually depends on the time-intensive and inefficient method of manual collection and annotation. Large models offer a solution via data generation. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Haoran Sun , Haoyu Bian , Shaoning Zeng , Yunbo Rao , Xu Xu , Lin Mei , Jianping Gou

Adversarial scenario generation is crucial for autonomous driving testing because it can efficiently simulate various challenge and complex traffic conditions. However, it is difficult to control current existing methods to generate desired…

Robotics · Computer Science 2024-08-27 Shuo Yang , Caojun Wang , Yuanjian Zhang , Yuming Yin , Yanjun Huang , Shengbo Eben Li , Hong Chen

Simulation forms the backbone of modern self-driving development. Simulators help develop, test, and improve driving systems without putting humans, vehicles, or their environment at risk. However, simulators face a major challenge: They…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Shuhan Tan , Boris Ivanovic , Xinshuo Weng , Marco Pavone , Philipp Kraehenbuehl

Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single…

Artificial Intelligence · Computer Science 2025-03-11 Shenyu Zhang , Jiaguo Tian , Zhengbang Zhu , Shan Huang , Jucheng Yang , Weinan Zhang

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Evaluating and improving planning for autonomous vehicles requires scalable generation of long-tail traffic scenarios. To be useful, these scenarios must be realistic and challenging, but not impossible to drive through safely. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Davis Rempe , Jonah Philion , Leonidas J. Guibas , Sanja Fidler , Or Litany

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

With the increasing integration of intelligent driving functions into serial-produced vehicles, ensuring their functionality and robustness poses greater challenges. Compared to traditional road testing, scenario-based virtual testing…

Robotics · Computer Science 2025-10-29 Li Li , Tobias Brinkmann , Till Temmen , Markus Eisenbarth , Jakob Andert

Scenario generation is one of the essential steps in scenario-based testing and, therefore, a significant part of the verification and validation of driver assistance functions and autonomous driving systems. However, the term scenario…

Robotics · Computer Science 2023-07-25 Barbara Schütt , Joshua Ransiek , Thilo Braun , Eric Sax

We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jingwei Shi , Zeyu Zhang , Biao Wu , Yanjie Liang , Meng Fang , Ling Chen , Yang Zhao

Current scientific research witnesses various attempts at applying Large Language Models for scenario generation but is inclined only to comprehensive or dangerous scenarios. In this paper, we seek to build a three-stage framework that not…

Artificial Intelligence · Computer Science 2025-01-22 Yicheng Xiao , Yangyang Sun , Yicheng Lin

Existing long-form video generation frameworks lack automated planning, requiring manual input for storylines, scenes, cinematography, and character interactions, resulting in high costs and inefficiencies. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Weijia Wu , Zeyu Zhu , Mike Zheng Shou

Automating crash video analysis is essential to leverage the growing availability of driving video data for traffic safety research and accountability attribution in autonomous driving. Crash video analysis is a challenging multitask…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaidi Liang , Ke Li , Xianbiao Hu , Ruwen Qin

Safely interacting with humans is a significant challenge for autonomous driving. The performance of this interaction depends on machine learning-based modules of an autopilot, such as perception, behavior prediction, and planning. These…

Artificial Intelligence · Computer Science 2020-12-01 Jay Shenoy , Edward Kim , Xiangyu Yue , Taesung Park , Daniel Fremont , Alberto Sangiovanni-Vincentelli , Sanjit Seshia

The generation of safety-critical scenarios in simulation has become increasingly crucial for safety evaluation in autonomous vehicles prior to road deployment in society. However, current approaches largely rely on predefined threat…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jiangfan Liu , Yongkang Guo , Fangzhi Zhong , Tianyuan Zhang , Zonglei Jing , Siyuan Liang , Jiakai Wang , Mingchuan Zhang , Aishan Liu , Xianglong Liu