English
Related papers

Related papers: DragTraffic: Interactive and Controllable Traffic …

200 papers

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Diffusion models excel in image generation but lack detailed semantic control using text prompts. Additional techniques have been developed to address this limitation. However, conditioning diffusion models solely on text-based descriptions…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Frank Fundel

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou

Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single…

Artificial Intelligence · Computer Science 2025-03-11 Shenyu Zhang , Jiaguo Tian , Zhengbang Zhu , Shan Huang , Jucheng Yang , Weinan Zhang

Existing traffic simulation models often fall short in capturing the intricacies of real-world scenarios, particularly the interactive behaviors among multiple traffic participants, thereby limiting their utility in the evaluation and…

Robotics · Computer Science 2026-02-03 Zhiyu Huang , Zixu Zhang , Ameya Vaidya , Yuxiao Chen , Chen Lv , Jaime Fernández Fisac

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

Controllable generative models for images and videos have seen significant success, yet 3D scene generation, especially in unbounded scenarios like autonomous driving, remains underdeveloped. Existing methods lack flexible controllability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ruiyuan Gao , Kai Chen , Zhihao Li , Lanqing Hong , Zhenguo Li , Qiang Xu

Accurate trajectory prediction is fundamental to autonomous driving, as it underpins safe motion planning and collision avoidance in complex environments. However, existing benchmark datasets suffer from a pronounced long-tail distribution…

Robotics · Computer Science 2025-10-06 Ruining Yang , Yi Xu , Yixiao Chen , Yun Fu , Lili Su

In this paper, we introduce a novel approach for autonomous driving trajectory generation by harnessing the complementary strengths of diffusion probabilistic models (a.k.a., diffusion models) and transformers. Our proposed framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chen Yang , Yangfan He , Aaron Xuxiang Tian , Dong Chen , Jianhui Wang , Tianyu Shi , Arsalan Heydarian , Pei Liu

In this paper, we introduce a novel approach to trajectory generation for autonomous driving, combining the strengths of Diffusion models and Transformers. First, we use the historical trajectory data for efficient preprocessing and…

Robotics · Computer Science 2024-05-07 Chen Yang , Tianyu Shi

We present DriveGen3D, a novel framework for generating high-quality and highly controllable dynamic 3D driving scenes that addresses critical limitations in existing methodologies. Current approaches to driving scene synthesis either…

In this paper, we present a novel trajectory prediction model for autonomous driving, combining a Characterized Diffusion Module and a Spatial-Temporal Interaction Network to address the challenges posed by dynamic and heterogeneous traffic…

Robotics · Computer Science 2024-11-26 Haoming Li

Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a unified framework…

A scenario-based testing approach can reduce the time required to obtain statistically significant evidence of the safety of Automated Driving Systems (ADS). Identifying these scenarios in an automated manner is a challenging task. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tobias Hoek , Holger Caesar , Andreas Falkovén , Tommy Johansson

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

Video diffusion techniques have advanced significantly in recent years; however, they struggle to generate realistic imagery of car crashes due to the scarcity of accident events in most driving datasets. Improving traffic safety requires…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Anthony Gosselin , Ge Ya Luo , Luis Lara , Florian Golemo , Derek Nowrouzezahrai , Liam Paull , Alexia Jolicoeur-Martineau , Christopher Pal

Generating multi-camera street-view videos is critical for augmenting autonomous driving datasets, addressing the urgent demand for extensive and varied data. Due to the limitations in diversity and challenges in handling lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiachen Lu , Ze Huang , Zeyu Yang , Jiahui Zhang , Li Zhang

Image synthesis driven by computer graphics achieved recently a remarkable realism, yet synthetic image data generated this way reveals a significant domain gap with respect to real-world data. This is especially true in autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Artem Savkin , Rachid Ellouze , Nassir Navab , Federico Tombari

Ensuring the safety of autonomous vehicles (AV) requires rigorous testing under both everyday driving and rare, safety-critical conditions. A key challenge lies in simulating environment agents, including background vehicles (BVs) and…

Machine Learning · Computer Science 2025-12-10 Qiujing Lu , Xuanhan Wang , Runze Yuan , Wei Lu , Xinyi Gong , Shuo Feng

Urban scene synthesis with video generation models has recently shown great potential for autonomous driving. Existing video generation approaches to autonomous driving primarily focus on RGB video generation and lack the ability to support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guile Wu , David Huang , Dongfeng Bai , Bingbing Liu