English
Related papers

Related papers: Risk-Controllable Multi-View Diffusion for Driving…

200 papers

Recent advances in diffusion models have improved controllable streetscape generation and supported downstream perception and planning tasks. However, challenges remain in accurately modeling driving scenes and generating long videos. To…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jianbiao Mei , Tao Hu , Xuemeng Yang , Licheng Wen , Yu Yang , Tiantian Wei , Yukai Ma , Min Dou , Botian Shi , Yong Liu

Simulation of autonomous vehicle systems requires that simulated traffic participants exhibit diverse and realistic behaviors. The use of prerecorded real-world traffic scenarios in simulation ensures realism but the rarity of safety…

Safety-critical traffic scenarios are integral to the development and validation of autonomous driving systems. These scenarios provide crucial insights into vehicle responses under high-risk conditions rarely encountered in real-world…

Robotics · Computer Science 2024-10-08 Jinxiong Lu , Shoaib Azam , Gokhan Alcan , Ville Kyrki

Recent advancements in generative models have provided promising solutions for synthesizing realistic driving videos, which are crucial for training autonomous driving perception models. However, existing approaches often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Wei Wu , Xi Guo , Weixuan Tang , Tingxuan Huang , Chiyu Wang , Dongyue Chen , Chenjing Ding

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Autonomous driving training requires a diverse range of datasets encompassing various traffic conditions, weather scenarios, and road types. Traditional data augmentation methods often struggle to generate datasets that represent rare…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yongjie Fu , Yunlong Li , Xuan Di

Autonomous driving testing increasingly relies on mining safety critical scenarios from large scale naturalistic driving data, yet existing screening pipelines still depend on manual risk annotation and expensive frame by frame risk…

Robotics · Computer Science 2026-03-24 Chen Xiong , Ziwen Wang , Deqi Wang , Cheng Wang , Yiyang Chen , He Zhang , Chao Gou

Robotic manipulation requires understanding both the 3D spatial structure of the environment and its temporal evolution, yet most existing policies overlook one or both. They typically rely on 2D visual observations and backbones pretrained…

While recent text-to-video (T2V) diffusion models have achieved impressive quality and prompt alignment, they often produce low-diversity outputs when sampling multiple videos from a single text prompt. We tackle this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tahira Kazimi , Connor Dunlop , Pinar Yanardag

Ensuring safe interactions between autonomous vehicles (AVs) and human drivers in mixed traffic systems remains a major challenge, particularly in complex, high-risk scenarios. This paper presents a cognition-decision framework that…

Artificial Intelligence · Computer Science 2025-03-18 Heye Huang , Zheng Li , Hao Cheng , Haoran Wang , Junkai Jiang , Xiaopeng Li , Arkady Zgonnikov

Training deep learning methods on small time series datasets that also include corrupted samples is challenging. Diffusion models have shown to be effective to generate realistic and synthetic data, and correct corrupted samples through…

Machine Learning · Computer Science 2025-09-17 Julian Ripper , Ousama Esbel , Rafael Fietzek , Max Mühlhäuser , Thomas Kreutz

The validation of autonomous driving systems benefits greatly from the ability to generate scenarios that are both realistic and precisely controllable. Conventional approaches, such as real-world test drives, are not only expensive but…

Robotics · Computer Science 2025-04-01 Yizhuo Xiao , Mustafa Suphi Erden , Cheng Wang

Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a unified framework…

Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporally consistent generation. However, large-scale 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Yang , Alan Liang , Jianbiao Mei , Yukai Ma , Yong Liu , Gim Hee Lee

Autonomous driving requires an understanding of the static environment from sensor data. Learned Bird's-Eye View (BEV) encoders are commonly used to fuse multiple inputs, and a vector decoder predicts a vectorized map representation from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Thomas Monninger , Zihan Zhang , Zhipeng Mo , Md Zafar Anwar , Steffen Staab , Sihao Ding

This paper proposes AutoScape, a long-horizon driving scene generation framework. At its core is a novel RGB-D diffusion model that iteratively generates sparse, geometrically consistent keyframes, serving as reliable anchors for the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Jiacheng Chen , Ziyu Jiang , Mingfu Liang , Bingbing Zhuang , Jong-Chyi Su , Sparsh Garg , Ying Wu , Manmohan Chandraker

Synthesizing extrapolated views remains a difficult task, especially in urban driving scenes, where the only reliable sources of data are limited RGB captures and sparse LiDAR points. To address this problem, we present PointmapDiff, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Thang-Anh-Quan Nguyen , Nathan Piasco , Luis Roldão , Moussab Bennehar , Dzmitry Tsishkou , Laurent Caraffa , Jean-Philippe Tarel , Roland Brémond

Diffusion-based methods have achieved remarkable achievements in 2D image or 3D object generation, however, the generation of 3D scenes and even $360^{\circ}$ images remains constrained, due to the limited number of scene datasets, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Weicai Ye , Chenhao Ji , Zheng Chen , Junyao Gao , Xiaoshui Huang , Song-Hai Zhang , Wanli Ouyang , Tong He , Cairong Zhao , Guofeng Zhang

Drivable Free-space prediction is a fundamental and crucial problem in autonomous driving. Recent works have addressed the problem by representing the entire non-obstacle road regions as the free-space. In contrast our aim is to estimate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Keshav Gupta , Tejas S. Stanley , Pranjal Paul , Arun K. Singh , K. Madhava Krishna

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

Robotics · Computer Science 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti