English
Related papers

Related papers: DiffAD: A Unified Diffusion Modeling Approach for …

200 papers

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

We introduce DreamerAD, the first latent world model framework that enables efficient reinforcement learning for autonomous driving by compressing diffusion sampling from 100 steps to 1 - achieving 80x speedup while maintaining visual…

Generating realistic and diverse road scenarios is essential for autonomous vehicle testing and validation. Nevertheless, owing to the complexity and variability of real-world road environments, creating authentic and varied scenarios for…

Robotics · Computer Science 2024-11-15 Junjie Zhou , Lin Wang , Qiang Meng , Xiaofan Wang

In this paper, we present a novel trajectory prediction model for autonomous driving, combining a Characterized Diffusion Module and a Spatial-Temporal Interaction Network to address the challenges posed by dynamic and heterogeneous traffic…

Robotics · Computer Science 2024-11-26 Haoming Li

With the increasing popularity of autonomous driving based on the powerful and unified bird's-eye-view (BEV) representation, a demand for high-quality and large-scale multi-view video data with accurate annotation is urgently required.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Xiaofan Li , Yifu Zhang , Xiaoqing Ye

We present PoseDiff, a conditional diffusion model that unifies robot state estimation and control within a single framework. At its core, PoseDiff maps raw visual observations into structured robot states-such as 3D keypoints or joint…

Robotics · Computer Science 2025-11-03 Haozhuo Zhang , Michele Caprio , Jing Shao , Qiang Zhang , Jian Tang , Shanghang Zhang , Wei Pan

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Safety-critical traffic simulation plays a crucial role in evaluating autonomous driving systems under rare and challenging scenarios. However, existing approaches often generate unrealistic scenarios due to insufficient consideration of…

Robotics · Computer Science 2025-05-02 Mingxing Peng , Ruoyu Yao , Xusen Guo , Yuting Xie , Xianda Chen , Jun Ma

Diffusion probabilistic models have been shown to generate state-of-the-art results on several competitive image synthesis benchmarks but lack a low-dimensional, interpretable latent space, and are slow at generation. On the other hand,…

Machine Learning · Computer Science 2022-11-30 Kushagra Pandey , Avideep Mukherjee , Piyush Rai , Abhishek Kumar

Diffusion probabilistic models (DPMs) have shown remarkable results on various image synthesis tasks such as text-to-image generation and image inpainting. However, compared to other generative methods like VAEs and GANs, DPMs lack a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yipeng Leng , Qiangjuan Huang , Zhiyuan Wang , Yangyang Liu , Haoyu Zhang

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Simulation-based design, optimization, and validation of autonomous vehicles have proven to be crucial for their improvement over the years. Nevertheless, the ultimate measure of effectiveness is their successful transition from simulation…

Robotics · Computer Science 2025-11-21 Chinmay Vilas Samak , Tanmay Vilas Samak , Bing Li , Venkat Krovi

Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition…

World models have demonstrated significant promise for data synthesis in autonomous driving. However, existing methods predominantly concentrate on single-modality generation, typically focusing on either multi-camera video or LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Guosheng Zhao , Yaozeng Wang , Xiaofeng Wang , Zheng Zhu , Tingdong Yu , Guan Huang , Yongchen Zai , Ji Jiao , Changliang Xue , Xiaole Wang , Zhen Yang , Futang Zhu , Xingang Wang

Although multi-view 3D object detection based on the Bird's-Eye-View (BEV) paradigm has garnered widespread attention as an economical and deployment-friendly perception solution for autonomous driving, there is still a performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zheng Jiang , Jinqing Zhang , Yanan Zhang , Qingjie Liu , Zhenghui Hu , Baohui Wang , Yunhong Wang

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

While there have been advancements in autonomous driving control and traffic simulation, there have been little to no works exploring their unification with deep learning. Works in both areas seem to focus on entirely different exclusive…

Robotics · Computer Science 2023-04-10 Laura Zheng , Sanghyun Son , Ming C. Lin

We describe a robust planning method for autonomous driving that mixes normal and adversarial agent predictions output by a diffusion model trained for motion prediction. We first train a diffusion model to learn an unbiased distribution of…

Robotics · Computer Science 2025-05-20 Albert Zhao , Stefano Soatto