English
Related papers

Related papers: SceneDiffuser: Efficient and Controllable Driving …

200 papers

Drivers' visual attention provides critical cues for anticipating latent hazards and directly shapes decision-making and control maneuvers, where its absence can compromise traffic safety. To emulate drivers' perception patterns and advance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weimin Liu , Qingkun Li , Jiyuan Qiu , Wenjun Wang , Joshua H. Meng

In this paper, we introduce a novel approach for autonomous driving trajectory generation by harnessing the complementary strengths of diffusion probabilistic models (a.k.a., diffusion models) and transformers. Our proposed framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chen Yang , Yangfan He , Aaron Xuxiang Tian , Dong Chen , Jianhui Wang , Tianyu Shi , Arsalan Heydarian , Pei Liu

Decentralized multi-robot motion planning requires each robot to generate collision-free trajectories from local observations, without global sensing or reliable communication. However, most existing planners, whether classical or…

Robotics · Computer Science 2026-05-28 Jinhao Liang , Sven Koenig , Ferdinando Fioretto

In this paper, we present a novel trajectory prediction model for autonomous driving, combining a Characterized Diffusion Module and a Spatial-Temporal Interaction Network to address the challenges posed by dynamic and heterogeneous traffic…

Robotics · Computer Science 2024-11-26 Haoming Li

World models, especially in autonomous driving, are trending and drawing extensive attention due to their capacity for comprehending driving environments. The established world model holds immense potential for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xinze Chen , Jiagang Zhu , Jiwen Lu

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chen Liu , Shibo He , Haoyu Liu , Jiming Chen

Bird's-eye-view (BEV) representations play a crucial role in autonomous driving tasks. Despite recent advancements in BEV generation, inherent noise, stemming from sensor limitations and the learning process, remains largely unaddressed,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Xin Ye , Burhaneddin Yaman , Sheng Cheng , Feng Tao , Abhirup Mallik , Liu Ren

This paper aims to tackle the problem of photorealistic view synthesis from vehicle sensor data. Recent advancements in neural scene representation have achieved notable success in rendering high-quality autonomous driving scenes, but the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yunzhi Yan , Zhen Xu , Haotong Lin , Haian Jin , Haoyu Guo , Yida Wang , Kun Zhan , Xianpeng Lang , Hujun Bao , Xiaowei Zhou , Sida Peng

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

Urban scene reconstruction from real-world observations has emerged as a powerful tool for self-driving development and testing. While current neural rendering approaches achieve high-fidelity rendering along the recorded trajectories,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Henry Che , Jingkang Wang , Yun Chen , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun

Accurate trajectory prediction and motion planning are crucial for autonomous driving systems to navigate safely in complex, interactive environments characterized by multimodal uncertainties. However, current generation-then-evaluation…

Robotics · Computer Science 2025-09-23 Ruiguo Zhong , Ruoyu Yao , Pei Liu , Xiaolong Chen , Rui Yang , Jun Ma

Achieving safe and stylized trajectory planning in complex real-world scenarios remains a critical challenge for autonomous driving systems. This paper proposes the SDD Planner, a diffusion-based framework designed to effectively reconcile…

Robotics · Computer Science 2026-03-13 Shuo Pei , Yong Wang , Yuanchen Zhu , Chen Sun , Qin Li , Yanan Zhao , Huachun Tan

Synthesizing natural human motion that adapts to complex environments while allowing creative control remains a fundamental challenge in motion synthesis. Existing models often fall short, either by assuming flat terrain or lacking the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Xiaohan Zhang , Sebastian Starke , Vladimir Guzov , Zhensong Zhang , Eduardo Pérez Pellitero , Gerard Pons-Moll

Generating multi-camera street-view videos is critical for augmenting autonomous driving datasets, addressing the urgent demand for extensive and varied data. Due to the limitations in diversity and challenges in handling lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiachen Lu , Ze Huang , Zeyu Yang , Jiahui Zhang , Li Zhang

Generating safe and reliable trajectories for autonomous vehicles in long-tail scenarios remains a significant challenge, particularly for high-lateral-acceleration maneuvers such as sharp turns, which represent critical safety situations.…

Robotics · Computer Science 2026-01-15 Xuemei Yao , Xiao Yang , Jianbin Sun , Liuwei Xie , Xuebin Shao , Xiyu Fang , Hang Su , Kewei Yang

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou

This paper presents a novel approach to improving autonomous vehicle control in environments lacking clear road markings by integrating a diffusion-based motion predictor within an Active Inference Framework (AIF). Using a simulated parking…

Robotics · Computer Science 2024-06-04 Yufei Huang , Yulin Li , Andrea Matta , Mohsen Jafari

Urban scene synthesis with video generation models has recently shown great potential for autonomous driving. Existing video generation approaches to autonomous driving primarily focus on RGB video generation and lack the ability to support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guile Wu , David Huang , Dongfeng Bai , Bingbing Liu

Recent advances in autonomous system simulation platforms have significantly enhanced the safe and scalable testing of driving policies. However, existing simulators do not yet fully meet the needs of future transportation…