English
Related papers

Related papers: Rolling Ahead Diffusion for Traffic Scene Simulati…

200 papers

Multi-agent trajectory forecasting in autonomous driving requires an agent to accurately anticipate the behaviors of the surrounding vehicles and pedestrians, for safe and reliable decision-making. Due to partial observability in these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Seong Hyeon Park , Gyubok Lee , Manoj Bhat , Jimin Seo , Minseok Kang , Jonathan Francis , Ashwin R. Jadhav , Paul Pu Liang , Louis-Philippe Morency

In the context of continuously rising global air traffic, efficient and safe Conflict Detection and Resolution (CD&R) is paramount for air traffic management. Although Deep Reinforcement Learning (DRL) offers a promising pathway for CD&R…

Artificial Intelligence · Computer Science 2025-09-05 Tonghe Li , Jixin Liu , Weili Zeng , Hao Jiang

Anticipating future actions is inherently uncertain. Given an observed video segment containing ongoing actions, multiple subsequent actions can plausibly follow. This uncertainty becomes even larger when predicting far into the future.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zeyun Zhong , Chengzhi Wu , Manuel Martin , Michael Voit , Juergen Gall , Jürgen Beyerer

This paper introduces UniGen, a novel approach to generating new traffic scenarios for evaluating and improving autonomous driving software through simulation. Our approach models all driving scenario elements in a unified model: the…

Addressing decision-making problems using sequence modeling to predict future trajectories shows promising results in recent years. In this paper, we take a step further to leverage the sequence predictive method in wider areas such as…

Robotics · Computer Science 2023-12-07 Mineui Hong , Minjae Kang , Songhwai Oh

A longstanding challenge for self-driving development is simulating dynamic driving scenarios seeded from recorded driving logs. In pursuit of this functionality, we apply tools from discrete sequence modeling to model how vehicles,…

Machine Learning · Computer Science 2024-04-16 Jonah Philion , Xue Bin Peng , Sanja Fidler

Diffusion models have become popular for policy learning in robotics due to their ability to capture high-dimensional and multimodal distributions. However, diffusion policies are stochastic and typically trained offline, limiting their…

Robotics · Computer Science 2025-05-28 Ralf Römer , Alexander von Rohr , Angela P. Schoellig

Traffic flow prediction is an important part of smart transportation. The goal is to predict future traffic conditions based on historical data recorded by sensors and the traffic network. As the city continues to build, parts of the…

Machine Learning · Statistics 2022-12-27 Yanan Xiao , Minyu Liu , Zichen Zhang , Lu Jiang , Minghao Yin , Jianan Wang

Existing long-term video prediction methods often rely on an autoregressive video prediction mechanism. However, this approach suffers from error propagation, particularly in distant future frames. To address this limitation, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Woonho Ko , Jin Bok Park , Il Yong Chun

Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep learning-based due to their strength in encoding complex…

Robotics · Computer Science 2023-03-27 Yujun Jiao , Mingze Miao , Zhishuai Yin , Chunyuan Lei , Xu Zhu , Linzhen Nie , Bo Tao

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jiawei Ren , Mengmeng Xu , Jui-Chieh Wu , Ziwei Liu , Tao Xiang , Antoine Toisoul

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

Human-Computer Interaction · Computer Science 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

The way of analyzing, designing and building of real-time projects has been changed due to the rapid growth of internet, mobile technologies and intelligent applications. Most of these applications are intelligent, tiny and distributed…

Multiagent Systems · Computer Science 2011-08-03 Venkatesh. M , K. Kumar , Srinivas. V

Lane changing and lane merging remains a challenging task for autonomous driving, due to the strong interaction between the controlled vehicle and the uncertain behavior of the surrounding traffic participants. The interaction induces a…

Optimization and Control · Mathematics 2022-12-01 Renzi Wang , Mathijs Schuurmans , Panagiotis Patrinos

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Diffusion models have made substantial progress in facilitating image generation and editing. As the technology matures, we see its potential in the context of driving simulations to enhance the simulated experience. In this paper, we…

Human-Computer Interaction · Computer Science 2024-10-08 Fanjun Bu , Hiroshi Yasuda

We introduce a method for generating realistic pedestrian trajectories and full-body animations that can be controlled to meet user-defined goals. We draw on recent advances in guided diffusion modeling to achieve test-time controllability…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Davis Rempe , Zhengyi Luo , Xue Bin Peng , Ye Yuan , Kris Kitani , Karsten Kreis , Sanja Fidler , Or Litany

In this paper we show an effective means of integrating data driven frameworks to sampling based optimal control to vastly reduce the compute time for easy adoption and adaptation to real time applications such as on-road autonomous driving…

Robotics · Computer Science 2023-10-23 Kaustab Pal , Aditya Sharma , Mohd Omama , Parth N. Shah , K. Madhava Krishna

Efficient planning in high-dimensional spaces, such as those involving deformable objects, requires computationally tractable yet sufficiently expressive dynamics models. This paper introduces a method that automatically generates…

Robotics · Computer Science 2025-08-27 Alex LaGrassa , Zixuan Huang , Dmitry Berenson , Oliver Kroemer