English
Related papers

Related papers: Scene Transformer: A unified architecture for pred…

200 papers

Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by…

Machine Learning · Computer Science 2024-03-26 Yinke Dong , Haifeng Yuan , Hongkun Liu , Wei Jing , Fangzhen Li , Hongmin Liu , Bin Fan

Developing safe human-robot interaction systems is a necessary step towards the widespread integration of autonomous agents in society. A key component of such systems is the ability to reason about the many potential futures (e.g.…

Robotics · Computer Science 2019-08-27 Boris Ivanovic , Marco Pavone

Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi-agent motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ari Seff , Brian Cera , Dian Chen , Mason Ng , Aurick Zhou , Nigamaa Nayakanti , Khaled S. Refaat , Rami Al-Rfou , Benjamin Sapp

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

We propose JFP, a Joint Future Prediction model that can learn to generate accurate and consistent multi-agent future trajectories. For this task, many different methods have been proposed to capture social interactions in the encoding part…

Multiagent Systems · Computer Science 2022-12-20 Wenjie Luo , Cheolho Park , Andre Cornman , Benjamin Sapp , Dragomir Anguelov

Trajectory prediction is a critical functionality of autonomous systems that share environments with uncontrolled agents, one prominent example being self-driving vehicles. Currently, most prediction methods do not enforce scene…

Artificial Intelligence · Computer Science 2022-06-28 Yuxiao Chen , Boris Ivanovic , Marco Pavone

Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is notoriously…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Xishun Wang , Tong Su , Fang Da , Xiaodong Yang

This paper introduces UniGen, a novel approach to generating new traffic scenarios for evaluating and improving autonomous driving software through simulation. Our approach models all driving scenario elements in a unified model: the…

Predicting the behaviors of other road users is crucial to safe and intelligent decision-making for autonomous vehicles (AVs). However, most motion prediction models ignore the influence of the AV's actions and the planning module has to…

Robotics · Computer Science 2023-02-09 Zhiyu Huang , Haochen Liu , Jingda Wu , Wenhui Huang , Chen Lv

Accurate prediction of driving scene is a challenging task due to uncertainty in sensor data, the complex behaviors of agents, and the possibility of multiple feasible futures. Existing prediction methods using occupancy grid maps primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Rabbia Asghar , Lukas Rummelhard , Wenqian Liu , Anne Spalanzani , Christian Laugier

Motion simulation, prediction and planning are foundational tasks in autonomous driving, each essential for modeling and reasoning about dynamic traffic scenarios. While often addressed in isolation due to their differing objectives, such…

Robotics · Computer Science 2026-02-03 Nan Song , Junzhe Jiang , Jingyu Li , Xiatian Zhu , Li Zhang

For autonomous agents to successfully operate in real world, the ability to anticipate future motions of surrounding entities in the scene can greatly enhance their safety levels since potentially dangerous situations could be avoided in…

Machine Learning · Computer Science 2019-06-04 Yeping Hu , Wei Zhan , Liting Sun , Masayoshi Tomizuka

To safely and efficiently solve motion planning problems in multi-agent settings, most approaches attempt to solve a joint optimization that explicitly accounts for the responses triggered in other agents. This often results in solutions…

Robotics · Computer Science 2025-06-11 Roman Chiva Gil , Daniel Jarne Ornia , Khaled A. Mustafa , Javier Alonso Mora

Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is essential for safe…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 DiJia Su , Bertrand Douillard , Rami Al-Rfou , Cheolho Park , Benjamin Sapp

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

In order to drive safely on the road, autonomous vehicle is expected to predict future outcomes of its surrounding environment and react properly. In fact, many researchers have been focused on solving behavioral prediction problems for…

Robotics · Computer Science 2020-11-12 Weihao Xuan , Ruijie Ren

Predicting motion of surrounding agents is critical to real-world applications of tactical path planning for autonomous driving. Due to the complex temporal dependencies and social interactions of agents, on-line trajectory prediction is a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jingwen Zhao , Xuanpeng Li , Qifan Xue , Weigong Zhang

Understanding the behavior of road users is of vital importance for the development of trajectory prediction systems. In this context, the latest advances have focused on recurrent structures, establishing the social interaction between the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 A. Quintanar , D. Fernández-Llorca , I. Parra , R. Izquierdo , M. A. Sotelo

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Forecasting vehicular motions in autonomous driving requires a deep understanding of agent interactions and the preservation of motion equivariance under Euclidean geometric transformations. Traditional models often lack the sophistication…

Robotics · Computer Science 2025-08-05 Yuping Wang , Jier Chen