English
Related papers

Related papers: FIMP: Future Interaction Modeling for Multi-Agent …

200 papers

Accurate prediction of physical interaction outcomes is a crucial component of human intelligence and is important for safe and efficient deployments of robots in the real world. While there are existing vision-based intuitive physics…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Jiafei Duan , Samson Yu , Soujanya Poria , Bihan Wen , Cheston Tan

Interactive driving scenarios, such as lane changes, merges and unprotected turns, are some of the most challenging situations for autonomous driving. Planning in interactive scenarios requires accurately modeling the reactions of other…

In this work, we aim to achieve efficient end-to-end learning of driving policies in dynamic multi-agent environments. Predicting and anticipating future events at the object level are critical for making informed driving decisions. We…

Robotics · Computer Science 2021-01-18 Jinkun Cao , Xin Wang , Trevor Darrell , Fisher Yu

Predicting the behaviors of other agents on the road is critical for autonomous driving to ensure safety and efficiency. However, the challenging part is how to represent the social interactions between agents and output different possible…

Robotics · Computer Science 2021-09-15 Zhiyu Huang , Xiaoyu Mo , Chen Lv

To safely operate, an autonomous vehicle must know the future behavior of a potentially high number of interacting agents around it, a task often posed as multi-agent trajectory prediction. Many previous attempts to model social…

Artificial Intelligence · Computer Science 2026-03-24 Caio Azevedo , Stefano Sabatini , Sascha Hornauer , Fabien Moutarde

Simulating realistic behaviors of traffic agents is pivotal for efficiently validating the safety of autonomous driving systems. Existing data-driven simulators primarily use an encoder-decoder architecture to encode the historical…

Artificial Intelligence · Computer Science 2024-11-12 Zikang Zhou , Haibo Hu , Xinhong Chen , Jianping Wang , Nan Guan , Kui Wu , Yung-Hui Li , Yu-Kai Huang , Chun Jason Xue

Trajectory prediction is crucial for autonomous driving, enabling vehicles to navigate safely by anticipating the movements of surrounding road users. However, current deep learning models often lack trustworthiness as their predictions can…

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

The analysis and prediction of agent trajectories are crucial for decision-making processes in intelligent systems, with precise short-term trajectory forecasting being highly significant across a range of applications. Agents and their…

Machine Learning · Computer Science 2025-04-23 Kai Chen , Xiaodong Zhao , Yujie Huang , Guoyu Fang , Xiao Song , Ruiping Wang , Ziyuan Wang

In urban driving scenarios, forecasting future trajectories of surrounding vehicles is of paramount importance. While several approaches for the problem have been proposed, the best-performing ones tend to require extremely detailed input…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Shashank Srikanth , Junaid Ahmed Ansari , Karnik Ram R , Sarthak Sharma , Krishna Murthy J. , Madhava Krishna K

Predicting the future behavior of agents is a fundamental task in autonomous vehicle domains. Accurate prediction relies on comprehending the surrounding map, which significantly regularizes agent behaviors. However, existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Chen Feng , Hangning Zhou , Huadong Lin , Zhigang Zhang , Ziyao Xu , Chi Zhang , Boyu Zhou , Shaojie Shen

Predicting the future motion of road participants is a critical task in autonomous driving. In this work, we address the challenge of low-quality generation of low-probability modes in multi-agent joint prediction. To tackle this issue, we…

Robotics · Computer Science 2025-07-24 Fangze Lin , Ying He , Fei Yu , Hong Zhang

Multi-agent motion prediction is challenging because it aims to foresee the future trajectories of multiple agents (\textit{e.g.} pedestrians) simultaneously in a complicated scene. Existing work addressed this challenge by either learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Chaofan Tao , Qinhong Jiang , Lixin Duan , Ping Luo

End-to-end motion planning is promising for simplifying complex autonomous driving pipelines. However, challenges such as scene understanding and effective prediction for decision-making continue to present substantial obstacles to its…

Trajectory prediction is a critical component of autonomous driving, essential for ensuring both safety and efficiency on the road. However, traditional approaches often struggle with the scarcity of labeled data and exhibit suboptimal…

Robotics · Computer Science 2025-09-18 Jianxin Shi , Zengqi Peng , Xiaolong Chen , Tianyu Wo , Jun Ma

Predicting future motions of road participants is an important task for driving autonomously. Most existing models excel at predicting the marginal trajectory of a single agent, but predicting joint trajectories for multiple agents that are…

Robotics · Computer Science 2024-11-26 Mingyi Wang , Hongqun Zou , Yifan Liu , You Wang , Guang Li

Due to the complex and changing interactions in dynamic scenarios, motion forecasting is a challenging problem in autonomous driving. Most existing works exploit static road graphs to characterize scenarios and are limited in modeling…

Artificial Intelligence · Computer Science 2023-03-09 Xing Gao , Xiaogang Jia , Yikang Li , Hongkai Xiong

For autonomous vehicles (AVs) to behave appropriately on roads populated by human-driven vehicles, they must be able to reason about the uncertain intentions and decisions of other drivers from rich perceptual information. Towards these…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Nicholas Rhinehart , Rowan McAllister , Kris Kitani , Sergey Levine

Predicting future frames of a video sequence has been a problem of high interest in the field of Computer Vision as it caters to a multitude of applications. The ability to predict, anticipate and reason about future events is the essence…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Jasmeen Kaur , Sukhendu Das

Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is notoriously…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Xishun Wang , Tong Su , Fang Da , Xiaodong Yang