English
Related papers

Related papers: FIMP: Future Interaction Modeling for Multi-Agent …

200 papers

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

As an essential task in autonomous driving (AD), motion prediction aims to predict the future states of surround objects for navigation. One natural solution is to estimate the position of other agents in a step-by-step manner where each…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Xiaosong Jia , Shaoshuai Shi , Zijun Chen , Li Jiang , Wenlong Liao , Tao He , Junchi Yan

For robots to be a part of our daily life, they need to be able to navigate among crowds not only safely but also in a socially compliant fashion. This is a challenging problem because humans tend to navigate by implicitly cooperating with…

Robotics · Computer Science 2017-05-18 Anirudh Vemula , Katharina Muelling , Jean Oh

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Lane changing and lane merging remains a challenging task for autonomous driving, due to the strong interaction between the controlled vehicle and the uncertain behavior of the surrounding traffic participants. The interaction induces a…

Optimization and Control · Mathematics 2022-12-01 Renzi Wang , Mathijs Schuurmans , Panagiotis Patrinos

Multi-person motion prediction is a challenging problem due to the dependency of motion on both individual past movements and interactions with other people. Transformer-based methods have shown promising results on this task, but they miss…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Qingyao Xu , Weibo Mao , Jingze Gong , Chenxin Xu , Siheng Chen , Weidi Xie , Ya Zhang , Yanfeng Wang

Accurate motion prediction of surrounding traffic participants is crucial for the safe and efficient operation of automated vehicles in dynamic environments. Marginal prediction models commonly forecast each agent's future trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fabian Konstantinidis , Ariel Dallari Guerreiro , Raphael Trumpp , Moritz Sackmann , Ulrich Hofmann , Marco Caccamo , Christoph Stiller

Accurate prediction is important for operating an autonomous vehicle in interactive scenarios. Prediction must be fast, to support multiple requests from a planner exploring a range of possible futures. The generated predictions must…

Robotics · Computer Science 2023-08-11 Anthony Knittel , Majd Hawasly , Stefano V. Albrecht , John Redford , Subramanian Ramamoorthy

Maintaining temporal stability is crucial in multi-agent trajectory prediction. Insufficient regularization to uphold this stability often results in fluctuations in kinematic states, leading to inconsistent predictions and the…

Artificial Intelligence · Computer Science 2024-04-26 Kaixin Shen , Ruijie Quan , Linchao Zhu , Jun Xiao , Yi Yang

In order to plan a safe maneuver an autonomous vehicle must accurately perceive its environment, and understand the interactions among traffic participants. In this paper, we aim to learn scene-consistent motion forecasts of complex urban…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Sergio Casas , Cole Gulino , Simon Suo , Katie Luo , Renjie Liao , Raquel Urtasun

To safely and efficiently navigate through complex traffic scenarios, autonomous vehicles need to have the ability to predict the future motion of surrounding vehicles. Multiple interacting agents, the multi-modal nature of driver behavior,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Nachiket Deo , Mohan M. Trivedi

As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns, etc., where predicting…

Vehicular traffic is a classical example of a multi-agent system in which autonomous drivers operate in a shared environment. The article provides an overview of the state-of-the-art in microscopic traffic modeling and the implications for…

Physics and Society · Physics 2009-10-26 Arne Kesting , Martin Treiber , Dirk Helbing

In this paper, we tackle the problem of detecting objects in 3D and forecasting their future motion in the context of self-driving. Towards this goal, we design a novel approach that explicitly takes into account the interactions between…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Lingyun Luke Li , Bin Yang , Ming Liang , Wenyuan Zeng , Mengye Ren , Sean Segal , Raquel Urtasun

Behavior prediction of traffic actors is an essential component of any real-world self-driving system. Actors' long-term behaviors tend to be governed by their interactions with other actors or traffic elements (traffic lights, stop signs)…

Machine Learning · Computer Science 2020-09-29 Sumit Kumar , Yiming Gu , Jerrick Hoang , Galen Clark Haynes , Micol Marchetti-Bowick

Forecasting the future behavior of all traffic agents in the vicinity is a key task to achieve safe and reliable autonomous driving systems. It is a challenging problem as agents adjust their behavior depending on their intentions, the…

Robotics · Computer Science 2021-12-30 Edoardo Mello Rella , Jan-Nico Zaech , Alexander Liniger , Luc Van Gool

This paper presents a novel approach to improving autonomous vehicle control in environments lacking clear road markings by integrating a diffusion-based motion predictor within an Active Inference Framework (AIF). Using a simulated parking…

Robotics · Computer Science 2024-06-04 Yufei Huang , Yulin Li , Andrea Matta , Mohsen Jafari

To accurately predict trajectories in multi-agent settings, e.g. team games, it is important to effectively model the interactions among agents. Whereas a number of methods have been developed for this purpose, existing methods implicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zikai Wei , Xinge Zhu , Bo Dai , Dahua Lin

Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jaewoo Jeong , Daehee Park , Kuk-Jin Yoon