English
Related papers

Related papers: AgentFormer: Agent-Aware Transformers for Socio-Te…

200 papers

Modeling multi-agent systems requires understanding how agents interact. Such systems are often difficult to model because they can involve a variety of types of interactions that layer together to drive rich social behavioral dynamics.…

Machine Learning · Computer Science 2023-01-26 Fan-Yun Sun , Isaac Kauvar , Ruohan Zhang , Jiachen Li , Mykel Kochenderfer , Jiajun Wu , Nick Haber

Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by…

Machine Learning · Computer Science 2024-03-26 Yinke Dong , Haifeng Yuan , Hongkun Liu , Wei Jing , Fangzhen Li , Hongmin Liu , Bin Fan

Individual traffic significantly contributes to climate change and environmental degradation. Therefore, innovation in sustainable mobility is gaining importance as it helps to reduce environmental pollution. However, effects of new ideas…

Multiagent Systems · Computer Science 2021-11-16 Johannes Nguyen , Simon T. Powers , Neil Urquhart , Thomas Farrenkopf , Michael Guckert

We propose JFP, a Joint Future Prediction model that can learn to generate accurate and consistent multi-agent future trajectories. For this task, many different methods have been proposed to capture social interactions in the encoding part…

Multiagent Systems · Computer Science 2022-12-20 Wenjie Luo , Cheolho Park , Andre Cornman , Benjamin Sapp , Dragomir Anguelov

Predicting trajectories of pedestrians based on goal information in highly interactive scenes is a crucial step toward Intelligent Transportation Systems and Autonomous Driving. The challenges of this task come from two key sources: (1)…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Weicheng Zhang , Hao Cheng , Fatema T. Johora , Monika Sester

In this paper, we address the problem of predicting the future motion of a dynamic agent (called a target agent) given its current and past states as well as the information on its environment. It is paramount to develop a prediction model…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 ByeoungDo Kim , Seong Hyeon Park , Seokhwan Lee , Elbek Khoshimjonov , Dongsuk Kum , Junsoo Kim , Jeong Soo Kim , Jun Won Choi

Predicting the future behavior of moving agents is essential for real world applications. It is challenging as the intent of the agent and the corresponding behavior is unknown and intrinsically multimodal. Our key insight is that for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Hang Zhao , Jiyang Gao , Tian Lan , Chen Sun , Benjamin Sapp , Balakrishnan Varadarajan , Yue Shen , Yi Shen , Yuning Chai , Cordelia Schmid , Congcong Li , Dragomir Anguelov

Passenger demand forecasting helps optimize vehicle scheduling, thereby improving urban efficiency. Recently, attention-based methods have been used to adequately capture the dynamic nature of spatio-temporal data. However, existing methods…

Artificial Intelligence · Computer Science 2025-06-06 Haichen Wang , Liu Yang , Xinyuan Zhang , Haomin Yu , Ming Li , Jilin Hu

Modeling how human moves in the space is useful for policy-making in transportation, public safety, and public health. Human movements can be viewed as a dynamic process that human transits between states (\eg, locations) over time. In the…

Artificial Intelligence · Computer Science 2021-03-24 Hua Wei , Dongkuan Xu , Junjie Liang , Zhenhui Li

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is essential for safe…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 DiJia Su , Bertrand Douillard , Rami Al-Rfou , Cheolho Park , Benjamin Sapp

Learning an agent model that behaves like humans-capable of jointly perceiving the environment, predicting the future, and taking actions from a first-person perspective-is a fundamental challenge in computer vision. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Lu Chen , Yizhou Wang , Shixiang Tang , Qianhong Ma , Tong He , Wanli Ouyang , Xiaowei Zhou , Hujun Bao , Sida Peng

Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Yao Liu , Binghao Li , Xianzhi Wang , Claude Sammut , Lina Yao

Predicting future locations of agents in the scene is an important problem in self-driving. In recent years, there has been a significant progress in representing the scene and the agents in it. The interactions of agents with the scene and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Görkay Aydemir , Adil Kaan Akan , Fatma Güney

Autonomous systems often operate in environments where the behavior of multiple agents is coordinated by a shared global state. Reliable estimation of the global state is thus critical for successfully operating in a multi-agent setting. We…

Robotics · Computer Science 2021-08-03 Shane Parr , Ishan Khatri , Justin Svegliato , Shlomo Zilberstein

Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is notoriously…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Xishun Wang , Tong Su , Fang Da , Xiaodong Yang

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

Learning accurate, data-driven predictive models for multiple interacting agents following unknown dynamics is crucial in many real-world physical and social systems. In many scenarios, dynamics prediction must be performed under incomplete…

Multiagent Systems · Computer Science 2024-04-03 Hemant Kumawat , Biswadeep Chakraborty , Saibal Mukhopadhyay

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Testing conversational AI systems at scale across diverse domains necessitates realistic and diverse user interactions capturing a wide array of behavioral patterns. We present a novel multi-agent framework for realistic, explainable human…

Human-Computer Interaction · Computer Science 2026-01-23 Hareeshwar Karthikeyan