English
Related papers

Related papers: SMEMO: Social Memory for Trajectory Forecasting

200 papers

We present a unified framework for understanding human social behaviors in raw image sequences. Our model jointly detects multiple individuals, infers their social actions, and estimates the collective actions with a single feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Timur Bagautdinov , Alexandre Alahi , François Fleuret , Pascal Fua , Silvio Savarese

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

Machine Learning · Computer Science 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov

Since the past few decades, human trajectory forecasting has been a field of active research owing to its numerous real-world applications: evacuation situation analysis, deployment of intelligent transport systems, traffic operations, to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Parth Kothari , Sven Kreiss , Alexandre Alahi

When humans navigate a crowed space such as a university campus or the sidewalks of a busy street, they follow common sense rules based on social etiquette. In this paper, we argue that in order to enable the design of new algorithms that…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Alexandre Robicquet , Alexandre Alahi , Amir Sadeghian , Bryan Anenberg , John Doherty , Eli Wu , Silvio Savarese

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

Multi-agent interactions are important to model for forecasting other agents' behaviors and trajectories. At a certain time, to forecast a reasonable future trajectory, each agent needs to pay attention to the interactions with only a small…

Machine Learning · Computer Science 2022-03-22 Zhangjie Cao , Erdem Bıyık , Guy Rosman , Dorsa Sadigh

Motion forecasts of road users (i.e., agents) vary in complexity depending on the number of agents, scene constraints, and interactions. In particular, the output space of joint trajectory distributions grows exponentially with the number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Royden Wagner , Omer Sahin Tas , Felix Hauser , Marlon Steiner , Dominik Strutz , Abhishek Vivekanandan , Jaime Villa , Yinzhe Shen , Carlos Fernandez , Christoph Stiller

Crowd navigation has received increasing attention from researchers over the last few decades, resulting in the emergence of numerous approaches aimed at addressing this problem to date. Our proposed approach couples agent motion prediction…

Pedestrian trajectory prediction is a challenging task because of the complexity of real-world human social behaviors and uncertainty of the future motion. For the first issue, existing methods adopt fully connected topology for modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Lidan Zhang , Qi She , Ping Guo

We introduce Masked Trajectory Models (MTM) as a generic abstraction for sequential decision making. MTM takes a trajectory, such as a state-action sequence, and aims to reconstruct the trajectory conditioned on random subsets of the same…

Machine Learning · Computer Science 2023-05-05 Philipp Wu , Arjun Majumdar , Kevin Stone , Yixin Lin , Igor Mordatch , Pieter Abbeel , Aravind Rajeswaran

Modeling how human moves in the space is useful for policy-making in transportation, public safety, and public health. Human movements can be viewed as a dynamic process that human transits between states (\eg, locations) over time. In the…

Artificial Intelligence · Computer Science 2021-03-24 Hua Wei , Dongkuan Xu , Junjie Liang , Zhenhui Li

Predicting future behavior of other traffic participants is an essential task that needs to be solved by automated vehicles and human drivers alike to achieve safe and situationaware driving. Modern approaches to vehicles trajectory…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Florian Mirus , Terrence C. Stewart , Jorg Conradt

Human motion and behaviour in crowded spaces is influenced by several factors, such as the dynamics of other moving agents in the scene, as well as the static elements that might be perceived as points of attraction or obstacles. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Federico Bartoli , Giuseppe Lisanti , Lamberto Ballan , Alberto Del Bimbo

Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by…

Machine Learning · Computer Science 2024-03-26 Yinke Dong , Haifeng Yuan , Hongkun Liu , Wei Jing , Fangzhen Li , Hongmin Liu , Bin Fan

Human movement prediction is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose a prediction framework that decouples short-term…

Robotics · Computer Science 2020-03-19 Philipp Kratzer , Marc Toussaint , Jim Mainprice

Humans learn from observations and experiences to adjust their behaviours towards better performance. Interacting with such dynamic humans is challenging, as the robot needs to predict the humans accurately for safe and efficient…

Robotics · Computer Science 2025-02-13 Yuwen Liao , Muqing Cao , Xinhang Xu , Lihua Xie

In the near future, more and more machines will perform tasks in the vicinity of human spaces or support them directly in their spatially bound activities. In order to simplify the verbal communication and the interaction between robotic…

Machine Learning · Computer Science 2020-04-14 Sebastian Feld , Steffen Illium , Andreas Sedlmeier , Lenz Belzner

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

From pedestrians to Kuramoto oscillators, interactions between agents govern how dynamical systems evolve in space and time. Discovering how these agents relate to each other has the potential to improve our understanding of the often…

Machine Learning · Computer Science 2025-03-12 Yulong Yang , Bowen Feng , Keqin Wang , Naomi Ehrich Leonard , Adji Bousso Dieng , Christine Allen-Blanchette

The trajectory prediction is significant for the decision-making of autonomous driving vehicles. In this paper, we propose a model to predict the trajectories of target agents around an autonomous vehicle. The main idea of our method is…

Machine Learning · Computer Science 2020-07-08 Tao Yang , Zhixiong Nan , He Zhang , Shitao Chen , Nanning Zheng