English
Related papers

Related papers: TITAN: Future Forecast using Action Priors

200 papers

The advancement of socially-aware autonomous vehicles hinges on precise modeling of human behavior. Within this broad paradigm, the specific challenge lies in accurately predicting pedestrian's trajectory and intention. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Farzeen Munir , Tomasz Piotr Kucner

The ability to predict collision-free future trajectories from egocentric observations is crucial in applications such as humanoid robotics, VR / AR, and assistive navigation. In this work, we introduce the challenging problem of predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Boxiao Pan , Adam W. Harley , C. Karen Liu , Leonidas J. Guibas

Prediction of dynamic environment is crucial to safe navigation of an autonomous vehicle. Urban traffic scenes are particularly challenging to forecast due to complex interactions between various dynamic agents, such as vehicles and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Rabbia Asghar , Lukas Rummelhard , Anne Spalanzani , Christian Laugier

Inferring relational behavior between road users as well as road users and their surrounding physical space is an important step toward effective modeling and prediction of navigation strategies adopted by participants in road scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Chiho Choi , Behzad Dariush

Deciphering human behaviors to predict their future paths/trajectories and what they would do from videos is important in many applications. Motivated by this idea, this paper studies predicting a pedestrian's future path jointly with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Junwei Liang , Lu Jiang , Juan Carlos Niebles , Alexander Hauptmann , Li Fei-Fei

In the field of autonomous driving, there have been many excellent perception models for object detection, semantic segmentation, and other tasks, but how can we effectively use the perception models for vehicle planning? Traditional…

Robotics · Computer Science 2023-08-04 Jingyu Du , Yang Zhao , Hong Cheng

Trajectory forecasting, or trajectory prediction, of multiple interacting agents in dynamic scenes, is an important problem for many applications, such as robotic systems and autonomous driving. The problem is a great challenge because of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yanliang Zhu , Dongchun Ren , Mingyu Fan , Deheng Qian , Xin Li , Huaxia Xia

To drive safely in complex traffic environments, autonomous vehicles need to make an accurate prediction of the future trajectories of nearby heterogeneous traffic agents (i.e., vehicles, pedestrians, bicyclists, etc). Due to the…

Machine Learning · Computer Science 2023-03-31 Zihao Sheng , Zilin Huang , Sikai Chen

In this paper, we address the problem of forecasting the trajectory of an egocentric camera wearer (ego-person) in crowded spaces. The trajectory forecasting ability learned from the data of different camera wearers walking around in the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Jianing Qiu , Lipeng Chen , Xiao Gu , Frank P. -W. Lo , Ya-Yen Tsai , Jiankai Sun , Jiaqi Liu , Benny Lo

One of the most crucial yet challenging tasks for autonomous vehicles in urban environments is predicting the future behaviour of nearby pedestrians, especially at points of crossing. Predicting behaviour depends on many social and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Tiffany Yau , Saber Malekmohammadi , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

In this paper, we present an end-to-end future-prediction model that focuses on pedestrian safety. Specifically, our model uses previous video frames, recorded from the perspective of the vehicle, to predict if a pedestrian will cross in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Mohamed Chaabane , Ameni Trabelsi , Nathaniel Blanchard , Ross Beveridge

An ego vehicle following a virtual lead vehicle planned route is an essential component when autonomous and non-autonomous vehicles interact. Yet, there is a question about the driver's ability to follow the planned lead vehicle route.…

Robotics · Computer Science 2023-04-14 Abduallah Mohamed , Jundi Liu , Linda Ng Boyle , Christian Claudel

We address the challenge of predicting human visual attention during real-world navigation by measuring and modeling egocentric pedestrian eye gaze in an outdoor campus setting. We introduce the EgoCampus dataset, which spans 25 unique…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ronan John , Aditya Kesari , Vincenzo DiMatteo , Kristin Dana

In this work, we aim to achieve efficient end-to-end learning of driving policies in dynamic multi-agent environments. Predicting and anticipating future events at the object level are critical for making informed driving decisions. We…

Robotics · Computer Science 2021-01-18 Jinkun Cao , Xin Wang , Trevor Darrell , Fisher Yu

Trajectory modelling had been the principal research area for understanding and anticipating human behaviour. Predicting the dynamic path by observing the agent and its surrounding environment are essential for applications such as…

Robotics · Computer Science 2020-03-03 Tin Lai , Weiming Zhi , Fabio Ramos

Predicting traffic agents' trajectories is an important task for auto-piloting. Most previous work on trajectory prediction only considers a single class of road agents. We use a sequence-to-sequence model to predict future paths from…

Machine Learning · Computer Science 2021-10-25 Shilun Li , Tracy Cai , Jiayi Li

Motion forecasting plays a crucial role in autonomous driving, with the aim of predicting the future reasonable motions of traffic agents. Most existing methods mainly model the historical interactions between agents and the environment,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Miao Kang , Shengqi Wang , Sanping Zhou , Ke Ye , Jingjing Jiang , Nanning Zheng

Predicting the future motion of traffic agents is crucial for safe and efficient autonomous driving. To this end, we present PredictionNet, a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with…

Accurately predicting how agents move in dynamic scenes is essential for safe autonomous driving. State-of-the-art motion forecasting models rely on datasets with manually annotated or post-processed trajectories. However, building these…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yihong Xu , Yuan Yin , Éloi Zablocki , Tuan-Hung Vu , Alexandre Boulch , Matthieu Cord

Most user-related data can be represented as a sequence of events associated with a timestamp and a collection of categorical labels. For example, the purchased basket of goods and the time of buying fully characterize the event of the…

Machine Learning · Computer Science 2024-10-29 Elizaveta Kovtun , Galina Boeva , Andrey Shulga , Alexey Zaytsev