English
Related papers

Related papers: Multimodal Motion Prediction with Stacked Transfor…

200 papers

For motion planning and control of autonomous vehicles to be proactive and safe, pedestrians' and other road users' motions must be considered. In this paper, we present a vehicle motion planning and control framework, based on Model…

Systems and Control · Computer Science 2019-03-20 Ivo Batkovic , Mario Zanon , Mohammad Ali , Paolo Falcone

Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict…

Human-Computer Interaction · Computer Science 2022-07-04 Yang Xing , Wenbo Li , Xiaoyu Mo , Chen Lv

Human pose forecasting is a challenging problem involving complex human body motion and posture dynamics. In cases that there are multiple people in the environment, one's motion may also be influenced by the motion and dynamic movements of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Edward Vendrow , Satyajit Kumar , Ehsan Adeli , Hamid Rezatofighi

Millimeter wave (mmWave) communication, utilizing beamforming techniques to address the inherent path loss limitation, is considered as one of the key technologies to support ever increasing high throughput and low latency demands of…

Networking and Internet Architecture · Computer Science 2026-02-17 Muhammad Baqer Mollah , Honggang Wang , Mohammad Ataul Karim , Hua Fang

Pedestrian action prediction is of great significance for many applications such as autonomous driving. However, state-of-the-art methods lack explainability to make trustworthy predictions. In this paper, a novel framework called MulCPred…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yan Feng , Alexander Carballo , Keisuke Fujii , Robin Karlsson , Ming Ding , Kazuya Takeda

This paper proposes an integrated approach for the safe and efficient control of mobile robots in dynamic and uncertain environments. The approach consists of two key steps: one-shot multimodal motion prediction to anticipate motions of…

Robotics · Computer Science 2025-06-05 Ze Zhang , Georg Hess , Junjie Hu , Emmanuel Dean , Lennart Svensson , Knut Åkesson

With the advancements of sensor hardware, traffic infrastructure and deep learning architectures, trajectory prediction of vehicles has established a solid foundation in intelligent transportation systems. However, existing solutions are…

Artificial Intelligence · Computer Science 2024-11-13 Jia Quan Loh , Xuewen Luo , Fan Ding , Hwa Hui Tew , Junn Yong Loo , Ze Yang Ding , Susilawati Susilawati , Chee Pin Tan

Image animation aims to animate a source image by using motion learned from a driving video. Current state-of-the-art methods typically use convolutional neural networks (CNNs) to predict motion information, such as motion keypoints and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Jiale Tao , Biao Wang , Tiezheng Ge , Yuning Jiang , Wen Li , Lixin Duan

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Yongyi Tang , Lin Ma , Wei Liu , Weishi Zheng

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

This paper presents a novel vehicle motion forecasting method based on multi-head attention. It produces joint forecasts for all vehicles on a road scene as sequences of multi-modal probability density functions of their positions. Its…

Machine Learning · Computer Science 2019-12-23 Jean Mercat , Thomas Gilles , Nicole El Zoghby , Guillaume Sandou , Dominique Beauvois , Guillermo Pita Gil

Motion simulation, prediction and planning are foundational tasks in autonomous driving, each essential for modeling and reasoning about dynamic traffic scenarios. While often addressed in isolation due to their differing objectives, such…

Robotics · Computer Science 2026-02-03 Nan Song , Junzhe Jiang , Jingyu Li , Xiatian Zhu , Li Zhang

Trajectory prediction for autonomous driving must continuously reason the motion stochasticity of road agents and comply with scene constraints. Existing methods typically rely on one-stage trajectory prediction models, which condition…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Mengmeng Liu , Hao Cheng , Lin Chen , Hellward Broszio , Jiangtao Li , Runjiang Zhao , Monika Sester , Michael Ying Yang

Trajectory forecasting plays a pivotal role in the field of intelligent vehicles or social robots. Recent works focus on modeling spatial social impacts or temporal motion attentions, but neglect inherent properties of motions, i.e. moving…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Qifan Xue , Shengyi Li , Xuanpeng Li , Jingwen Zhao , Weigong Zhang

Anticipating the multimodality of future events lays the foundation for safe autonomous driving. However, multimodal motion prediction for traffic agents has been clouded by the lack of multimodal ground truth. Existing works predominantly…

Machine Learning · Computer Science 2025-03-25 Zikang Zhou , Hengjian Zhou , Haibo Hu , Zihao Wen , Jianping Wang , Yung-Hui Li , Yu-Kai Huang

To safely and efficiently navigate through complex traffic scenarios, autonomous vehicles need to have the ability to predict the future motion of surrounding vehicles. Multiple interacting agents, the multi-modal nature of driver behavior,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Nachiket Deo , Mohan M. Trivedi

Trajectory prediction modules are key enablers for safe and efficient planning of autonomous vehicles (AVs), particularly in highly interactive traffic scenarios. Recently, learning-based trajectory predictors have experienced considerable…

Robotics · Computer Science 2023-07-06 Sushant Veer , Apoorva Sharma , Marco Pavone

Multimodal demand forecasting aims at predicting product demand utilizing visual, textual, and contextual information. This paper proposes a method for multimodal product demand forecasting using convolutional, graph-based, and…

Machine Learning · Computer Science 2023-07-07 Maarten Sukel , Stevan Rudinac , Marcel Worring

Human intention prediction is a growing area of research where an activity in a video has to be anticipated by a vision-based system. To this end, the model creates a representation of the past, and subsequently, it produces future…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nada Osman , Guglielmo Camporese , Lamberto Ballan

Predicting the future motion of dynamic agents is of paramount importance to ensuring safety and assessing risks in motion planning for autonomous robots. In this study, we propose a two-stage motion prediction method, called R-Pred,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Sehwan Choi , Jungho Kim , Junyong Yun , Jun Won Choi