English
Related papers

Related papers: Multimodal Motion Prediction with Stacked Transfor…

200 papers

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this problem is to use the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Amir Rasouli , Iuliia Kotseruba , John K. Tsotsos

Navigation in dynamic environments requires autonomous systems to reason about uncertainties in the behavior of other agents. In this paper, we introduce a unified framework that combines trajectory planning with multimodal predictions and…

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Predicting future behavior of the surrounding vehicles is crucial for self-driving platforms to safely navigate through other traffic. This is critical when making decisions like crossing an unsignalized intersection. We address the problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Mohamed Hasan , Evangelos Paschalidis , Albert Solernou , He Wang , Gustav Markkula , Richard Romano

Predicting pedestrian behavior is a crucial task for intelligent driving systems. Accurate predictions require a deep understanding of various contextual elements that potentially impact the way pedestrians behave. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Amir Rasouli , Iuliia Kotseruba

It has been challenging to model the complex temporal-spatial dependencies between agents for trajectory prediction. As each state of an agent is closely related to the states of adjacent time steps, capturing the local temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yixin Yan , Yang Li , Yuanfan Wang , Xiaozhou Zhou , Beihao Xia , Manjiang Hu , Hongmao Qin

Accurate motion prediction of surrounding agents is crucial for the safe planning of autonomous vehicles. Recent advancements have extended prediction techniques from individual agents to joint predictions of multiple interacting agents,…

Artificial Intelligence · Computer Science 2025-09-12 Xing Gao , Zherui Huang , Weiyao Lin , Xiao Sun

We propose a Stochastic MPC (SMPC) formulation for path planning with autonomous vehicles in scenarios involving multiple agents with multi-modal predictions. The multi-modal predictions capture the uncertainty of urban driving in distinct…

Robotics · Computer Science 2023-11-01 Siddharth H. Nair , Hotae Lee , Eunhyek Joa , Yan Wang , H. Eric Tseng , Francesco Borrelli

Human motion prediction, which plays a key role in computer vision, generally requires a past motion sequence as input. However, in real applications, a complete and correct past motion sequence can be too expensive to achieve. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chunzhi Gu , Yan Zhao , Chao Zhang

Accurate trajectory prediction is crucial for autonomous driving, yet uncertainty in agent behavior and perception noise makes it inherently challenging. While multi-modal trajectory prediction models generate multiple plausible future…

Robotics · Computer Science 2025-03-10 Sajad Marvi , Christoph Rist , Julian Schmidt , Julian Jordan , Abhinav Valada

Recent years have seen a shift towards learning-based methods for trajectory prediction, with challenges remaining in addressing uncertainty and capturing multi-modal distributions. This paper introduces Temporal Ensembling with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kai-Yin Hong , Chieh-Chih Wang , Wen-Chieh Lin

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Recurrent Neural Network, Long Short-Term Memory, and Transformer have made great progress in predicting the trajectories of moving objects. Although the trajectory element with the surrounding scene features has been merged to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Wendong Zhang , Qingjie Chai , Quanqi Zhang , Chengwei Wu

Beamforming techniques are utilized in millimeter wave (mmWave) communication to address the inherent path loss limitation, thereby establishing and maintaining reliable connections. However, adopting standard defined beamforming approach…

Networking and Internet Architecture · Computer Science 2025-09-16 Muhammad Baqer Mollah , Honggang Wang , Hua Fang

Human mobility prediction is vital for urban planning, transportation optimization, and personalized services. However, the inherent randomness, non-uniform time intervals, and complex patterns of human mobility, compounded by the…

Machine Learning · Computer Science 2025-11-11 Chonghua Han , Yuan Yuan , Yukun Liu , Jingtao Ding , Jie Feng , Yong Li

This paper tackles video prediction from a new dimension of predicting spacetime-varying motions that are incessantly changing across both space and time. Prior methods mainly capture the temporal state transitions but overlook the complex…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Haixu Wu , Zhiyu Yao , Jianmin Wang , Mingsheng Long

Future prediction is a fundamental principle of intelligence that helps plan actions and avoid possible dangers. As the future is uncertain to a large extent, modeling the uncertainty and multimodality of the future states is of great…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Osama Makansi , Eddy Ilg , Özgün Cicek , Thomas Brox

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Predicting turn-taking in multiparty conversations has many practical applications in human-computer/robot interaction. However, the complexity of human communication makes it a challenging task. Recent advances have shown that synchronous…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Mehdi Fatan , Emanuele Mincato , Dimitra Pintzou , Mariella Dimiccoli