English
Related papers

Related papers: Multimodal Motion Prediction with Stacked Transfor…

200 papers

Accurate Traffic Prediction is a challenging task in intelligent transportation due to the spatial-temporal aspects of road networks. The traffic of a road network can be affected by long-distance or long-term dependencies where existing…

Machine Learning · Computer Science 2024-04-10 Zhengyang Zhao , Haitao Yuan , Nan Jiang , Minxiao Chen , Ning Liu , Zengxiang Li

Nowadays, a number of grasping algorithms have been proposed, that can predict a candidate of grasp poses, even for unseen objects. This enables a robotic manipulator to pick-and-place such objects. However, some of the predicted grasp…

Robotics · Computer Science 2023-09-28 Jiaming Hu , Zhao Tang , Henrik I. Christensen

A critical aspect of safe and efficient motion planning for autonomous vehicles (AVs) is to handle the complex and uncertain behavior of surrounding human-driven vehicles (HDVs). Despite intensive research on driver behavior prediction,…

Robotics · Computer Science 2024-11-05 Jinhao Liang , Chaopeng Tan , Longhao Yan , Jingyuan Zhou , Guodong Yin , Kaidi Yang

In recent years, the field of autonomous driving has attracted increasingly significant public interest. Accurately forecasting the future behavior of various traffic participants is essential for the decision-making of Autonomous Vehicles…

Robotics · Computer Science 2025-02-14 Jianxin Shi , Jinhao Chen , Yuandong Wang , Li Sun , Chunyang Liu , Wei Xiong , Tianyu Wo

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren

We present JointMotion, a self-supervised pre-training method for joint motion prediction in self-driving vehicles. Our method jointly optimizes a scene-level objective connecting motion and environments, and an instance-level objective to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Royden Wagner , Omer Sahin Tas , Marvin Klemp , Carlos Fernandez

This paper proposes the Transition Motion Tensor, a data-driven framework that creates novel and physically accurate transitions outside of the motion dataset. It enables simulated characters to adopt new motion skills efficiently and…

Robotics · Computer Science 2021-12-01 Jonathan Hans Soeseno , Ying-Sheng Luo , Trista Pei-Chun Chen , Wei-Chao Chen

Autonomous driving is an emerging technology that has advanced rapidly over the last decade. Modern transportation is expected to benefit greatly from a wise decision-making framework of autonomous vehicles, including the improvement of…

Artificial Intelligence · Computer Science 2023-12-20 Yuyang Xia , Shuncheng Liu , Quanlin Yu , Liwei Deng , You Zhang , Han Su , Kai Zheng

Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Song , Bozhou Zhang , Xiatian Zhu , Li Zhang

In this paper, we tackle the challenge of predicting stock movements in financial markets by introducing Higher Order Transformers, a novel architecture designed for processing multivariate time-series data. We extend the self-attention…

Machine Learning · Computer Science 2024-12-17 Soroush Omranpour , Guillaume Rabusseau , Reihaneh Rabbany

Transformer-based architectures have shown remarkable performance in vision and language tasks but pose unique challenges for safety-critical applications. This paper presents a conceptual framework for integrating Transformers into…

Software Engineering · Computer Science 2026-01-28 Sven Kirchner , Nils Purschke , Chengdong Wu , Alois Knoll

In this paper, we present a motion planning framework for multi-modal vehicle dynamics. Our proposed algorithm employs transcription of the optimization objective function, vehicle dynamics, and state and control constraints into sparse…

Robotics · Computer Science 2021-07-07 L. Lao Beyer , N. Balabanska , E. Tal , S. Karaman

Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception…

Enabling resilient autonomous motion planning requires robust predictions of surrounding road users' future behavior. In response to this need and the associated challenges, we introduce our model titled MTP-GO. The model encodes the scene…

Robotics · Computer Science 2023-12-12 Theodor Westny , Joel Oskarsson , Björn Olofsson , Erik Frisk

Human motion prediction is an essential component for enabling closer human-robot collaboration. The task of accurately predicting human motion is non-trivial. It is compounded by the variability of human motion, both at a skeletal level…

Robotics · Computer Science 2021-07-02 Mohammad Samin Yasar , Tariq Iqbal

Traditional online Model Predictive Control (MPC) methods often suffer from excessive computational complexity, limiting their practical deployment. Explicit MPC mitigates online computational load by pre-computing control policies offline;…

Robotics · Computer Science 2025-09-10 Sichao Wu , Jiang Wu , Xingyu Cao , Fawang Zhang , Guangyuan Yu , Junjie Zhao , Yue Qu , Fei Ma , Jingliang Duan

Predicting future motion trajectories is a critical capability across domains such as robotics, autonomous systems, and human activity forecasting, enabling safer and more intelligent decision-making. This paper proposes a novel, efficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zesen Zhong , Duomin Zhang , Yijia Li

Multimodal learning is a framework for building models that make predictions based on different types of modalities. Important challenges in multimodal learning are the inference of shared representations from arbitrary modalities and…

Machine Learning · Computer Science 2022-07-06 Masahiro Suzuki , Yutaka Matsuo

Human behavior has the nature of indeterminacy, which requires the pedestrian trajectory prediction system to model the multi-modality of future motion states. Unlike existing stochastic trajectory prediction methods which usually use a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Tianpei Gu , Guangyi Chen , Junlong Li , Chunze Lin , Yongming Rao , Jie Zhou , Jiwen Lu