English
Related papers

Related papers: MSTFormer: Motion Inspired Spatial-temporal Transf…

200 papers

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constraining both temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Accurate vessel trajectory prediction facilitates improved navigational safety, routing, and environmental protection. However, existing prediction methods are challenged by the irregular sampling time intervals of the vessel tracking data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Haomin Yu , Tianyi Li , Kristian Torp , Christian S. Jensen

Effective trajectory generation is essential for reliable on-board spacecraft autonomy. Among other approaches, learning-based warm-starting represents an appealing paradigm for solving the trajectory generation problem, effectively…

Traffic flow forecasting is essential and challenging to intelligent city management and public safety. Recent studies have shown the potential of convolution-free Transformer approach to extract the dynamic dependencies among complex…

Physics and Society · Physics 2021-11-08 Xiao Yan , Xianghua Gan , Jingjing Tang , Rui Wang

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Multi-person motion prediction remains a challenging problem, especially in the joint representation learning of individual motion and social interactions. Most prior methods only involve learning local pose dynamics for individual motion…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Xiaogang Peng , Yaodi Shen , Haoran Wang , Binling Nie , Yigang Wang , Zizhao Wu

Accurate traffic flow prediction is essential for applications like transport logistics but remains challenging due to complex spatio-temporal correlations and non-linear traffic patterns. Existing methods often model spatial and temporal…

Machine Learning · Computer Science 2025-03-18 Jing Chen , Haocheng Ye , Zhian Ying , Yuntao Sun , Wenqiang Xu

As a core technology of Intelligent Transportation System, traffic flow prediction has a wide range of applications. The fundamental challenge in traffic flow prediction is to effectively model the complex spatial-temporal dependencies in…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Chengkai Han , Wayne Xin Zhao , Jingyuan Wang

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

3D multi-object tracking (MOT) is vital for many applications including autonomous driving vehicles and service robots. With the commonly used tracking-by-detection paradigm, 3D MOT has made important progress in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xuesong Chen , Shaoshuai Shi , Chao Zhang , Benjin Zhu , Qiang Wang , Ka Chun Cheung , Simon See , Hongsheng Li

Bipedal robots have advantages in maneuvering human-centered environments, but face greater failure risk compared to other stable mobile platforms such as wheeled or quadrupedal robots. While learning-based traversability has been widely…

Robotics · Computer Science 2025-12-08 Ziwon Yoon , Lawrence Y. Zhu , Jingxi Lu , Lu Gan , Ye Zhao

Anticipating the motion of other road users is crucial for automated driving systems (ADS), as it enables safe and informed downstream decision-making and motion planning. Unfortunately, contemporary learning-based approaches for motion…

Machine Learning · Computer Science 2023-09-21 MReza Alipour Sormoli , Amir Samadi , Sajjad Mozaffari , Konstantinos Koufos , Mehrdad Dianati , Roger Woodman

Accurate prediction of future agent trajectories is a critical challenge for ensuring safe and efficient autonomous navigation, particularly in complex urban environments characterized by multiple plausible future scenarios. In this paper,…

Robotics · Computer Science 2025-07-29 Haichuan Li , Tomi Westerlund

Understanding dynamics from visual observations is a challenging problem that requires disentangling individual objects from the scene and learning their interactions. While recent object-centric models can successfully decompose a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Ziyi Wu , Nikita Dvornik , Klaus Greff , Thomas Kipf , Animesh Garg

Trajectory prediction is one of the key capabilities for robots to safely navigate and interact with pedestrians. Critical insights from human intention and behavioral patterns need to be integrated to effectively forecast long-term…

Robotics · Computer Science 2021-06-22 Zhe Huang , Aamir Hasan , Kazuki Shin , Ruohua Li , Katherine Driggs-Campbell

Predicting the motion of a driver's vehicle is crucial for advanced driving systems, enabling detection of potential risks towards shared control between the driver and automation systems. In this paper, we propose a variational neural…

Robotics · Computer Science 2019-03-07 Xin Huang , Stephen McGill , Brian C. Williams , Luke Fletcher , Guy Rosman

It has been challenging to model the complex temporal-spatial dependencies between agents for trajectory prediction. As each state of an agent is closely related to the states of adjacent time steps, capturing the local temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yixin Yan , Yang Li , Yuanfan Wang , Xiaozhou Zhou , Beihao Xia , Manjiang Hu , Hongmao Qin

A multi-modal framework to generate user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual…

Robotics · Computer Science 2022-03-17 Kavindie Katuwandeniya , Stefan H. Kiss , Lei Shi , Jaime Valls Miro

Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Yao Liu , Binghao Li , Xianzhi Wang , Claude Sammut , Lina Yao

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

Computation and Language · Computer Science 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata