English
Related papers

Related papers: A Spatio-temporal Transformer for 3D Human Motion …

200 papers

3D human motion prediction is a research area of high significance and a challenge in computer vision. It is useful for the design of many applications including robotics and autonomous driving. Traditionally, autogregressive models have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Avinash Ajit Nargund , Misha Sra

Comprehending human motion is a fundamental challenge for developing Human-Robot Collaborative applications. Computer vision researchers have addressed this field by only focusing on reducing error in predictions, but not taking into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Esteve Valls Mascaro , Shuo Ma , Hyemin Ahn , Dongheui Lee

Nowadays, Transformers and Graph Convolutional Networks (GCNs) are the prevailing techniques for 3D human pose estimation. However, Transformer-based methods either ignore the spatial neighborhood relationships between the joints when used…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Kamel Aouaidjia , Aofan Li , Wenhao Zhang , Chongsheng Zhang

Human motion prediction is an increasingly interesting topic in computer vision and robotics. In this paper, we propose a new 2D CNN based network, TrajectoryNet, to predict future poses in the trajectory space. Compared with most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Xiaoli Liu , Jianqin Yin , Jin Liu , Pengxiang Ding , Jun Liu , Huaping Liu

Human motion prediction is a fundamental part of many human-robot applications. Despite the recent progress in human motion prediction, most studies simplify the problem by predicting the human motion relative to a fixed joint and/or only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Payam Nikdel , Mohammad Mahdavian , Mo Chen

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianbin Jiao , Xina Cheng , Weijie Chen , Xiaoting Yin , Hao Shi , Kailun Yang

In this paper, we develop a neural network model to predict future human motion from an observed human motion history. We propose a non-autoregressive transformer architecture to leverage its parallel nature for easier training and fast,…

Robotics · Computer Science 2025-01-20 Mohammad Mahdavian , Payam Nikdel , Mahdi TaherAhmadi , Mo Chen

We address the challenging task of human reaction generation, which aims to generate a corresponding reaction based on an input action. Most of the existing works do not focus on generating and predicting the reaction and cannot generate…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Baptiste Chopin , Hao Tang , Naima Otberdout , Mohamed Daoudi , Nicu Sebe

Spatio-temporal information is key to resolve occlusion and depth ambiguity in 3D pose estimation. Previous methods have focused on either temporal contexts or local-to-global architectures that embed fixed-length spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Junfa Liu , Juan Rojas , Zhijun Liang , Yihui Li , Yisheng Guan

Spatiotemporal predictive learning offers a self-supervised learning paradigm that enables models to learn both spatial and temporal patterns by predicting future sequences based on historical sequences. Mainstream methods are dominated by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xuesong Nie , Xi Chen , Haoyuan Jin , Zhihang Zhu , Yunfeng Yan , Donglian Qi

3D multi-person motion prediction is a highly complex task, primarily due to the dependencies on both individual past movements and the interactions between agents. Moreover, effectively modeling these interactions often incurs substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yuanhong Zheng , Ruixuan Yu , Jian Sun

3D human pose estimation can be handled by encoding the geometric dependencies between the body parts and enforcing the kinematic constraints. Recently, Transformer has been adopted to encode the long-range dependencies between the joints…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Mohammed Hassanin , Abdelwahed Khamiss , Mohammed Bennamoun , Farid Boussaid , Ibrahim Radwan

This project addresses the challenge of human motion prediction, a critical area for applications such as au- tonomous vehicle movement detection. Previous works have emphasized the need for low inference times to provide real time…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Edmund Shieh , Joshua Lee Franco , Kang Min Bae , Tej Lalvani

The current methods of video-based 3D human pose estimation have achieved significant progress.However, they still face pressing challenges, such as the underutilization of spatiotemporal bodystructure features in transformers and the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Yang Liu , Zhiyong Zhang

Human activity intensity prediction is crucial to many location-based services. Despite tremendous progress in modeling dynamics of human activity, most existing methods overlook physical constraints of spatial interaction, leading to…

Machine Learning · Computer Science 2025-10-27 Yi Wang , Zhenghong Wang , Fan Zhang , Chaogui Kang , Sijie Ruan , Di Zhu , Chengling Tang , Zhongfu Ma , Weiyu Zhang , Yu Zheng , Philip S. Yu , Yu Liu

Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background. Nevertheless, an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Chiara Plizzari , Marco Cannici , Matteo Matteucci

This report reviews recent advancements in human motion prediction, reconstruction, and generation. Human motion prediction focuses on forecasting future poses and movements from historical data, addressing challenges like nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Canxuan Gang , Yiran Wang

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constraining both temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Skeleton-based Human Activity Recognition has achieved great interest in recent years as skeleton data has demonstrated being robust to illumination changes, body scales, dynamic camera views, and complex background. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Chiara Plizzari , Marco Cannici , Matteo Matteucci

The primary goal of skeletal motion prediction is to generate future motion by observing a sequence of 3D skeletons. A key challenge in motion prediction is the fact that a motion can often be performed in several different ways, with each…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Junfeng Hu , Zhencheng Fan , Jun Liao , Li Liu
‹ Prev 1 2 3 10 Next ›