English
Related papers

Related papers: 3D Skeleton-based Human Motion Prediction with Man…

200 papers

Human motion prediction and understanding is a challenging problem. Due to the complex dynamic of human motion and the non-deterministic aspect of future prediction. We propose a novel sequence-to-sequence model for human motion prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Emad Barsoum , John Kender , Zicheng Liu

Human movement is goal-directed and influenced by the spatial layout of the objects in the scene. To plan future human motion, it is crucial to perceive the environment -- imagine how hard it is to navigate a new room with lights off.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Zhe Cao , Hang Gao , Karttikeya Mangalam , Qi-Zhi Cai , Minh Vo , Jitendra Malik

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

Generative models of 3D human motion are often restricted to a small number of activities and can therefore not generalize well to novel movements or applications. In this work we propose a deep learning framework for human motion capture…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Judith Bütepage , Michael Black , Danica Kragic , Hedvig Kjellström

This work make the first attempt to generate articulated human motion sequence from a single image. On the one hand, we utilize paired inputs including human skeleton information as motion embedding and a single human image as appearance…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Yichao Yan , Jingwei Xu , Bingbing Ni , Xiaokang Yang

Human motion generation involves creating natural sequences of human body poses, widely used in gaming, virtual reality, and human-computer interaction. It aims to produce lifelike virtual characters with realistic movements, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Zhao , Dongdong Weng , Qiuxin Du , Zeyu Tian

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

This paper presents a novel recurrent neural network-based method to construct a latent motion manifold that can represent a wide range of human motions in a long sequence. We introduce several new components to increase the spatial and…

Graphics · Computer Science 2020-06-01 Deok-Kyeong Jang , Sung-Hee Lee

Scene-aware global human motion forecasting is critical for manifold applications, including virtual reality, robotics, and sports. The task combines human trajectory and pose forecasting within the provided scene context, which represents…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Luca Scofano , Alessio Sampieri , Elisabeth Schiele , Edoardo De Matteis , Laura Leal-Taixé , Fabio Galasso

Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architectures. However, the generalizability to different…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Xipeng Chen , Kwan-Yee Lin , Wentao Liu , Chen Qian , Xiaogang Wang , Liang Lin

3D human pose estimation from a single image is still a challenging problem despite the large amount of work that has been performed in this field. Generally, most methods directly use neural networks and ignore certain constraints (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Yicheng Deng , Cheng Sun , Yongqi Sun , Jiahui Zhu

Human motion prediction is crucial for human-centric multimedia understanding and interacting. Current methods typically rely on ground truth human poses as observed input, which is not practical for real-world scenarios where only raw…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Xiao Han , Yiming Ren , Yichen Yao , Yujing Sun , Yuexin Ma

Several applications such as autonomous driving, augmented reality and virtual reality require a precise prediction of the 3D human pose. Recently, a new problem was introduced in the field to predict the 3D human poses from observed 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Abduallah Mohamed , Huancheng Chen , Zhangyang Wang , Christian Claudel

Recent progress in stochastic motion prediction, i.e., predicting multiple possible future human motions given a single past pose sequence, has led to producing truly diverse future motions and even providing control over the motion of some…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Wei Mao , Miaomiao Liu , Mathieu Salzmann

Given a video of a person in action, we can easily guess the 3D future motion of the person. In this work, we present perhaps the first approach for predicting a future 3D mesh model sequence of a person from past video input. We do this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Jason Y. Zhang , Panna Felsen , Angjoo Kanazawa , Jitendra Malik

Human motion prediction is a challenging and important task in many computer vision application domains. Existing work only implicitly models the spatial structure of the human skeleton. In this paper, we propose a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Emre Aksan , Manuel Kaufmann , Otmar Hilliges

We consider the task of estimating 3D human pose and shape from videos. While existing frame-based approaches have made significant progress, these methods are independently applied to each image, thereby often leading to inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Yun-Chun Chen , Marco Piccirilli , Robinson Piramuthu , Ming-Hsuan Yang

Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors that violate physical constraints, such as feet penetrating the ground and bodies leaning at extreme angles. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Davis Rempe , Leonidas J. Guibas , Aaron Hertzmann , Bryan Russell , Ruben Villegas , Jimei Yang

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Yongyi Tang , Lin Ma , Wei Liu , Weishi Zheng

3D human pose estimation involves reconstructing the human skeleton by detecting the body joints. Accurate and efficient solutions are required for several real-world applications including animation, human-robot interaction, surveillance,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ana Filipa Rodrigues Nogueira , Hélder P. Oliveira , Luís F. Teixeira