English
Related papers

Related papers: Long-Term Human Video Generation of Multiple Futur…

200 papers

Human pose forecasting predicts future poses based on past observations, and has many significant applications in areas such as action recognition, autonomous driving or human-robot interaction. This paper evaluates a wide range of pose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

The creation of plausible and controllable 3D human motion animations is a long-standing problem that requires a manual intervention of skilled artists. Current machine learning approaches can semi-automate the process, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Kacper Kania , Marek Kowalski , Tomasz Trzciński

3D human motion prediction, predicting future poses from a given sequence, is an issue of great significance and challenge in computer vision and machine intelligence, which can help machines in understanding human behaviors. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Kedi Lyu , Haipeng Chen , Zhenguang Liu , Beiqi Zhang , Ruili Wang

Human pose estimation and action recognition are related tasks since both problems are strongly dependent on the human body representation and analysis. Nonetheless, most recent methods in the literature handle the two problems separately.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Diogo C Luvizon , Hedi Tabia , David Picard

Human motion modelling is crucial in many areas such as computer graphics, vision and virtual reality. Acquiring high-quality skeletal motions is difficult due to the need for specialized equipment and laborious manual post-posting, which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Wenheng Chen , He Wang , Yi Yuan , Tianjia Shao , Kun Zhou

Video-based human pose estimation in crowded scenes is a challenging problem due to occlusion, motion blur, scale variation and viewpoint change, etc. Prior approaches always fail to deal with this problem because of (1) lacking of usage of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Li Yuan , Shuning Chang , Xuecheng Nie , Ziyuan Huang , Yichen Zhou , Yunpeng Chen , Jiashi Feng , Shuicheng Yan

We propose a Generative Adversarial Network (GAN) to forecast 3D human motion given a sequence of past 3D skeleton poses. While recent GANs have shown promising results, they can only forecast plausible motion over relatively short periods…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Alejandro Hernandez Ruiz , Juergen Gall , Francesc Moreno-Noguer

3D human motion prediction is a research area of high significance and a challenge in computer vision. It is useful for the design of many applications including robotics and autonomous driving. Traditionally, autogregressive models have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Avinash Ajit Nargund , Misha Sra

Existing video prediction methods mainly rely on observing multiple historical frames or focus on predicting the next one-frame. In this work, we study the problem of generating consecutive multiple future frames by observing one single…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Predicting high dimensional video sequences is a curiously difficult problem. The number of possible futures for a given video sequence grows exponentially over time due to uncertainty. This is especially evident when trying to predict…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Luke Ditria , Tom Drummond

Understanding and predicting dynamics of the physical world can enhance a robot's ability to plan and interact effectively in complex environments. While recent video generation models have shown strong potential in modeling dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zeyi Liu , Shuang Li , Eric Cousineau , Siyuan Feng , Benjamin Burchfiel , Shuran Song

Human motion prediction is consisting in forecasting future body poses from historically observed sequences. It is a longstanding challenge due to motion's complex dynamics and uncertainty. Existing methods focus on building up complicated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhihao Wang , Yulin Zhou , Ningyu Zhang , Xiaosong Yang , Jun Xiao , Zhao Wang

Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors that violate physical constraints, such as feet penetrating the ground and bodies leaning at extreme angles. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Davis Rempe , Leonidas J. Guibas , Aaron Hertzmann , Bryan Russell , Ruben Villegas , Jimei Yang

3D human pose estimation from a monocular image or 2D joints is an ill-posed problem because of depth ambiguity and occluded joints. We argue that 3D human pose estimation from a monocular input is an inverse problem where multiple feasible…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Chen Li , Gim Hee Lee

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu

3D animation of humans in action is quite challenging as it involves using a huge setup with several motion trackers all over the person's body to track the movements of every limb. This is time-consuming and may cause the person discomfort…

Graphics · Computer Science 2020-02-10 Laxman Kumarapu , Prerana Mukherjee

In this paper, we tackle the problem of human motion transfer, where we synthesize novel motion video for a target person that imitates the movement from a reference video. It is a video-to-video translation task in which the estimated…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Jian Ren , Menglei Chai , Sergey Tulyakov , Chen Fang , Xiaohui Shen , Jianchao Yang

We present an approach to predict future video frames given a sequence of continuous video frames in the past. Instead of synthesizing images directly, our approach is designed to understand the complex scene dynamics by decoupling the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Yue Wu , Rongrong Gao , Jaesik Park , Qifeng Chen

We propose a personalized ConvNet pose estimator that automatically adapts itself to the uniqueness of a person's appearance to improve pose estimation in long videos. We make the following contributions: (i) we show that given a few…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 James Charles , Tomas Pfister , Derek Magee , David Hogg , Andrew Zisserman

Long-term activity forecasting is an especially challenging research problem because it requires understanding the temporal relationships between observed actions, as well as the variability and complexity of human activities. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Reuben Tan , Matthias De Lange , Michael Iuzzolino , Bryan A. Plummer , Kate Saenko , Karl Ridgeway , Lorenzo Torresani