English
Related papers

Related papers: Best Practices for 2-Body Pose Forecasting

200 papers

Monocular 3D human pose estimation technologies have the potential to greatly increase the availability of human movement data. The best-performing models for single-image 2D-3D lifting use graph convolutional networks (GCNs) that typically…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Sebastian Lutz , Richard Blythman , Koustav Ghosal , Matthew Moynihan , Ciaran Simms , Aljosa Smolic

We present the first single-network approach for 2D~whole-body pose estimation, which entails simultaneous localization of body, face, hands, and feet keypoints. Due to the bottom-up formulation, our method maintains constant real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Gines Hidalgo , Yaadhav Raaj , Haroon Idrees , Donglai Xiang , Hanbyul Joo , Tomas Simon , Yaser Sheikh

This paper presents a high-quality human motion prediction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good initial guess of the future poses is very helpful in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tiezheng Ma , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

Accurate whole-body multi-person pose estimation and tracking is an important yet challenging topic in computer vision. To capture the subtle actions of humans for complex behavior analysis, whole-body pose estimation including the face,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Hao-Shu Fang , Jiefeng Li , Hongyang Tang , Chao Xu , Haoyi Zhu , Yuliang Xiu , Yong-Lu Li , Cewu Lu

Human pose estimation aims at localizing human anatomical keypoints or body parts in the input data (e.g., images, videos, or signals). It forms a crucial component in enabling machines to have an insightful understanding of the behaviors…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Haoming Chen , Runyang Feng , Sifan Wu , Hao Xu , Fengcheng Zhou , Zhenguang Liu

We propose a novel framework for multi-person 3D motion trajectory prediction. Our key observation is that a human's action and behaviors may highly depend on the other persons around. Thus, instead of predicting each human pose trajectory…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Jiashun Wang , Huazhe Xu , Medhini Narasimhan , Xiaolong Wang

Human pose analysis has garnered significant attention within both the research community and practical applications, owing to its expanding array of uses, including gaming, video surveillance, sports performance analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Lijuan Zhou , Xiang Meng , Zhihuan Liu , Mengqi Wu , Zhimin Gao , Pichao Wang

This paper presents the first study on forecasting human dynamics from static images. The problem is to input a single RGB image and generate a sequence of upcoming human body poses in 3D. To address the problem, we propose the 3D Pose…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Yu-Wei Chao , Jimei Yang , Brian Price , Scott Cohen , Jia Deng

Human behavior forecasting during human-human interactions is of utmost importance to provide robotic or virtual agents with social intelligence. This problem is especially challenging for scenarios that are highly driven by interpersonal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 German Barquero , Johnny Núñez , Zhen Xu , Sergio Escalera , Wei-Wei Tu , Isabelle Guyon , Cristina Palmero

We propose a new self-supervised method for predicting 3D human body pose from a single image. The prediction network is trained from a dataset of unlabelled images depicting people in typical poses and a set of unpaired 2D poses. By…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Jose Sosa , David Hogg

Human pose forecasting is an important problem in computer vision with applications to human-robot interaction, visual surveillance, and autonomous driving. Usually, forecasting algorithms use 3D skeleton sequences and are trained to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Sam Toyer , Anoop Cherian , Tengda Han , Stephen Gould

We present GazeMotion, a novel method for human motion forecasting that combines information on past human poses with human eye gaze. Inspired by evidence from behavioural sciences showing that human eye and body movements are closely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Zhiming Hu , Syn Schmitt , Daniel Haeufle , Andreas Bulling

We present a generative approach to forecast long-term future human behavior in 3D, requiring only weak supervision from readily available 2D human action data. This is a fundamental task enabling many downstream applications. The required…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Christian Diller , Thomas Funkhouser , Angela Dai

Human action-anticipation methods predict what is the future action by observing only a few portion of an action in progress. This is critical for applications where computers have to react to human actions as early as possible such as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Cristian Rodriguez , Basura Fernando , Hongdong Li

In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistency between the human…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wei Mao , Miaomiao Liu , Richard Hartley , Mathieu Salzmann

Pushing back the frontiers of collaborative robots in industrial environments, we propose a new Separable-Sparse Graph Convolutional Network (SeS-GCN) for pose forecasting. For the first time, SeS-GCN bottlenecks the interaction of the…

This paper considers to jointly tackle the highly correlated tasks of estimating 3D human body poses and predicting future 3D motions from RGB image sequences. Based on Lie algebra pose representation, a novel self-projection mechanism is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ji Yang , Youdong Ma , Xinxin Zuo , Sen Wang , Minglun Gong , Li Cheng

We tackle the problem of Human Locomotion Forecasting, a task for jointly predicting the spatial positions of several keypoints on the human body in the near future under an egocentric setting. In contrast to the previous work that aims to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Karttikeya Mangalam , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Sena Kiciroglu , Wei Wang , Mathieu Salzmann , Pascal Fua

Estimating human pose, classifying actions, and predicting movement progress are essential for human-robot interaction. While vision-based methods suffer from occlusion and privacy concerns in realistic environments, tactile sensing avoids…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Isaac Han , Seoyoung Lee , Sangyeon Park , Ecehan Akan , Yiyue Luo , Joseph DelPreto , Kyung-Joong Kim