English
Related papers

Related papers: Monocular Real-time Hand Shape and Motion Capture …

200 papers

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Yating Tian , Hongwen Zhang , Yebin Liu , Limin Wang

Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors that violate physical constraints, such as feet penetrating the ground and bodies leaning at extreme angles. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Davis Rempe , Leonidas J. Guibas , Aaron Hertzmann , Bryan Russell , Ruben Villegas , Jimei Yang

Learning and predicting the pose parameters of a 3D hand model given an image, such as locations of hand joints, is challenging due to large viewpoint changes and articulations, and severe self-occlusions exhibited particularly in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Qi Ye , Tae-Kyun Kim

Estimation of the human pose from a monocular camera has been an emerging research topic in the computer vision community with many applications. Recently, benefited from the deep learning technologies, a significant amount of research…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Wu Liu , Qian Bao , Yu Sun , Tao Mei

We present an interactive core training system for core training using a monocular camera image as input in this paper. It is commonly expensive to capture human pose using depth cameras or multiple cameras with conventional approaches. To…

Human-Computer Interaction · Computer Science 2021-06-18 Haoran Xie , Atsushi Watatani , Kazunori Miyata

3D human motion capture from monocular RGB images respecting interactions of a subject with complex and possibly deformable environments is a very challenging, ill-posed and under-explored problem. Existing methods address it only weakly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Zhi Li , Soshi Shimada , Bernt Schiele , Christian Theobalt , Vladislav Golyanik

We propose a new self-supervised method for predicting 3D human body pose from a single image. The prediction network is trained from a dataset of unlabelled images depicting people in typical poses and a set of unpaired 2D poses. By…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Jose Sosa , David Hogg

We present the first approach to volumetric performance capture and novel-view rendering at real-time speed from monocular video, eliminating the need for expensive multi-view systems or cumbersome pre-acquisition of a personalized template…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Ruilong Li , Yuliang Xiu , Shunsuke Saito , Zeng Huang , Kyle Olszewski , Hao Li

We present a deep learning method for end-to-end monocular 3D object detection and metric shape retrieval. We propose a novel loss formulation by lifting 2D detection, orientation, and scale estimation into 3D space. Instead of optimizing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Fabian Manhardt , Wadim Kehl , Adrien Gaidon

We present the first real-time method to capture the full global 3D skeletal pose of a human in a stable, temporally consistent manner using a single RGB camera. Our method combines a new convolutional neural network (CNN) based pose…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Dushyant Mehta , Srinath Sridhar , Oleksandr Sotnychenko , Helge Rhodin , Mohammad Shafiei , Hans-Peter Seidel , Weipeng Xu , Dan Casas , Christian Theobalt

Estimating 3D from 2D is one of the central tasks in computer vision. In this work, we consider the monocular setting, i.e. single-view input, for 3D human pose estimation (HPE). Here, the task is to predict a 3D point set of human skeletal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pavlo Melnyk , Cuong Le , Urs Waldmann , Per-Erik Forssén , Bastian Wandt

The detection of 3D objects through a single perspective camera is a challenging issue. The anchor-free and keypoint-based models receive increasing attention recently due to their effectiveness and simplicity. However, most of these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Chen , Jie Zhao , Wan-Lei Zhao , Song-Yuan Wu

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Monocular estimation of three dimensional human self-contact is fundamental for detailed scene analysis including body language understanding and behaviour modeling. Existing 3d reconstruction methods do not focus on body regions in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Mihai Fieraru , Mihai Zanfir , Elisabeta Oneata , Alin-Ionut Popa , Vlad Olaru , Cristian Sminchisescu

In this paper, we propose a novel structure-aware 3D hourglass network for hand pose estimation from a single depth image, which achieves state-of-the-art results on MSRA and NYU datasets. Compared to existing works that perform…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Fuyang Huang , Ailing Zeng , Minhao Liu , Jing Qin , Qiang Xu

We consider the task of estimating 3D human pose and shape from videos. While existing frame-based approaches have made significant progress, these methods are independently applied to each image, thereby often leading to inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Yun-Chun Chen , Marco Piccirilli , Robinson Piramuthu , Ming-Hsuan Yang

We present a unified framework for understanding 3D hand and object interactions in raw image sequences from egocentric RGB cameras. Given a single RGB image, our model jointly estimates the 3D hand and object poses, models their…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Bugra Tekin , Federica Bogo , Marc Pollefeys

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

This paper proposes a new lightweight Transformer-based lifter that maps short sequences of human 2D joint positions to 3D poses using a single camera. The proposed model takes as input geometric priors including segment lengths and camera…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Mohamed Adjel , Vincent Bonnet

Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast/slow relative to the scale and speed of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Cheng Yu , Bo Wang , Bo Yang , Robby T. Tan