English
Related papers

Related papers: An End-to-end Framework for Unconstrained Monocula…

200 papers

Occlusion is one of the challenging issues when estimating 3D hand pose. This problem becomes more prominent when hand interacts with an object or two hands are involved. In the past works, much attention has not been given to these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mallika Garg , Debashis Ghosh , Pyari Mohan Pradhan

3D hand pose estimation is a fundamental task in understanding human hands. However, accurately estimating 3D hand poses remains challenging due to the complex movement of hands, self-similarity, and frequent occlusions. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lee Chae-Yeon , Nam Hyeon-Woo , Tae-Hyun Oh

Estimating 3D hand and object pose from a single image is an extremely challenging problem: hands and objects are often self-occluded during interactions, and the 3D annotations are scarce as even humans cannot directly label the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Shaowei Liu , Hanwen Jiang , Jiarui Xu , Sifei Liu , Xiaolong Wang

Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast/slow relative to the scale and speed of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Cheng Yu , Bo Wang , Bo Yang , Robby T. Tan

Many manipulation tasks, such as placement or within-hand manipulation, require the object's pose relative to a robot hand. The task is difficult when the hand significantly occludes the object. It is especially hard for adaptive hands, for…

Robotics · Computer Science 2021-12-20 Bowen Wen , Chaitanya Mitash , Sruthi Soorian , Andrew Kimmel , Avishai Sintov , Kostas E. Bekris

In this paper, we strive to answer two questions: What is the current state of 3D hand pose estimation from depth images? And, what are the next challenges that need to be tackled? Following the successful Hands In the Million Challenge…

3D hand-object pose estimation is an important issue to understand the interaction between human and environment. Current hand-object pose estimation methods require detailed 3D labels, which are expensive and labor-intensive. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Zida Cheng , Siheng Chen , Ya Zhang

Recently, remarkable advances have been achieved in 3D human pose estimation from monocular images because of the powerful Deep Convolutional Neural Networks (DCNNs). Despite their success on large-scale datasets collected in the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Wei Yang , Wanli Ouyang , Xiaolong Wang , Jimmy Ren , Hongsheng Li , Xiaogang Wang

Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Christian Zimmermann , Duygu Ceylan , Jimei Yang , Bryan Russell , Max Argus , Thomas Brox

Learning and predicting the pose parameters of a 3D hand model given an image, such as locations of hand joints, is challenging due to large viewpoint changes and articulations, and severe self-occlusions exhibited particularly in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Qi Ye , Tae-Kyun Kim

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

We introduce and evaluate several architectures for Convolutional Neural Networks to predict the 3D joint locations of a hand given a depth map. We first show that a prior on the 3D pose can be easily introduced and significantly improves…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

With an enormous number of hand images generated over time, unleashing pose knowledge from unlabeled images for supervised hand mesh estimation is an emerging yet challenging topic. To alleviate this issue, semi-supervised and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zuyan Liu , Gaojie Lin , Congyi Wang , Min Zheng , Feida Zhu

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , Haichao Zhu

3D human pose estimation using monocular images is an important yet challenging task. Existing 3D pose detection methods exhibit excellent performance under normal conditions however their performance may degrade due to occlusion. Recently…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Mehwish Ghafoor , Arif Mahmood

Convolutional Neural Network based approaches for monocular 3D human pose estimation usually require a large amount of training images with 3D pose annotations. While it is feasible to provide 2D joint annotations for large corpora of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Ikhsanul Habibie , Weipeng Xu , Dushyant Mehta , Gerard Pons-Moll , Christian Theobalt

3D hand pose estimation from monocular videos is a long-standing and challenging problem, which is now seeing a strong upturn. In this work, we address it for the first time using a single event camera, i.e., an asynchronous vision sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Viktor Rudnev , Vladislav Golyanik , Jiayi Wang , Hans-Peter Seidel , Franziska Mueller , Mohamed Elgharib , Christian Theobalt

We study how well different types of approaches generalise in the task of 3D hand pose estimation under single hand scenarios and hand-object interaction. We show that the accuracy of state-of-the-art methods can drop, and that they fail…

Contrastive Language-Image Pre-training (CLIP) starts to emerge in many computer vision tasks and has achieved promising performance. However, it remains underexplored whether CLIP can be generalized to 3D hand pose estimation, as bridging…

Multimedia · Computer Science 2023-09-29 Shaoxiang Guo , Qing Cai , Lin Qi , Junyu Dong

We present a self-trainable method, Mask2Hand, which learns to solve the challenging task of predicting 3D hand pose and shape from a 2D binary mask of hand silhouette/shadow without additional manually-annotated data. Given the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Li-Jen Chang , Yu-Cheng Liao , Chia-Hui Lin , Hwann-Tzong Chen