English
Related papers

Related papers: Towards Accurate Alignment in Real-time 3D Hand-Me…

200 papers

Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less straightforward for predicting the position of 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yihong Lin , Xianjia Wu , Xilai Wang , Jianqiao Hu , Songju Lei , Xiandong Li , Wenxiong Kang

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

We present an approach that can reconstruct hands in 3D from monocular input. Our approach for Hand Mesh Recovery, HaMeR, follows a fully transformer-based architecture and can analyze hands with significantly increased accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Georgios Pavlakos , Dandan Shan , Ilija Radosavovic , Angjoo Kanazawa , David Fouhey , Jitendra Malik

In this paper, we strive to answer two questions: What is the current state of 3D hand pose estimation from depth images? And, what are the next challenges that need to be tackled? Following the successful Hands In the Million Challenge…

Low-cost consumer depth cameras and deep learning have enabled reasonable 3D hand pose estimation from single depth images. In this paper, we present an approach that estimates 3D hand pose from regular RGB images. This task has far more…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Christian Zimmermann , Thomas Brox

The human hand is the main medium through which we interact with our surroundings, making its digitization an important problem. While there are several works modeling the geometry of hands, little attention has been paid to capturing…

We present 3D Points Splatting Hand Reconstruction (3D-PSHR), a real-time and photo-realistic hand reconstruction approach. We propose a self-adaptive canonical points upsampling strategy to achieve high-resolution hand geometry…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zheheng Jiang , Hossein Rahmani , Sue Black , Bryan M. Williams

3D hand pose estimation from images has seen considerable interest from the literature, with new methods improving overall 3D accuracy. One current challenge is to address hand-to-hand interaction where self-occlusions and finger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

Recent studies on 3D hand reconstruction have demonstrated the effectiveness of synthetic training data to improve estimation performance. However, most methods rely on game engines to synthesize hand images, which often lack diversity in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuoran Zhao , Xianghao Kong , Linlin Yang , Zheng Wei , Pan Hui , Anyi Rao

3D hand pose estimation from RGB images suffers from the difficulty of obtaining the depth information. Therefore, a great deal of attention has been spent on estimating 3D hand pose from 2D hand joints. In this paper, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Tu Le-Xuan , Trung Tran-Quang , Thi Ngoc Hien Doan , Thanh-Hai Tran

Animating realistic character interactions with the surrounding environment is important for autonomous agents in gaming, AR/VR, and robotics. However, current methods for human motion reconstruction struggle with accurately placing humans…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Joshua Li , Brendan Chharawala , Chang Shu , Xue Bin Peng , Pengcheng Xi

Deterministic models for 3D hand pose reconstruction, whether single-staged or cascaded, struggle with pose ambiguities caused by self-occlusions and complex hand articulations. Existing cascaded approaches refine predictions in a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Taeyun Woo , Jinah Park , Tae-Kyun Kim

Recent work achieved impressive progress towards joint reconstruction of hands and manipulated objects from monocular color images. Existing methods focus on two alternative representations in terms of either parametric meshes or signed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Zerui Chen , Yana Hasson , Cordelia Schmid , Ivan Laptev

3D reconstruction serves as the foundational layer for numerous robotic perception tasks, including 6D object pose estimation and grasp pose generation. Modern 3D reconstruction methods for objects can produce visually and geometrically…

Robotics · Computer Science 2026-02-20 Varun Burde , Pavel Burget , Torsten Sattler

Accurately recovering the dense 3D mesh of both hands from monocular images poses considerable challenges due to occlusions and projection ambiguity. Most of the existing methods extract features from color images to estimate the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jinwei Ren , Jianke Zhu

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Yating Tian , Hongwen Zhang , Yebin Liu , Limin Wang

This paper addresses the problem of 3D hand pose estimation from a monocular RGB image. While previous methods have shown great success, the structure of hands has not been fully exploited, which is critical in pose estimation. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Yiming He , Wei Hu

We present a method for recovering the dense 3D surface of the hand by regressing the vertex coordinates of a mesh model from a single depth map. To this end, we use a two-stage 2D fully convolutional network architecture. In the first…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Franziska Mueller , Micah Davis , Florian Bernard , Oleksandr Sotnychenko , Mickeal Verschoor , Miguel A. Otaduy , Dan Casas , Christian Theobalt

3D hand pose estimation has received a lot of attention for its wide range of applications and has made great progress owing to the development of deep learning. Existing approaches mainly consider different input modalities and settings,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Kuo-Wei Lee , Shih-Hung Liu , Hwann-Tzong Chen , Koichi Ito