English
Related papers

Related papers: HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruc…

200 papers

Reconstructing a 3D hand from a single-view RGB image is challenging due to various hand configurations and depth ambiguity. To reliably reconstruct a 3D hand from a monocular image, most state-of-the-art methods heavily rely on 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yujin Chen , Zhigang Tu , Di Kang , Linchao Bao , Ying Zhang , Xuefei Zhe , Ruizhi Chen , Junsong Yuan

We present an approach for 3D global human mesh recovery from monocular videos recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions and tracks human bodies even when they go outside the camera's field of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ye Yuan , Umar Iqbal , Pavlo Molchanov , Kris Kitani , Jan Kautz

Hand pose estimation from monocular depth images has been an important and challenging problem in the Computer Vision community. In this paper, we present a novel approach to estimate 3D hand joint locations from 2D depth images. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Rohan Lekhwani , Bhupendra Singh

This work addresses the challenging problem of unconstrained 3D hand pose estimation using monocular RGB images. Most of the existing approaches assume some prior knowledge of hand (such as hand locations and side information) is available…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Sanjeev Sharma , Shaoli Huang , Dacheng Tao

We present a method for reconstructing accurate and consistent 3D hands from a monocular video. We observe that detected 2D hand keypoints and the image texture provide important cues about the geometry and texture of the 3D hand, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhigang Tu , Zhisheng Huang , Yujin Chen , Di Kang , Linchao Bao , Bisheng Yang , Junsong Yuan

We present an approach that can reconstruct hands in 3D from monocular input. Our approach for Hand Mesh Recovery, HaMeR, follows a fully transformer-based architecture and can analyze hands with significantly increased accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Georgios Pavlakos , Dandan Shan , Ilija Radosavovic , Angjoo Kanazawa , David Fouhey , Jitendra Malik

Reconstructing two hands from monocular RGB images is challenging due to frequent occlusion and mutual confusion. Existing methods mainly learn an entangled representation to encode two interacting hands, which are incredibly fragile to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Zhengdi Yu , Shaoli Huang , Chen Fang , Toby P. Breckon , Jue Wang

In this paper, we introduce OmniHands, a universal approach to recovering interactive hand meshes and their relative movement from monocular or multi-view inputs. Our approach addresses two major limitations of previous methods: lacking a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Dixuan Lin , Yuxiang Zhang , Mengcheng Li , Wei Jing , Qi Yan , Qianying Wang , Yebin Liu , Hongwen Zhang

We present a method for recovering the dense 3D surface of the hand by regressing the vertex coordinates of a mesh model from a single depth map. To this end, we use a two-stage 2D fully convolutional network architecture. In the first…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

In this paper, we aim to reconstruct a full 3D human shape from a single image. Previous vertex-level and parameter regression approaches reconstruct 3D human shape based on a pre-defined adjacency matrix to encode positive relations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shihao Zhou , Mengxi Jiang , Shanshan Cai , Yunqi Lei

Whole-body mesh recovery aims to estimate the 3D human body, face, and hands parameters from a single image. It is challenging to perform this task with a single network due to resolution issues, i.e., the face and hands are usually located…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Jing Lin , Ailing Zeng , Haoqian Wang , Lei Zhang , Yu Li

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

Although significant progress has been achieved on monocular maker-less human motion capture in recent years, it is still hard for state-of-the-art methods to obtain satisfactory results in occlusion scenarios. There are two main reasons:…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Buzhen Huang , Yuan Shu , Jingyi Ju , Yangang Wang

The proliferation of commercial egocentric devices offers a unique lens into human behavior, yet reconstructing full-body 3D motion remains difficult due to frequent self-occlusion and the 'out-of-sight' nature of the wearer's limbs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Kyungwon Cho , Hanbyul Joo

Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less straightforward for predicting the position of 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yihong Lin , Xianjia Wu , Xilai Wang , Jianqiao Hu , Songju Lei , Xiandong Li , Wenxiong Kang

Reconstructing multi-human body mesh from a single monocular image is an important but challenging computer vision problem. In addition to the individual body mesh models, we need to estimate relative 3D positions among subjects to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Chenyan Wu , Yandong Li , Xianfeng Tang , James Wang

Graph convolutional network (GCN) has achieved great success in single hand reconstruction task, while interacting two-hand reconstruction by GCN remains unexplored. In this paper, we present Interacting Attention Graph Hand (IntagHand),…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Mengcheng Li , Liang An , Hongwen Zhang , Lianpeng Wu , Feng Chen , Tao Yu , Yebin Liu

For Embodied AI, jointly reconstructing dynamic hands and the dense scene context is crucial for understanding physical interaction. However, most existing methods recover isolated hands in local coordinates, overlooking the surrounding 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Wendi Hu , Haonan Zhou , Wenhao Hu , Gaoang Wang

Egocentric human mesh recovery (HMR) from monocular head-mounted cameras is increasingly important for AR/VR applications, but remains challenging due to the lack of reliable ground-truth (GT) annotations based on parametric human body…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Soyeon Na , Seung Young Noh , Ju Yong Chang

This work addresses a novel and challenging problem of estimating the full 3D hand shape and pose from a single RGB image. Most current methods in 3D hand analysis from monocular RGB images only focus on estimating the 3D locations of hand…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang , Jianfei Cai , Junsong Yuan