English
Related papers

Related papers: End-to-end Weakly-supervised Single-stage Multiple…

200 papers

We present a new multi-stream 3D mesh reconstruction network (MSMR-Net) for hand pose estimation from a single RGB image. Our model consists of an image encoder followed by a mesh-convolution decoder composed of connected graph convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Uri Wollner , Guy Ben-Yosef

Reconstructing high-fidelity hand models with intricate textures plays a crucial role in enhancing human-object interaction and advancing real-world applications. Despite the state-of-the-art methods excelling in texture generation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Qijun Gan , Wentong Li , Jinwei Ren , Jianke Zhu

Human hands play a central role in interacting with other people and objects. For realistic replication of such hand motions, high-fidelity hand meshes have to be reconstructed. In this study, we firstly propose DeepHandMesh, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Gyeongsik Moon , Takaaki Shiratori , Kyoung Mu Lee

Reconstructing a 3D hand mesh from a single RGB image is challenging due to complex articulations, self-occlusions, and depth ambiguities. Traditional discriminative methods, which learn a deterministic mapping from a 2D image to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Muhammad Usama Saleem , Ekkasit Pinyoanuntapong , Mayur Jagdishbhai Patel , Hongfei Xue , Ahmed Helmy , Srijan Das , Pu Wang

Estimating the 3D pose of a hand from a 2D image is a well-studied problem and a requirement for several real-life applications such as virtual reality, augmented reality, and hand gesture recognition. Currently, reasonable estimations can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Adriano Fragomeni , Daniele Pannone

Reconstructing interacting hands from a single RGB image is a very challenging task. On the one hand, severe mutual occlusion and similar local appearance between two hands confuse the extraction of visual features, resulting in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Pengfei Ren , Chao Wen , Xiaozheng Zheng , Zhou Xue , Haifeng Sun , Qi Qi , Jingyu Wang , Jianxin Liao

Estimating 3D hand mesh from RGB images is a longstanding track, in which occlusion is one of the most challenging problems. Existing attempts towards this task often fail when the occlusion dominates the image space. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Yinqiao Wang , Hao Xu , Pheng-Ann Heng , Chi-Wing Fu

Reconstructing the hand mesh from one single RGB image is a challenging task because hands are often occluded by other objects. Most previous works attempt to explore more additional information and adopt attention mechanisms for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zixun Jiao , Xihan Wang , Zhaoqiang Xia , Lianhe Shao , Quanli Gao

Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less straightforward for predicting the position of 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yihong Lin , Xianjia Wu , Xilai Wang , Jianqiao Hu , Songju Lei , Xiandong Li , Wenxiong Kang

We present an approach that can reconstruct hands in 3D from monocular input. Our approach for Hand Mesh Recovery, HaMeR, follows a fully transformer-based architecture and can analyze hands with significantly increased accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Georgios Pavlakos , Dandan Shan , Ilija Radosavovic , Angjoo Kanazawa , David Fouhey , Jitendra Malik

The malformed hands in the AI-generated images seriously affect the authenticity of the images. To refine malformed hands, existing depth-based approaches use a hand depth estimator to guide the refinement of malformed hands. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Chen-Bin Feng , Kangdao Liu , Jian Sun , Jiping Jin , Yiguo Jiang , Chi-Man Vong

In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bosang Kim , Jonghyun Kim , Hyotae Lee , Lanying Jin , Jeongwon Ha , Dowoo Kwon , Jungpyo Kim , Wonhyeok Im , KyungMin Jin , Jungho Lee

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , Haichao Zhu

Purpose: Accurate 3D hand pose estimation supports surgical applications such as skill assessment, robot-assisted interventions, and geometry-aware workflow analysis. However, surgical environments pose severe challenges, including intense…

Monocular 3D hand reconstruction is intrinsically a geometric problem, yet RGB appearance features alone often struggle to resolve severe ambiguities caused by self-occlusions and hand-object interactions. While introducing depth can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Weiquan Lin , Yaoqing Hu , Liangchen Dai , Xu Tang , Xingyu Chen

Current parametric models have made notable progress in 3D hand pose and shape estimation. However, due to the fixed hand topology and complex hand poses, current models are hard to generate meshes that are aligned with the image well. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hanhui Li , Xiaojian Lin , Xuan Huang , Zejun Yang , Zhisheng Wang , Xiaodan Liang

In this work, we propose a framework for single-view hand mesh reconstruction, which can simultaneously achieve high reconstruction accuracy, fast inference speed, and temporal coherence. Specifically, for 2D encoding, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Xingyu Chen , Yufeng Liu , Yajiao Dong , Xiong Zhang , Chongyang Ma , Yanmin Xiong , Yuan Zhang , Xiaoyan Guo

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Estimating the 3D hand pose from a monocular RGB image is important but challenging. A solution is training on large-scale RGB hand images with accurate 3D hand keypoint annotations. However, it is too expensive in practice. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhenyu Wu , Duc Hoang , Shih-Yao Lin , Yusheng Xie , Liangjian Chen , Yen-Yu Lin , Zhangyang Wang , Wei Fan

Estimating 3D hand meshes from RGB images robustly is a highly desirable task, made challenging due to the numerous degrees of freedom, and issues such as self similarity and occlusions. Previous methods generally either use parametric 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Michael Seeber , Roi Poranne , Marc Polleyfeys , Martin R. Oswald