English
Related papers

Related papers: MobRecon: Mobile-Friendly Hand Mesh Reconstruction…

200 papers

We present a new multi-stream 3D mesh reconstruction network (MSMR-Net) for hand pose estimation from a single RGB image. Our model consists of an image encoder followed by a mesh-convolution decoder composed of connected graph convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Uri Wollner , Guy Ben-Yosef

Hand pose estimation is a fundamental task in many human-robot interaction-related applications. However, previous approaches suffer from unsatisfying hand landmark predictions in real-world scenes and high computation burden. This paper…

Robotics · Computer Science 2021-10-13 Shan An , Xiajie Zhang , Dong Wei , Haogang Zhu , Jianyu Yang , Konstantinos A. Tsintotas

We present an approach that can reconstruct hands in 3D from monocular input. Our approach for Hand Mesh Recovery, HaMeR, follows a fully transformer-based architecture and can analyze hands with significantly increased accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Georgios Pavlakos , Dandan Shan , Ilija Radosavovic , Angjoo Kanazawa , David Fouhey , Jitendra Malik

In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bosang Kim , Jonghyun Kim , Hyotae Lee , Lanying Jin , Jeongwon Ha , Dowoo Kwon , Jungpyo Kim , Wonhyeok Im , KyungMin Jin , Jungho Lee

Recently, 3D hand reconstruction has gained more attention in human-computer cooperation, especially for hand-object interaction scenario. However, it still remains huge challenge due to severe hand-occlusion caused by interaction, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Feng Shuang , Wenbo He , Shaodong Li

Human reconstruction and synthesis from monocular RGB videos is a challenging problem due to clothing, occlusion, texture discontinuities and sharpness, and framespecific pose changes. Many methods employ deferred rendering, NeRFs and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Rohit Jena , Pratik Chaudhari , James Gee , Ganesh Iyer , Siddharth Choudhary , Brandon M. Smith

Existing methods proposed for hand reconstruction tasks usually parameterize a generic 3D hand model or predict hand mesh positions directly. The parametric representations consisting of hand shapes and rotational poses are more stable,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Congyi Wang , Feida Zhu , Shilei Wen

This work introduces a novel and generalizable multi-view Hand Mesh Reconstruction (HMR) model, named POEM, designed for practical use in real-world hand motion capture scenarios. The advances of the POEM model consist of two main aspects.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Lixin Yang , Licheng Zhong , Pengxiang Zhu , Xinyu Zhan , Junxiao Kong , Jian Xu , Cewu Lu

Reconstructing a 3D hand mesh from a single RGB image is challenging due to complex articulations, self-occlusions, and depth ambiguities. Traditional discriminative methods, which learn a deterministic mapping from a 2D image to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Muhammad Usama Saleem , Ekkasit Pinyoanuntapong , Mayur Jagdishbhai Patel , Hongfei Xue , Ahmed Helmy , Srijan Das , Pu Wang

Estimating 3D hand mesh from RGB images is a longstanding track, in which occlusion is one of the most challenging problems. Existing attempts towards this task often fail when the occlusion dominates the image space. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Yinqiao Wang , Hao Xu , Pheng-Ann Heng , Chi-Wing Fu

We introduce a simple and effective network architecture for monocular 3D hand pose estimation consisting of an image encoder followed by a mesh convolutional decoder that is trained through a direct 3D hand mesh reconstruction loss. We…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Dominik Kulon , Riza Alp Güler , Iasonas Kokkinos , Michael Bronstein , Stefanos Zafeiriou

Reconstructing a 3D hand from a single-view RGB image is challenging due to various hand configurations and depth ambiguity. To reliably reconstruct a 3D hand from a monocular image, most state-of-the-art methods heavily rely on 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yujin Chen , Zhigang Tu , Di Kang , Linchao Bao , Ying Zhang , Xuefei Zhe , Ruizhi Chen , Junsong Yuan

High-fidelity hand gesture generation represents a significant challenge in human-centric generation tasks. Existing methods typically employ a single-view mesh-rendered image prior to enhancing gesture generation quality. However, the…

Graphics · Computer Science 2025-08-07 Qifan Fu , Xu Chen , Muhammad Asad , Shanxin Yuan , Changjae Oh , Gregory Slabaugh

Monocular 3D hand reconstruction is intrinsically a geometric problem, yet RGB appearance features alone often struggle to resolve severe ambiguities caused by self-occlusions and hand-object interactions. While introducing depth can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Weiquan Lin , Yaoqing Hu , Liangchen Dai , Xu Tang , Xingyu Chen

Recovering 3D human mesh from monocular images is a popular topic in computer vision and has a wide range of applications. This paper aims to estimate 3D mesh of multiple body parts (e.g., body, hands) with large-scale differences from a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Yu Sun , Qian Bao , Wu Liu , Wenpeng Gao , Yili Fu , Chuang Gan , Tao Mei

Human hands play a central role in interacting with other people and objects. For realistic replication of such hand motions, high-fidelity hand meshes have to be reconstructed. In this study, we firstly propose DeepHandMesh, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Gyeongsik Moon , Takaaki Shiratori , Kyoung Mu Lee

We revisit the role of texture in monocular 3D hand reconstruction, not as an afterthought for photorealism, but as a dense, spatially grounded cue that can actively support pose and shape estimation. Our observation is simple: even in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Giorgos Karvounas , Nikolaos Kyriazis , Iason Oikonomidis , Georgios Pavlakos , Antonis A. Argyros

This paper presents a method to learn hand-object interaction prior for reconstructing a 3D hand-object scene from a single RGB image. The inference as well as training-data generation for 3D hand-object scene reconstruction is challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Hongsuk Choi , Nikhil Chavan-Dafle , Jiacheng Yuan , Volkan Isler , Hyunsoo Park

Reconstructing multi-human body mesh from a single monocular image is an important but challenging computer vision problem. In addition to the individual body mesh models, we need to estimate relative 3D positions among subjects to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Chenyan Wu , Yandong Li , Xianfeng Tang , James Wang

Panoptic 3D reconstruction from a monocular video is a fundamental perceptual task in robotic scene understanding. However, existing efforts suffer from inefficiency in terms of inference speed and accuracy, limiting their practical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Zhen Zhou , Yunkai Ma , Junfeng Fan , Shaolin Zhang , Fengshui Jing , Min Tan