English
Related papers

Related papers: Towards Accurate Alignment in Real-time 3D Hand-Me…

200 papers

Recently, 3D hand reconstruction has gained more attention in human-computer cooperation, especially for hand-object interaction scenario. However, it still remains huge challenge due to severe hand-occlusion caused by interaction, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Feng Shuang , Wenbo He , Shaodong Li

Reconstructing a high-precision and high-fidelity 3D human hand from a color image plays a central role in replicating a realistic virtual hand in human-computer interaction and virtual reality applications. The results of current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Ping Chen , Yujin Chen , Dong Yang , Fangyin Wu , Qin Li , Qingpei Xia , Yong Tan

Estimating 3D poses and shapes in the form of meshes from monocular RGB images is challenging. Obviously, it is more difficult than estimating 3D poses only in the form of skeletons or heatmaps. When interacting persons are involved, the 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Junuk Cha , Muhammad Saqlain , GeonU Kim , Mingyu Shin , Seungryul Baek

Whole-body 3D human mesh estimation aims to reconstruct the 3D human body, hands, and face simultaneously. Although several methods have been proposed, accurate prediction of 3D hands, which consist of 3D wrist and fingers, still remains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Gyeongsik Moon , Hongsuk Choi , Kyoung Mu Lee

Purpose: Accurate 3D hand pose estimation supports surgical applications such as skill assessment, robot-assisted interventions, and geometry-aware workflow analysis. However, surgical environments pose severe challenges, including intense…

Reconstructing 3D hand meshes from monocular RGB images has attracted increasing amount of attention due to its enormous potential applications in the field of AR/VR. Most state-of-the-art methods attempt to tackle this task in an anonymous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Deying Kong , Linguang Zhang , Liangjian Chen , Haoyu Ma , Xiangyi Yan , Shanlin Sun , Xingwei Liu , Kun Han , Xiaohui Xie

Current parametric models have made notable progress in 3D hand pose and shape estimation. However, due to the fixed hand topology and complex hand poses, current models are hard to generate meshes that are aligned with the image well. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hanhui Li , Xiaojian Lin , Xuan Huang , Zejun Yang , Zhisheng Wang , Xiaodan Liang

Estimating 3D hand poses from a single RGB image is challenging because depth ambiguity leads the problem ill-posed. Training hand pose estimators with 3D hand mesh annotations and multi-view images often results in significant performance…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Yen-Yu Lin , Xiaohui Xie

3D meshes are a fundamental representation widely used in computer science and engineering. In robotics, they are particularly valuable because they capture objects in a form that aligns directly with how robots interact with the physical…

Robotics · Computer Science 2026-01-01 Qian Wang , Omar Abdellall , Tony Gao , Xiatao Sun , Daniel Rakita

This work addresses hand mesh recovery from a single RGB image. In contrast to most of the existing approaches where the parametric hand models are employed as the prior, we show that the hand mesh can be learned directly from the input…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Akila Pemasiri , Kien Nguyen Thanh , Sridha Sridharan , Clinton Fookes

Recent advances have enabled 3d object reconstruction approaches using a single off-the-shelf RGB-D camera. Although these approaches are successful for a wide range of object classes, they rely on stable and distinctive geometric or…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Dimitrios Tzionas , Juergen Gall

Accurate 3D reconstruction of hands and instruments is critical for vision-based analysis of ophthalmic microsurgery, yet progress has been hampered by the lack of realistic, large-scale datasets and reliable annotation tools. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Ming Hu , Zhengdi Yu , Feilong Tang , Kaiwen Chen , Yulong Li , Imran Razzak , Junjun He , Tolga Birdal , Kaijing Zhou , Zongyuan Ge

Reconstructing a 3D hand mesh from a single RGB image is challenging due to complex articulations, self-occlusions, and depth ambiguities. Traditional discriminative methods, which learn a deterministic mapping from a 2D image to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Muhammad Usama Saleem , Ekkasit Pinyoanuntapong , Mayur Jagdishbhai Patel , Hongfei Xue , Ahmed Helmy , Srijan Das , Pu Wang

Direct mesh fitting for 3D hand shape reconstruction is highly accurate. However, the reconstructed meshes are prone to artifacts and do not appear as plausible hand shapes. Conversely, parametric models like MANO ensure plausible hand…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Ziwei Yu , Chen Li , Linlin Yang , Xiaoxu Zheng , Michael Bi Mi , Gim Hee Lee , Angela Yao

We propose a novel framework for 3D hand shape reconstruction and hand-object grasp optimization from a single RGB image. The representation of hand-object contact regions is critical for accurate reconstructions. Instead of approximating…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ziwei Yu , Linlin Yang , You Xie , Ping Chen , Angela Yao

With the rapid advancement of technologies such as virtual reality, augmented reality, and gesture control, users expect interactions with computer interfaces to be more natural and intuitive. Existing visual algorithms often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Haonan Li , Patrick P. K. Chen , Yitong Zhou

Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign language…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiayi Wang , Franziska Mueller , Florian Bernard , Suzanne Sorli , Oleksandr Sotnychenko , Neng Qian , Miguel A. Otaduy , Dan Casas , Christian Theobalt

Monocular 3D reconstruction of deformable objects, such as human body parts, has been typically approached by predicting parameters of heavyweight linear models. In this paper, we demonstrate an alternative solution that is based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dominik Kulon , Haoyang Wang , Riza Alp Güler , Michael Bronstein , Stefanos Zafeiriou

Reliable hand mesh reconstruction (HMR) from commonly-used color and depth sensors is challenging especially under scenarios with varied illuminations and fast motions. Event camera is a highly promising alternative for its high dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jianping Jiang , Xinyu Zhou , Bingxuan Wang , Xiaoming Deng , Chao Xu , Boxin Shi

This paper presents a simple yet powerful method for 3D human mesh reconstruction from a single RGB image. Most recently, the non-local interactions of the whole mesh vertices have been effectively estimated in the transformer while the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Jeonghwan Kim , Mi-Gyeong Gwon , Hyunwoo Park , Hyukmin Kwon , Gi-Mun Um , Wonjun Kim