English
Related papers

Related papers: Enhancing Monocular 3D Hand Reconstruction with Le…

200 papers

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulated hand meshes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

Estimating 3D hand meshes from RGB images robustly is a highly desirable task, made challenging due to the numerous degrees of freedom, and issues such as self similarity and occlusions. Previous methods generally either use parametric 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Michael Seeber , Roi Poranne , Marc Polleyfeys , Martin R. Oswald

In recent years, substantial progress has been achieved in learning-based reconstruction of 3D objects. At the same time, generative models were proposed that can generate highly realistic images. However, despite this success in these…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Michael Oechsle , Lars Mescheder , Michael Niemeyer , Thilo Strauss , Andreas Geiger

Model-based approaches to 3D hand tracking have been shown to perform well in a wide range of scenarios. However, they require initialisation and cannot recover easily from tracking failures that occur due to fast hand motions. Data-driven…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Georg Poier , Konstantinos Roditakis , Samuel Schulter , Damien Michel , Horst Bischof , Antonis A. Argyros

Hand pose estimation from a single image has many applications. However, approaches to full 3D body pose estimation are typically trained on day-to-day activities or actions. As such, detailed hand-to-hand interactions are poorly…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

The malformed hands in the AI-generated images seriously affect the authenticity of the images. To refine malformed hands, existing depth-based approaches use a hand depth estimator to guide the refinement of malformed hands. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Chen-Bin Feng , Kangdao Liu , Jian Sun , Jiping Jin , Yiguo Jiang , Chi-Man Vong

Most recent approaches to monocular 3D pose estimation rely on Deep Learning. They either train a Convolutional Neural Network to directly regress from image to 3D pose, which ignores the dependencies between human joints, or model these…

Computer Vision and Pattern Recognition · Computer Science 2016-05-18 Bugra Tekin , Isinsu Katircioglu , Mathieu Salzmann , Vincent Lepetit , Pascal Fua

Our work aims to reconstruct hand-held objects given a single RGB image. In contrast to prior works that typically assume known 3D templates and reduce the problem to 3D pose estimation, our work reconstructs generic hand-held object…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yufei Ye , Abhinav Gupta , Shubham Tulsiani

Thanks to the development of 2D keypoint detectors, monocular 3D human pose estimation (HPE) via 2D-to-3D uplifting approaches have achieved remarkable improvements. Still, monocular 3D HPE is a challenging problem due to the inherent depth…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jeongjun Choi , Dongseok Shim , H. Jin Kim

Hand-object pose estimation from monocular RGB images remains a significant challenge mainly due to the severe occlusions inherent in hand-object interactions. Existing methods do not sufficiently explore global structural perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Hui Yang , Wei Sun , Jian Liu , Jin Zheng , Jian Xiao , Ajmal Mian

We propose a novel diffusion-based framework for reconstructing 3D geometry of hand-held objects from monocular RGB images by leveraging hand-object interaction as geometric guidance. Our method conditions a latent diffusion model on an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ayce Idil Aytekin , Helge Rhodin , Rishabh Dabral , Christian Theobalt

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconstruction and pose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Deniz Beker , Hiroharu Kato , Mihai Adrian Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Human hands play a central role in interacting with other people and objects. For realistic replication of such hand motions, high-fidelity hand meshes have to be reconstructed. In this study, we firstly propose DeepHandMesh, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Gyeongsik Moon , Takaaki Shiratori , Kyoung Mu Lee

The advancement in deep implicit modeling and articulated models has significantly enhanced the process of digitizing human figures in 3D from just a single image. While state-of-the-art methods have greatly improved geometric precision,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Vishnu Mani Hema , Shubhra Aich , Christian Haene , Jean-Charles Bazin , Fernando de la Torre

3D textured shape recovery from partial scans is crucial for many real-world applications. Existing approaches have demonstrated the efficacy of implicit function representation, but they suffer from partial inputs with severe occlusions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Lei Li , Zhizheng Liu , Weining Ren , Liudi Yang , Fangjinhua Wang , Marc Pollefeys , Songyou Peng

Reconstructing 3D hand meshes from monocular RGB images has attracted increasing amount of attention due to its enormous potential applications in the field of AR/VR. Most state-of-the-art methods attempt to tackle this task in an anonymous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Deying Kong , Linguang Zhang , Liangjian Chen , Haoyu Ma , Xiangyi Yan , Shanlin Sun , Xingwei Liu , Kun Han , Xiaohui Xie

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

3D Human Body Reconstruction from a monocular image is an important problem in computer vision with applications in virtual and augmented reality platforms, animation industry, en-commerce domain, etc. While several of the existing works…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Abbhinav Venkat , Chaitanya Patel , Yudhik Agrawal , Avinash Sharma

We present an approach for the reconstruction of textured 3D meshes of human heads from one or few views. Since such few-shot reconstruction is underconstrained, it requires prior knowledge which is hard to impose on traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Egor Burkov , Ruslan Rakhimov , Aleksandr Safin , Evgeny Burnaev , Victor Lempitsky