English
Related papers

Related papers: Weakly-Supervised Mesh-Convolutional Hand Reconstr…

200 papers

This paper presents an approach that reconstructs a hand-held object from a monocular video. In contrast to many recent methods that directly predict object geometry by a trained network, the proposed approach does not require any learned…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Di Huang , Xiaopeng Ji , Xingyi He , Jiaming Sun , Tong He , Qing Shuai , Wanli Ouyang , Xiaowei Zhou

Reconstructing high-fidelity hand models with intricate textures plays a crucial role in enhancing human-object interaction and advancing real-world applications. Despite the state-of-the-art methods excelling in texture generation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Qijun Gan , Wentong Li , Jinwei Ren , Jianke Zhu

In recent years, 3D hand pose estimation methods have garnered significant attention due to their extensive applications in human-computer interaction, virtual reality, and robotics. In contrast, there has been a notable gap in hand…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Rolandos Alexandros Potamias , Jinglei Zhang , Jiankang Deng , Stefanos Zafeiriou

Convolutional Neural Network based approaches for monocular 3D human pose estimation usually require a large amount of training images with 3D pose annotations. While it is feasible to provide 2D joint annotations for large corpora of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Ikhsanul Habibie , Weipeng Xu , Dushyant Mehta , Gerard Pons-Moll , Christian Theobalt

We present a new multi-stream 3D mesh reconstruction network (MSMR-Net) for hand pose estimation from a single RGB image. Our model consists of an image encoder followed by a mesh-convolution decoder composed of connected graph convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Uri Wollner , Guy Ben-Yosef

Human performance capture is a highly important computer vision problem with many applications in movie production and virtual/augmented reality. Many previous performance capture approaches either required expensive multi-view setups or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

We propose a robust and accurate method for reconstructing 3D hand mesh from monocular images. This is a very challenging problem, as hands are often severely occluded by objects. Previous works often have disregarded 2D hand pose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Shuaibing Wang , Shunli Wang , Dingkang Yang , Mingcheng Li , Ziyun Qian , Liuzhen Su , Lihua Zhang

With an enormous number of hand images generated over time, unleashing pose knowledge from unlabeled images for supervised hand mesh estimation is an emerging yet challenging topic. To alleviate this issue, semi-supervised and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zuyan Liu , Gaojie Lin , Congyi Wang , Min Zheng , Feida Zhu

Although monocular 3D human pose estimation methods have made significant progress, it is far from being solved due to the inherent depth ambiguity. Instead, exploiting multi-view information is a practical way to achieve absolute 3D human…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Guoliang Hua , Hong Liu , Wenhao Li , Qian Zhang , Runwei Ding , Xin Xu

3D interacting hand reconstruction is essential to facilitate human-machine interaction and human behaviors understanding. Previous works in this field either rely on auxiliary inputs such as depth images or they can only handle a single…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yu Rong , Jingbo Wang , Ziwei Liu , Chen Change Loy

Despite recent progress in 3D hand reconstruction from monocular videos, most existing methods rely on data captured in well-controlled environments and therefore degrade in real-world settings with severe perturbations, such as hand-object…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Hanhui Li , Xuan Huang , Wanquan Liu , Yuhao Cheng , Long Chen , Yiqiang Yan , Xiaodan Liang , Chenqiang Gao

We propose a method for hand pose estimation based on a deep regressor trained on two different kinds of input. Raw depth data is fused with an intermediate representation in the form of a segmentation of the hand into parts. This…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Natalia Neverova , Christian Wolf , Florian Nebout , Graham Taylor

Estimating 3d human pose from monocular images is a challenging problem due to the variety and complexity of human poses and the inherent ambiguity in recovering depth from the single view. Recent deep learning based methods show promising…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Sandika Biswas , Sanjana Sinha , Kavya Gupta , Brojeshwar Bhowmick

This work addresses the challenging problem of unconstrained 3D hand pose estimation using monocular RGB images. Most of the existing approaches assume some prior knowledge of hand (such as hand locations and side information) is available…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Sanjeev Sharma , Shaoli Huang , Dacheng Tao

Estimating the 3D hand pose from a monocular RGB image is important but challenging. A solution is training on large-scale RGB hand images with accurate 3D hand keypoint annotations. However, it is too expensive in practice. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhenyu Wu , Duc Hoang , Shih-Yao Lin , Yusheng Xie , Liangjian Chen , Yen-Yu Lin , Zhangyang Wang , Wei Fan

Most of the existing deep learning-based methods for 3D hand and human pose estimation from a single depth map are based on a common framework that takes a 2D depth map and directly regresses the 3D coordinates of keypoints, such as hand or…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

To improve the generalization of 3D human pose estimators, many existing deep learning based models focus on adding different augmentations to training poses. However, data augmentation techniques are limited to the "seen" pose combinations…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Cheng-Yen Yang , Jiajia Luo , Lu Xia , Yuyin Sun , Nan Qiao , Ke Zhang , Zhongyu Jiang , Jenq-Neng Hwang

Recovering 3D human mesh from monocular images is a popular topic in computer vision and has a wide range of applications. This paper aims to estimate 3D mesh of multiple body parts (e.g., body, hands) with large-scale differences from a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Yu Sun , Qian Bao , Wu Liu , Wenpeng Gao , Yili Fu , Chuang Gan , Tao Mei

We propose a novel 3D neural network architecture for 3D hand pose estimation from a single depth image. Different from previous works that mostly run on 2D depth image domain and require intermediate or post process to bring in the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Xiaoming Deng , Shuo Yang , Yinda Zhang , Ping Tan , Liang Chang , Hongan Wang

Non-parametric mesh reconstruction has recently shown significant progress in 3D hand and body applications. In these methods, mesh vertices and edges are visible to neural networks, enabling the possibility to establish a direct mapping…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shijian Jiang , Guwen Han , Danhang Tang , Yang Zhou , Xiang Li , Jiming Chen , Qi Ye