English
Related papers

Related papers: Weakly-Supervised Mesh-Convolutional Hand Reconstr…

200 papers

Previous methods for 3D human motion recovery from monocular images often fall short due to reliance on camera coordinates, leading to inaccuracies in real-world applications. The limited availability and diversity of focal length labels…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Wei Yao , Hongwen Zhang , Yunlian Sun , Yebin Liu , Jinhui Tang

Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Christen Millerdurai , Shaoxiang Wang , Yaxu Xie , Vladislav Golyanik , Didier Stricker , Alain Pagani

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one coupling feature,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Sun Yu , Ye Yun , Liu Wu , Gao Wenpeng , Fu YiLi , Mei Tao

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

Estimating 3D hand and object pose from a single image is an extremely challenging problem: hands and objects are often self-occluded during interactions, and the 3D annotations are scarce as even humans cannot directly label the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Shaowei Liu , Hanwen Jiang , Jiarui Xu , Sifei Liu , Xiaolong Wang

We propose a method for extracting very accurate masks of hands in egocentric views. Our method is based on a novel Deep Learning architecture: In contrast with current Deep Learning methods, we do not use upscaling layers applied to a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-29 Tadej Vodopivec , Vincent Lepetit , Peter Peer

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Most of the recent deep learning-based 3D human pose and mesh estimation methods regress the pose and shape parameters of human mesh models, such as SMPL and MANO, from an input image. The first weakness of these methods is an appearance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Kyoung Mu Lee

Reconstructing the hand mesh from one single RGB image is a challenging task because hands are often occluded by other objects. Most previous works attempt to explore more additional information and adopt attention mechanisms for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zixun Jiao , Xihan Wang , Zhaoqiang Xia , Lianhe Shao , Quanli Gao

Camera captured human pose is an outcome of several sources of variation. Performance of supervised 3D pose estimation approaches comes at the cost of dispensing with variations, such as shape and appearance, that may be useful for solving…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jogendra Nath Kundu , Siddharth Seth , Varun Jampani , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

Encouraged by the success of contrastive learning on image classification tasks, we propose a new self-supervised method for the structured regression task of 3D hand pose estimation. Contrastive learning makes use of unlabeled data for the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Adrian Spurr , Aneesh Dahiya , Xi Wang , Xucong Zhang , Otmar Hilliges

Realistic reconstruction of two hands interacting with objects is a new and challenging problem that is essential for building personalized Virtual and Augmented Reality environments. Graph Convolutional networks (GCNs) allow for the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Ahmed Tawfik Aboukhadra , Jameel Malik , Ahmed Elhayek , Nadia Robertini , Didier Stricker

This paper proposes a weakly-supervised learning framework for dynamics estimation from human motion. Although there are many solutions to capture pure human motion readily available, their data is not sufficient to analyze quality and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Petrissa Zell , Bodo Rosenhahn , Bastian Wandt

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast/slow relative to the scale and speed of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Cheng Yu , Bo Wang , Bo Yang , Robby T. Tan

Monocular 3D human pose estimation from RGB images has attracted significant attention in recent years. However, recent models depend on supervised training with 3D pose ground truth data or known pose priors for their target domains. 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Shuangjun Liu , Michael Wan , Sarah Ostadabbas

Accurate hand motion capture and standardized 3D representation are essential for various hand-related tasks. Collecting keypoints-only data, while efficient and cost-effective, results in low-fidelity representations and lacks surface…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Menghe Zhang , Joonyeoup Kim , Yangwen Liang , Shuangquan Wang , Kee-Bong Song

We present an approach that learns to synthesize high-quality, novel views of 3D objects or scenes, while providing fine-grained and precise control over the 6-DOF viewpoint. The approach is self-supervised and only requires 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xu Chen , Jie Song , Otmar Hilliges

We tackle the challenging task of estimating global 3D joint locations for both hands via only monocular RGB input images. We propose a novel multi-stage convolutional neural network based pipeline that accurately segments and locates the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Fanqing Lin , Connor Wilhelm , Tony Martinez

Estimating 3D hand pose directly from RGB imagesis challenging but has gained steady progress recently bytraining deep models with annotated 3D poses. Howeverannotating 3D poses is difficult and as such only a few 3Dhand pose datasets are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Yen-Yu Lin , Xiaohui Xie