English
Related papers

Related papers: Using a single RGB frame for real time 3D hand pos…

200 papers

We present a simple and effective method for 3D hand pose estimation from a single depth frame. As opposed to previous state-of-the-art methods based on holistic 3D regression, our method works on dense pixel-wise estimation. This is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

In this paper, we present a HAnd Mesh Recovery (HAMR) framework to tackle the problem of reconstructing the full 3D mesh of a human hand from a single RGB image. In contrast to existing research on 2D or 3D hand pose estimation from RGB…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xiong Zhang , Qiang Li , Hong Mo , Wenbo Zhang , Wen Zheng

We present a real-time approach for multi-person 3D motion capture at over 30 fps using a single RGB camera. It operates successfully in generic scenes which may contain occlusions by objects and by other people. Our method operates in…

In-hand object reorientation requires precise estimation of the object pose to handle complex task dynamics. While RGB sensing offers rich semantic cues for pose tracking, existing solutions rely on multi-camera setups or costly ray…

Robotics · Computer Science 2026-04-14 Arjun Bhardwaj , Maximum Wilder-Smith , Mayank Mittal , Vaishakh Patil , Marco Hutter

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image. Our approach uses a new neural network architecture that exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Yuxiao Zhou , Marc Habermann , Ikhsanul Habibie , Ayush Tewari , Christian Theobalt , Feng Xu

3D hand pose tracking/estimation will be very important in the next generation of human-computer interaction. Most of the currently available algorithms rely on low-cost active depth sensors. However, these sensors can be easily interfered…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Jiawei Zhang , Jianbo Jiao , Mingliang Chen , Liangqiong Qu , Xiaobin Xu , Qingxiong Yang

Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Christen Millerdurai , Shaoxiang Wang , Yaxu Xie , Vladislav Golyanik , Didier Stricker , Alain Pagani

We explore 3D human pose estimation from a single RGB image. While many approaches try to directly predict 3D pose from image measurements, we explore a simple architecture that reasons through intermediate 2D pose predictions. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Ching-Hang Chen , Deva Ramanan

3D hand pose estimation in everyday egocentric images is challenging for several reasons: poor visual signal (occlusion from the object of interaction, low resolution & motion blur), large perspective distortion (hands are close to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Ruisen Tu , Matthew Chang , Saurabh Gupta

We propose a method for in-hand 3D scanning of an unknown object with a monocular camera. Our method relies on a neural implicit surface representation that captures both the geometry and the appearance of the object, however, by contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shreyas Hampali , Tomas Hodan , Luan Tran , Lingni Ma , Cem Keskin , Vincent Lepetit

Accurate hand pose estimation at joint level has several uses on human-robot interaction, user interfacing and virtual reality applications. Yet, it currently is not a solved problem. The novel deep learning techniques could make a great…

Human-Computer Interaction · Computer Science 2017-07-20 Francisco Gomez-Donoso , Sergio Orts-Escolano , Miguel Cazorla

Estimating 3D hand pose from monocular RGB images is fundamental for applications in AR/VR, human-computer interaction, and sign language understanding. In this work we focus on a scenario where a discrete set of gesture labels is available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rui Hong , Jana Kosecka

Human pose estimation from single images is a challenging problem in computer vision that requires large amounts of labeled training data to be solved accurately. Unfortunately, for many human activities (\eg outdoor sports) such training…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Bastian Wandt , Marco Rudolph , Petrissa Zell , Helge Rhodin , Bodo Rosenhahn

Contemporary monocular 6D pose estimation methods can only cope with a handful of object instances. This naturally hampers possible applications as, for instance, robots seamlessly integrated in everyday processes necessarily require the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Fabian Manhardt , Gu Wang , Benjamin Busam , Manuel Nickel , Sven Meier , Luca Minciullo , Xiangyang Ji , Nassir Navab

This report describes our 1st place solution to ECCV 2022 challenge on Human Body, Hands, and Activities (HBHA) from Egocentric and Multi-view Cameras (hand pose estimation). In this challenge, we aim to estimate global 3D hand poses from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Hoseong Cho , Donguk Kim , Chanwoo Kim , Seongyeong Lee , Seungryul Baek

Analysis of hand-hand interactions is a crucial step towards better understanding human behavior. However, most researches in 3D hand pose estimation have focused on the isolated single hand case. Therefore, we firstly propose (1) a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Gyeongsik Moon , Shoou-i Yu , He Wen , Takaaki Shiratori , Kyoung Mu Lee

In this paper we present a novel approach for bottom-up multi-person 3D human pose estimation from monocular RGB images. We propose to use high resolution volumetric heatmaps to model joint locations, devising a simple and effective…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Matteo Fabbri , Fabio Lanzi , Simone Calderara , Stefano Alletto , Rita Cucchiara

Egocentric 3D human pose estimation using a single fisheye camera has become popular recently as it allows capturing a wide range of daily activities in unconstrained environments, which is difficult for traditional outside-in motion…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jian Wang , Lingjie Liu , Weipeng Xu , Kripasindhu Sarkar , Christian Theobalt

We present a new solution to egocentric 3D body pose estimation from monocular images captured from a downward looking fish-eye camera installed on the rim of a head mounted virtual reality device. This unusual viewpoint, just 2 cm. away…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Denis Tome , Patrick Peluse , Lourdes Agapito , Hernan Badino

This work proposes an end-to-end approach to estimate full 3D hand pose from stereo cameras. Most existing methods of estimating hand pose from stereo cameras apply stereo matching to obtain depth map and use depth-based solution to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Yuncheng Li , Zehao Xue , Yingying Wang , Liuhao Ge , Zhou Ren , Jonathan Rodriguez