English
Related papers

Related papers: 3D Interacting Hand Pose Estimation by Hand De-occ…

200 papers

In this survey, we present a systematic review of 3D hand pose estimation from the perspective of efficient annotation and learning. 3D hand pose estimation has been an important research area owing to its potential to enable various…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Takehiko Ohkawa , Ryosuke Furuta , Yoichi Sato

Hand pose estimation from the monocular 2D image is challenging due to the variation in lighting, appearance, and background. While some success has been achieved using deep neural networks, they typically require collecting a large dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yikang Li , Chris Twigg , Yuting Ye , Lingling Tao , Xiaogang Wang

We propose a method for annotating images of a hand manipulating an object with the 3D poses of both the hand and the object, together with a dataset created using this method. Our motivation is the current lack of annotated real images for…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Shreyas Hampali , Mahdi Rad , Markus Oberweger , Vincent Lepetit

Estimating the 3D hand pose from a monocular RGB image is important but challenging. A solution is training on large-scale RGB hand images with accurate 3D hand keypoint annotations. However, it is too expensive in practice. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhenyu Wu , Duc Hoang , Shih-Yao Lin , Yusheng Xie , Liangjian Chen , Yen-Yu Lin , Zhangyang Wang , Wei Fan

Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign language…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiayi Wang , Franziska Mueller , Florian Bernard , Suzanne Sorli , Oleksandr Sotnychenko , Neng Qian , Miguel A. Otaduy , Dan Casas , Christian Theobalt

Hand pose represents key information for action recognition in the egocentric perspective, where the user is interacting with objects. We propose to improve egocentric 3D hand pose estimation based on RGB frames only by using pseudo-depth…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wiktor Mucha , Michael Wray , Martin Kampel

Current human pose estimation systems focus on retrieving an accurate 3D global estimate of a single person. Therefore, this paper presents one of the first 3D multi-person human pose estimation systems that is able to work in real-time and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Pawel Knap , Peter Hardy , Alberto Tamajo , Hwasup Lim , Hansung Kim

In this paper, we propose a method to jointly determine the status of hand-object interaction. This is crucial for egocentric human activity understanding and interaction. From a computer vision perspective, we believe that determining…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yao Lu , Yanan Liu

3D hand pose is an underexplored modality for action recognition. Poses are compact yet informative and can greatly benefit applications with limited compute budgets. However, poses alone offer an incomplete understanding of actions, as…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Md Salman Shamil , Dibyadip Chatterjee , Fadime Sener , Shugao Ma , Angela Yao

We tackle the challenging task of estimating global 3D joint locations for both hands via only monocular RGB input images. We propose a novel multi-stage convolutional neural network based pipeline that accurately segments and locates the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Fanqing Lin , Connor Wilhelm , Tony Martinez

Hand image synthesis and pose estimation from RGB images are both highly challenging tasks due to the large discrepancy between factors of variation ranging from image background content to camera viewpoint. To better analyze these factors…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Linlin Yang , Angela Yao

3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion. Most existing methods rely on RGB inputs, which have severe limitations under low-light…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Christen Millerdurai , Diogo Luvizon , Viktor Rudnev , André Jonas , Jiayi Wang , Christian Theobalt , Vladislav Golyanik

3D hand pose estimation from monocular videos is a long-standing and challenging problem, which is now seeing a strong upturn. In this work, we address it for the first time using a single event camera, i.e., an asynchronous vision sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Viktor Rudnev , Vladislav Golyanik , Jiayi Wang , Hans-Peter Seidel , Franziska Mueller , Mohamed Elgharib , Christian Theobalt

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , Haichao Zhu

The proliferation of XR devices has made egocentric hand pose estimation a vital task, yet this perspective is inherently challenged by frequent finger occlusions. To address this, we propose a novel approach that leverages the rich…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 William Huang , Siyou Pei , Leyi Zou , Eric J. Gonzalez , Ishan Chatterjee , Yang Zhang

Occlusions remain one of the key challenges in 3D body pose estimation from single-camera video sequences. Temporal consistency has been extensively used to mitigate their impact but the existing algorithms in the literature do not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Soumava Kumar Roy , Ilia Badanin , Sina Honari , Pascal Fua

Accurate hand pose estimation at joint level has several uses on human-robot interaction, user interfacing and virtual reality applications. Yet, it currently is not a solved problem. The novel deep learning techniques could make a great…

Human-Computer Interaction · Computer Science 2017-07-20 Francisco Gomez-Donoso , Sergio Orts-Escolano , Miguel Cazorla

Unlike traditional robotic hands, underactuated compliant hands are challenging to model due to inherent uncertainties. Consequently, pose estimation of a grasped object is usually performed based on visual perception. However, visual…

Robotics · Computer Science 2024-01-18 Osher Azulay , Inbar Ben-David , Avishai Sintov

We present an approach for real-time, robust and accurate hand pose estimation from moving egocentric RGB-D cameras in cluttered real environments. Existing methods typically fail for hand-object interactions in cluttered scenes imaged from…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Franziska Mueller , Dushyant Mehta , Oleksandr Sotnychenko , Srinath Sridhar , Dan Casas , Christian Theobalt

Hand pose estimation is a fundamental task in many human-robot interaction-related applications. However, previous approaches suffer from unsatisfying hand landmark predictions in real-world scenes and high computation burden. This paper…

Robotics · Computer Science 2021-10-13 Shan An , Xiajie Zhang , Dong Wei , Haogang Zhu , Jianyu Yang , Konstantinos A. Tsintotas