English
Related papers

Related papers: Real-time Hand Tracking under Occlusion from an Eg…

200 papers

Despite recent advances in 3D pose estimation of human hands, especially thanks to the advent of CNNs and depth cameras, this task is still far from being solved. This is mainly due to the highly non-linear dynamics of fingers, which make…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Meysam Madadi , Sergio Escalera , Xavier Baro , Jordi Gonzalez

3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion. Most existing methods rely on RGB inputs, which have severe limitations under low-light…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Christen Millerdurai , Diogo Luvizon , Viktor Rudnev , André Jonas , Jiayi Wang , Christian Theobalt , Vladislav Golyanik

Estimating the 3D hand articulation from a single color image is an important problem with applications in Augmented Reality (AR), Virtual Reality (VR), Human-Computer Interaction (HCI), and robotics. Apart from the absence of depth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Christos Pantazopoulos , Spyridon Thermos , Gerasimos Potamianos

Low-cost consumer depth cameras and deep learning have enabled reasonable 3D hand pose estimation from single depth images. In this paper, we present an approach that estimates 3D hand pose from regular RGB images. This task has far more…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Christian Zimmermann , Thomas Brox

Nowadays, hand gesture recognition has become an alternative for human-machine interaction. It has covered a large area of applications like 3D game technology, sign language interpreting, VR (virtual reality) environment, and robotics. But…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Abir Sen , Tapas Kumar Mishra , Ratnakar Dash

Egocentric 3D human pose estimation has been actively studied using cameras installed in front of a head-mounted device (HMD). While frontal placement is the optimal and the only option for some tasks, such as hand tracking, it remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Hiroyasu Akada , Jian Wang , Vladislav Golyanik , Christian Theobalt

Real-time recognition of dynamic hand gestures from video streams is a challenging task since (i) there is no indication when a gesture starts and ends in the video, (ii) performed gestures should only be recognized once, and (iii) the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Okan Köpüklü , Ahmet Gunduz , Neslihan Kose , Gerhard Rigoll

In this paper, we address the problem of estimating the hand pose from the egocentric view when the hand is interacting with objects. Specifically, we propose a method to label a dataset Ego-Siam which contains the egocentric images…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Yao Lu , Walterio W. Mayol-Cuevas

We present a novel solution to the problem of 3D tracking of the articulated motion of human hand(s), possibly in interaction with other objects. The vast majority of contemporary relevant work capitalizes on depth information provided by…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Paschalis Panteleris , Antonis Argyros

The ability to distinguish between the self and the background is of paramount importance for robotic tasks. The particular case of hands, as the end effectors of a robotic system that more often enter into contact with other elements of…

Robotics · Computer Science 2021-02-10 Alexandre Almeida , Pedro Vicente , Alexandre Bernardino

Accurate 3D tracking of hands and their interactions with the world in unconstrained settings remains a significant challenge for egocentric computer vision. With few exceptions, existing datasets are predominantly captured in controlled…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Patrick Rim , Kun He , Kevin Harris , Braden Copple , Shangchen Han , Sizhe An , Ivan Shugurov , Tomas Hodan , He Wen , Xu Xie

Hands are often severely occluded by objects, which makes 3D hand mesh estimation challenging. Previous works often have disregarded information at occluded regions. However, we argue that occluded regions have strong correlations with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 JoonKyu Park , Yeonguk Oh , Gyeongsik Moon , Hongsuk Choi , Kyoung Mu Lee

Estimating the 6D pose of known objects is important for robots to interact with the real world. The problem is challenging due to the variety of objects as well as the complexity of a scene caused by clutter and occlusions between objects.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Yu Xiang , Tanner Schmidt , Venkatraman Narayanan , Dieter Fox

This work addresses the challenging problem of unconstrained 3D hand pose estimation using monocular RGB images. Most of the existing approaches assume some prior knowledge of hand (such as hand locations and side information) is available…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Sanjeev Sharma , Shaoli Huang , Dacheng Tao

The success of Deep Convolutional Neural Networks (CNNs) in recent years in almost all the Computer Vision tasks on one hand, and the popularity of low-cost consumer depth cameras on the other, has made Hand Pose Estimation a hot topic in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Bardia Doosti

We present a novel appearance-based approach for pose estimation of a human hand using the point clouds provided by the low-cost Microsoft Kinect sensor. Both the free-hand case, in which the hand is isolated from the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Pasquale Coscia , Francesco A. N. Palmieri , Francesco Castaldo , Alberto Cavallo

We present a real-time approach for multi-person 3D motion capture at over 30 fps using a single RGB camera. It operates successfully in generic scenes which may contain occlusions by objects and by other people. Our method operates in…

3D hand pose estimation in everyday egocentric images is challenging for several reasons: poor visual signal (occlusion from the object of interaction, low resolution & motion blur), large perspective distortion (hands are close to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Ruisen Tu , Matthew Chang , Saurabh Gupta

Egocentric gesture recognition is a pivotal technology for enhancing natural human-computer interaction, yet traditional RGB-based solutions suffer from motion blur and illumination variations in dynamic scenarios. While event cameras show…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Luming Wang , Hao Shi , Xiaoting Yin , Kailun Yang , Kaiwei Wang , Jian Bai

Touch contact and pressure are essential for understanding how humans interact with and manipulate objects, insights which can significantly benefit applications in mixed reality and robotics. However, estimating these interactions from an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yiming Zhao , Taein Kwon , Paul Streli , Marc Pollefeys , Christian Holz