English
Related papers

Related papers: Cross-modal Deep Variational Hand Pose Estimation

200 papers

This work proposes an end-to-end approach to estimate full 3D hand pose from stereo cameras. Most existing methods of estimating hand pose from stereo cameras apply stereo matching to obtain depth map and use depth-based solution to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Yuncheng Li , Zehao Xue , Yingying Wang , Liuhao Ge , Zhou Ren , Jonathan Rodriguez

Hand pose estimation is a crucial part of a wide range of augmented reality and human-computer interaction applications. Predicting the 3D hand pose from a single RGB image is challenging due to occlusion and depth ambiguities. GCN-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

Hand pose estimation from a single depth image is an essential topic in computer vision and human computer interaction. Despite recent advancements in this area promoted by convolutional neural network, accurate hand pose estimation is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Xinghao Chen , Guijin Wang , Hengkai Guo , Cairong Zhang

While many recent hand pose estimation methods critically rely on a training set of labelled frames, the creation of such a dataset is a challenging task that has been overlooked so far. As a result, existing datasets are limited to a few…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Markus Oberweger , Gernot Riegler , Paul Wohlhart , Vincent Lepetit

3D hand pose estimation from single depth image is an important and challenging problem for human-computer interaction. Recently deep convolutional networks (ConvNet) with sophisticated design have been employed to address it, but the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Hengkai Guo , Guijin Wang , Xinghao Chen , Cairong Zhang

We propose an approach to estimating the 3D pose of a hand, possibly handling an object, given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

Articulated hand pose estimation plays an important role in human-computer interaction. Despite the recent progress, the accuracy of existing methods is still not satisfactory, partially due to the difficulty of embedded high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 Liuhao Ge , Hui Liang , Junsong Yuan , Daniel Thalmann

Accurate hand pose estimation at joint level has several uses on human-robot interaction, user interfacing and virtual reality applications. Yet, it currently is not a solved problem. The novel deep learning techniques could make a great…

Human-Computer Interaction · Computer Science 2017-07-20 Francisco Gomez-Donoso , Sergio Orts-Escolano , Miguel Cazorla

Hand pose estimation from a monocular RGB image is an important but challenging task. The main factor affecting its performance is the lack of a sufficiently large training dataset with accurate hand-keypoint annotations. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Hui Tang , Yufan Xue , Xiaohui Xie , Yen-Yu Lin , Wei Fan

Most of the existing deep learning-based methods for 3D hand and human pose estimation from a single depth map are based on a common framework that takes a 2D depth map and directly regresses the 3D coordinates of keypoints, such as hand or…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

Crucial to the success of training a depth-based 3D hand pose estimator (HPE) is the availability of comprehensive datasets covering diverse camera perspectives, shapes, and pose variations. However, collecting such annotated datasets is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-14 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

With the increase number of companies focusing on commercializing Augmented Reality (AR), Virtual Reality (VR) and wearable devices, the need for a hand based input mechanism is becoming essential in order to make the experience natural,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-22 Emad Barsoum

We develop a system for modeling hand-object interactions in 3D from RGB images that show a hand which is holding a novel object from a known category. We design a Convolutional Neural Network (CNN) for Hand-held Object Pose and Shape…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Mia Kokic , Danica Kragic , Jeannette Bohg

Defining methods for the automatic understanding of gestures is of paramount importance in many application contexts and in Virtual Reality applications for creating more natural and easy-to-use human-computer interaction methods. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Katia Lupinetti , Andrea Ranieri , Franca Giannini , Marina Monti

Modeling hand-object manipulations is essential for understanding how humans interact with their environment. While of practical importance, estimating the pose of hands and objects during interactions is challenging due to the large mutual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Yana Hasson , Bugra Tekin , Federica Bogo , Ivan Laptev , Marc Pollefeys , Cordelia Schmid

We present a method for the real-time estimation of the full 3D pose of one or more human hands using a single commodity RGB camera. Recent work in the area has displayed impressive progress using RGBD input. However, since the introduction…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Paschalis Panteleris , Iason Oikonomidis , Antonis Argyros

Deep generative modelling for human body analysis is an emerging problem with many interesting applications. However, the latent space learned by such approaches is typically not interpretable, resulting in less flexibility. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Rodrigo de Bem , Arnab Ghosh , Thalaiyasingam Ajanthan , Ondrej Miksik , Adnane Boukhayma , N. Siddharth , Philip Torr

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , Haichao Zhu

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot