English
Related papers

Related papers: 3D Hand Shape and Pose from Images in the Wild

200 papers

Accurate hand pose estimation at joint level has several uses on human-robot interaction, user interfacing and virtual reality applications. Yet, it currently is not a solved problem. The novel deep learning techniques could make a great…

Human-Computer Interaction · Computer Science 2017-07-20 Francisco Gomez-Donoso , Sergio Orts-Escolano , Miguel Cazorla

Soft robotic hand shows considerable promise for various grasping applications. However, the sensing and reconstruction of the robot pose will cause limitation during the design and fabrication. In this work, we present a novel 3D pose…

Robotics · Computer Science 2023-08-08 Haihang Wang , He Xu , Yihan Meng

Estimating the 3D pose of a hand is an essential part of human-computer interaction. Estimating 3D pose using depth or multi-view sensors has become easier with recent advances in computer vision, however, regressing pose from a single RGB…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Umar Iqbal , Pavlo Molchanov , Thomas Breuel , Juergen Gall , Jan Kautz

We propose an entirely data-driven approach to estimating the 3D pose of a hand given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

We develop a system for modeling hand-object interactions in 3D from RGB images that show a hand which is holding a novel object from a known category. We design a Convolutional Neural Network (CNN) for Hand-held Object Pose and Shape…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Mia Kokic , Danica Kragic , Jeannette Bohg

Hand pose estimation is a crucial part of a wide range of augmented reality and human-computer interaction applications. Predicting the 3D hand pose from a single RGB image is challenging due to occlusion and depth ambiguities. GCN-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

Estimating the 3D hand pose from a monocular RGB image is important but challenging. A solution is training on large-scale RGB hand images with accurate 3D hand keypoint annotations. However, it is too expensive in practice. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zhenyu Wu , Duc Hoang , Shih-Yao Lin , Yusheng Xie , Liangjian Chen , Yen-Yu Lin , Zhangyang Wang , Wei Fan

Model-based approaches to 3D hand tracking have been shown to perform well in a wide range of scenarios. However, they require initialisation and cannot recover easily from tracking failures that occur due to fast hand motions. Data-driven…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Georg Poier , Konstantinos Roditakis , Samuel Schulter , Damien Michel , Horst Bischof , Antonis A. Argyros

Despite recent advances in 3D pose estimation of human hands, especially thanks to the advent of CNNs and depth cameras, this task is still far from being solved. This is mainly due to the highly non-linear dynamics of fingers, which make…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Meysam Madadi , Sergio Escalera , Xavier Baro , Jordi Gonzalez

We present a joint 3D pose and focal length estimation approach for object categories in the wild. In contrast to previous methods that predict 3D poses independently of the focal length or assume a constant focal length, we explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Alexander Grabner , Peter M. Roth , Vincent Lepetit

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

3D Hand pose estimation from a single depth image is an essential topic in computer vision and human-computer interaction. Although the rising of deep learning method boosts the accuracy a lot, the problem is still hard to solve due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Xingyuan Zhang , Fuhai Zhang

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

We present a method for the real-time estimation of the full 3D pose of one or more human hands using a single commodity RGB camera. Recent work in the area has displayed impressive progress using RGBD input. However, since the introduction…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Paschalis Panteleris , Iason Oikonomidis , Antonis Argyros

We present a method for simultaneously estimating 3D human pose and body shape from a sparse set of wide-baseline camera views. We train a symmetric convolutional autoencoder with a dual loss that enforces learning of a latent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Matthew Trumble , Andrew Gilbert , Adrian Hilton , John Collomosse

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

Most of the existing deep learning-based methods for 3D hand and human pose estimation from a single depth map are based on a common framework that takes a 2D depth map and directly regresses the 3D coordinates of keypoints, such as hand or…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

State-of-the-art single depth image-based 3D hand pose estimation methods are based on dense predictions, including voxel-to-voxel predictions, point-to-point regression, and pixel-wise estimations. Despite the good performance, those…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Linpu Fang , Xingyan Liu , Li Liu , Hang Xu , Wenxiong Kang

3D hand pose estimation based on RGB images has been studied for a long time. Most of the studies, however, have performed frame-by-frame estimation based on independent static images. In this paper, we attempt to not only consider the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 John Yang , Hyung Jin Chang , Seungeui Lee , Nojun Kwak

We present a contrastive learning framework based on in-the-wild hand images tailored for pre-training 3D hand pose estimators, dubbed HandCLR. Pre-training on large-scale images achieves promising results in various tasks, but prior 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Nie Lin , Takehiko Ohkawa , Mingfang Zhang , Yifei Huang , Ryosuke Furuta , Yoichi Sato