English
Related papers

Related papers: Rotation-invariant Mixed Graphical Model Network f…

200 papers

3D hand pose estimation has received a lot of attention for its wide range of applications and has made great progress owing to the development of deep learning. Existing approaches mainly consider different input modalities and settings,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Kuo-Wei Lee , Shih-Hung Liu , Hwann-Tzong Chen , Koichi Ito

We propose the first approach to the problem of inferring the depth map of a human hand based on a single RGB image. We achieve this with a Convolutional Neural Network (CNN) that employs a stacked hourglass model as its main building…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Vassilis C. Nicodemou , Iason Oikonomidis , Georgios Tzimiropoulos , Antonis Argyros

Hand pose estimation from monocular depth images is an important and challenging problem for human-computer interaction. Recently deep convolutional networks (ConvNet) with sophisticated design have been employed to address it, but the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Hengkai Guo , Guijin Wang , Xinghao Chen , Cairong Zhang , Fei Qiao , Huazhong Yang

This paper proposes a method for hand pose estimation from RGB images that uses both external large-scale depth image datasets and paired depth and RGB images as privileged information at training time. We show that providing depth…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Shanxin Yuan , Bjorn Stenger , Tae-Kyun Kim

Estimating the 3D pose of a hand from a 2D image is a well-studied problem and a requirement for several real-life applications such as virtual reality, augmented reality, and hand gesture recognition. Currently, reasonable estimations can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Adriano Fragomeni , Daniele Pannone

Hand pose estimation from a monocular RGB image is an important but challenging task. The main factor affecting its performance is the lack of a sufficiently large training dataset with accurate hand-keypoint annotations. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Hui Tang , Yufan Xue , Xiaohui Xie , Yen-Yu Lin , Wei Fan

In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resulting in large network…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Ayman Ali , Ekkasit Pinyoanuntapong , Pu Wang , Mohsen Dorodchi

Hand pose estimation from the monocular 2D image is challenging due to the variation in lighting, appearance, and background. While some success has been achieved using deep neural networks, they typically require collecting a large dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yikang Li , Chris Twigg , Yuting Ye , Lingling Tao , Xiaogang Wang

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hao Meng , Sheng Jin , Wentao Liu , Chen Qian , Mengxiang Lin , Wanli Ouyang , Ping Luo

We develop a rotation equivariant model for generating 3D hand meshes from 2D RGB images. This guarantees that as the input image of a hand is rotated the generated mesh undergoes a corresponding rotation. Furthermore, this removes…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Joshua Mitton , Chaitanya Kaul , Roderick Murray-Smith

With increasing applications of 3D hand pose estimation in various human-computer interaction applications, convolution neural networks (CNNs) based estimation models have been actively explored. However, the existing models require complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Wencan Cheng , Jae Hyun Park , Jong Hwan Ko

We propose a novel 3D neural network architecture for 3D hand pose estimation from a single depth image. Different from previous works that mostly run on 2D depth image domain and require intermediate or post process to bring in the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Xiaoming Deng , Shuo Yang , Yinda Zhang , Ping Tan , Liang Chang , Hongan Wang

Predicting camera-space hand meshes from single RGB images is crucial for enabling realistic hand interactions in 3D virtual and augmented worlds. Previous work typically divided the task into two stages: given a cropped image of the hand,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Eugene Valassakis , Guillermo Garcia-Hernando

State-of-the-art single depth image-based 3D hand pose estimation methods are based on dense predictions, including voxel-to-voxel predictions, point-to-point regression, and pixel-wise estimations. Despite the good performance, those…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Linpu Fang , Xingyan Liu , Li Liu , Hang Xu , Wenxiong Kang

We propose a single-shot approach to determining 6-DoF pose of an object with available 3D computer-aided design (CAD) model from a single RGB image. Our method, dubbed MRC-Net, comprises two stages. The first performs pose classification…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yuelong Li , Yafei Mao , Raja Bala , Sunil Hadap

Hand-object pose estimation (HOPE) aims to jointly detect the poses of both a hand and of a held object. In this paper, we propose a lightweight model called HOPE-Net which jointly estimates hand and object pose in 2D and 3D in real-time.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Bardia Doosti , Shujon Naha , Majid Mirbagheri , David Crandall

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulated hand meshes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Changlong Jiang , Yang Xiao , Cunlin Wu , Mingyang Zhang , Jinghong Zheng , Zhiguo Cao , Joey Tianyi Zhou

Since the emergence of large annotated datasets, state-of-the-art hand pose estimation methods have been mostly based on discriminative learning. Recently, a hybrid approach has embedded a kinematic layer into the deep learning structure in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Jan Wöhlke , Shile Li , Dongheui Lee