English
Related papers

Related papers: Cross-modal Deep Variational Hand Pose Estimation

200 papers

While hand pose estimation is a critical component of most interactive extended reality and gesture recognition systems, contemporary approaches are not optimized for computational and memory efficiency. In this paper, we propose a tiny…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 John Yang , Yash Bhalgat , Simyung Chang , Fatih Porikli , Nojun Kwak

Model-based approaches to 3D hand tracking have been shown to perform well in a wide range of scenarios. However, they require initialisation and cannot recover easily from tracking failures that occur due to fast hand motions. Data-driven…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Georg Poier , Konstantinos Roditakis , Samuel Schulter , Damien Michel , Horst Bischof , Antonis A. Argyros

We present a novel unified framework that concurrently tackles recognition and future prediction for human hand pose and action modeling. Previous works generally provide isolated solutions for either recognition or prediction, which not…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yilin Wen , Hao Pan , Takehiko Ohkawa , Lei Yang , Jia Pan , Yoichi Sato , Taku Komura , Wenping Wang

The motion of picking up and placing an object in 3D space is full of subtle detail. Typically these motions are formed from the same constraints, optimizing for swiftness, energy efficiency, as well as physiological limits. Yet, even for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Connor Daly , Yuzuko Nakamura , Tobias Ritschel

Estimating 3D hand pose from monocular RGB images is fundamental for applications in AR/VR, human-computer interaction, and sign language understanding. In this work we focus on a scenario where a discrete set of gesture labels is available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rui Hong , Jana Kosecka

We present a deployment friendly, fast bottom-up framework for multi-person 3D human pose estimation. We adopt a novel neural representation of multi-person 3D pose which unifies the position of person instances with their corresponding 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Jogendra Nath Kundu , Ambareesh Revanur , Govind Vitthal Waghmare , Rahul Mysore Venkatesh , R. Venkatesh Babu

We present a simple and effective method for 3D hand pose estimation from a single depth frame. As opposed to previous state-of-the-art methods based on holistic 3D regression, our method works on dense pixel-wise estimation. This is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

A deep generative model that describes human motions can benefit a wide range of fundamental computer vision and graphics tasks, such as providing robustness to video-based human pose estimation, predicting complete body movements for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Jiaman Li , Ruben Villegas , Duygu Ceylan , Jimei Yang , Zhengfei Kuang , Hao Li , Yajie Zhao

As a fundamental and challenging problem in computer vision, hand pose estimation aims to estimate the hand joint locations from depth images. Typically, the problem is modeled as learning a mapping function from images to hand joint…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yiming Wu , Wei Ji , Xi Li , Gang Wang , Jianwei Yin , Fei Wu

Estimating 3D hand pose directly from RGB imagesis challenging but has gained steady progress recently bytraining deep models with annotated 3D poses. Howeverannotating 3D poses is difficult and as such only a few 3Dhand pose datasets are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Yen-Yu Lin , Xiaohui Xie

Estimating3D hand poses from RGB images is essentialto a wide range of potential applications, but is challengingowing to substantial ambiguity in the inference of depth in-formation from RGB images. State-of-the-art estimators ad-dress…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Yen-Yu Lin , Wei Fan , Xiaohui Xie

We propose an entirely data-driven approach to estimating the 3D pose of a hand given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

This paper addresses the problem of 3D hand pose estimation from a monocular RGB image. While previous methods have shown great success, the structure of hands has not been fully exploited, which is critical in pose estimation. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Yiming He , Wei Hu

Discriminative methods often generate hand poses kinematically implausible, then generative methods are used to correct (or verify) these results in a hybrid method. Estimating 3D hand pose in a hierarchy, where the high-dimensional output…

Computer Vision and Pattern Recognition · Computer Science 2016-10-21 Qi Ye , Shanxin Yuan , Tae-Kyun Kim

We propose a Bayesian approximation to a deep learning architecture for 3D hand pose estimation. Through this framework, we explore and analyse the two types of uncertainties that are influenced either by data or by the learning capability.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Razvan Caramalau , Binod Bhattarai , Tae-Kyun Kim

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulated hand meshes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Christian Zimmermann , Duygu Ceylan , Jimei Yang , Bryan Russell , Max Argus , Thomas Brox

Most deep pose estimation methods need to be trained for specific object instances or categories. In this work we propose a completely generic deep pose estimation approach, which does not require the network to have been trained on…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Yang Xiao , Xuchong Qiu , Pierre-Alain Langlois , Mathieu Aubry , Renaud Marlet

In this paper, a feature boosting network is proposed for estimating 3D hand pose and 3D body pose from a single RGB image. In this method, the features learned by the convolutional layers are boosted with a new long short-term…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Jun Liu , Henghui Ding , Amir Shahroudy , Ling-Yu Duan , Xudong Jiang , Gang Wang , Alex C. Kot

This paper proposes a method for hand pose estimation from RGB images that uses both external large-scale depth image datasets and paired depth and RGB images as privileged information at training time. We show that providing depth…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Shanxin Yuan , Bjorn Stenger , Tae-Kyun Kim