English
Related papers

Related papers: Enhancing Hands in 3D Whole-Body Pose Estimation w…

200 papers

Crucial to the success of training a depth-based 3D hand pose estimator (HPE) is the availability of comprehensive datasets covering diverse camera perspectives, shapes, and pose variations. However, collecting such annotated datasets is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-14 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

Hand detection is essential for many hand related tasks, e.g. parsing hand pose, understanding gesture, which are extremely useful for robotics and human-computer interaction. However, hand detection in uncontrolled environments is…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Xiaoming Deng , Ye Yuan , Yinda Zhang , Ping Tan , Liang Chang , Shuo Yang , Hongan Wang

In this paper, we propose an adaptive weighting regression (AWR) method to leverage the advantages of both detection-based and regression-based methods. Hand joint coordinates are estimated as discrete integration of all pixels in dense…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Weiting Huang , Pengfei Ren , Jingyu Wang , Qi Qi , Haifeng Sun

We propose an approach to estimating the 3D pose of a hand, possibly handling an object, given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

We present Multi-HMR, a strong sigle-shot model for multi-person 3D human mesh recovery from a single RGB image. Predictions encompass the whole body, i.e., including hands and facial expressions, using the SMPL-X parametric model and 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Fabien Baradel , Matthieu Armando , Salma Galaaoui , Romain Brégier , Philippe Weinzaepfel , Grégory Rogez , Thomas Lucas

The extraction of keypoint positions from input hand frames, known as 3D hand pose estimation, is crucial for various human-computer interaction applications. However, current approaches often struggle with the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wencan Cheng , Eunji Kim , Jong Hwan Ko

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulated hand meshes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

This paper investigates the task of 2D human whole-body pose estimation, which aims to localize dense landmarks on the entire human body including face, hands, body, and feet. As existing datasets do not have whole-body annotations,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Sheng Jin , Lumin Xu , Jin Xu , Can Wang , Wentao Liu , Chen Qian , Wanli Ouyang , Ping Luo

Event camera shows great potential in 3D hand pose estimation, especially addressing the challenges of fast motion and high dynamic range in a low-power way. However, due to the asynchronous differential imaging mechanism, it is challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jianping Jiang , Jiahe Li , Baowen Zhang , Xiaoming Deng , Boxin Shi

DeepPrior is a simple approach based on Deep Learning that predicts the joint 3D locations of a hand given a depth map. Since its publication early 2015, it has been outperformed by several impressive works. Here we show that with simple…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Markus Oberweger , Vincent Lepetit

We propose DeepMetaHandles, a 3D conditional generative model based on mesh deformation. Given a collection of 3D meshes of a category and their deformation handles (control points), our method learns a set of meta-handles for each shape,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Minghua Liu , Minhyuk Sung , Radomir Mech , Hao Su

Whole-body pose estimation localizes the human body, hand, face, and foot keypoints in an image. This task is challenging due to multi-scale body parts, fine-grained localization for low-resolution regions, and data scarcity. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Zhendong Yang , Ailing Zeng , Chun Yuan , Yu Li

Articulated hand pose tracking is an under-explored problem that carries the potential for use in an extensive number of applications, especially in the medical domain. With a robust and accurate tracking system on surgical videos, the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Nathan Louis , Luowei Zhou , Steven J. Yule , Roger D. Dias , Milisa Manojlovich , Francis D. Pagani , Donald S. Likosky , Jason J. Corso

Estimating 3D hand pose from monocular RGB images is fundamental for applications in AR/VR, human-computer interaction, and sign language understanding. In this work we focus on a scenario where a discrete set of gesture labels is available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rui Hong , Jana Kosecka

We present Implicit Two Hands (Im2Hands), the first neural implicit representation of two interacting hands. Unlike existing methods on two-hand reconstruction that rely on a parametric hand model and/or low-resolution meshes, Im2Hands can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jihyun Lee , Minhyuk Sung , Honggyu Choi , Tae-Kyun Kim

This work proposes an end-to-end approach to estimate full 3D hand pose from stereo cameras. Most existing methods of estimating hand pose from stereo cameras apply stereo matching to obtain depth map and use depth-based solution to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Yuncheng Li , Zehao Xue , Yingying Wang , Liuhao Ge , Zhou Ren , Jonathan Rodriguez

Manually annotating accurate 3D hand poses is extremely time-consuming and labor-intensive. Existing self-supervised hand pose estimation methods leverage the discrepancy between input images and rendered outputs, or multi-view consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianhao Han , Haoyang Zhang , Liang Xie , Haochen Chang , Kun Gao , Yuan Cheng , Pengfei Ren , Erwei Yin

Direct mesh fitting for 3D hand shape reconstruction is highly accurate. However, the reconstructed meshes are prone to artifacts and do not appear as plausible hand shapes. Conversely, parametric models like MANO ensure plausible hand…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Ziwei Yu , Chen Li , Linlin Yang , Xiaoxu Zheng , Michael Bi Mi , Gim Hee Lee , Angela Yao

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianbin Jiao , Xina Cheng , Weijie Chen , Xiaoting Yin , Hao Shi , Kailun Yang

Hands are often severely occluded by objects, which makes 3D hand mesh estimation challenging. Previous works often have disregarded information at occluded regions. However, we argue that occluded regions have strong correlations with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 JoonKyu Park , Yeonguk Oh , Gyeongsik Moon , Hongsuk Choi , Kyoung Mu Lee