English
Related papers

Related papers: Transformer-based Global 3D Hand Pose Estimation i…

200 papers

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

We propose to leverage recent advances in reliable 2D pose estimation with Convolutional Neural Networks (CNN) to estimate the 3D pose of people from depth images in multi-person Human-Robot Interaction (HRI) scenarios. Our method is based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Angel Martínez-González , Michael Villamizar , Olivier Canévet , Jean-Marc Odobez

Full-body egocentric pose estimation from head and hand poses alone has become an active area of research to power articulate avatar representations on headset-based platforms. However, existing methods over-rely on the indoor…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Jiaxi Jiang , Paul Streli , Manuel Meier , Christian Holz

Detecting hand actions from ego-centric depth sequences is a practically challenging problem, owing mostly to the complex and dexterous nature of hand articulations as well as non-stationary camera motion. We address this problem via a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-08 Chi Xu , Lakshmi Narasimhan Govindarajan , Li Cheng

Purpose: Accurate 3D hand pose estimation supports surgical applications such as skill assessment, robot-assisted interventions, and geometry-aware workflow analysis. However, surgical environments pose severe challenges, including intense…

Forecasting how human hands move in egocentric views is critical for applications like augmented reality and human-robot policy transfer. Recently, several hand trajectory prediction (HTP) methods have been developed to generate future…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Junyi Ma , Wentao Bao , Jingyi Xu , Guanzhong Sun , Yu Zheng , Erhang Zhang , Xieyuanli Chen , Hesheng Wang

With increasing applications of 3D hand pose estimation in various human-computer interaction applications, convolution neural networks (CNNs) based estimation models have been actively explored. However, the existing models require complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Wencan Cheng , Jae Hyun Park , Jong Hwan Ko

Hand-object pose estimation (HOPE) aims to jointly detect the poses of both a hand and of a held object. In this paper, we propose a lightweight model called HOPE-Net which jointly estimates hand and object pose in 2D and 3D in real-time.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Bardia Doosti , Shujon Naha , Majid Mirbagheri , David Crandall

While many recent hand pose estimation methods critically rely on a training set of labelled frames, the creation of such a dataset is a challenging task that has been overlooked so far. As a result, existing datasets are limited to a few…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Markus Oberweger , Gernot Riegler , Paul Wohlhart , Vincent Lepetit

We present EgoHumans, a new multi-view multi-human video benchmark to advance the state-of-the-art of egocentric human 3D pose estimation and tracking. Existing egocentric benchmarks either capture single subject or indoor-only scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Rawal Khirodkar , Aayush Bansal , Lingni Ma , Richard Newcombe , Minh Vo , Kris Kitani

In this survey, we present a systematic review of 3D hand pose estimation from the perspective of efficient annotation and learning. 3D hand pose estimation has been an important research area owing to its potential to enable various…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Takehiko Ohkawa , Ryosuke Furuta , Yoichi Sato

We propose an entirely data-driven approach to estimating the 3D pose of a hand given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

Unlike traditional robotic hands, underactuated compliant hands are challenging to model due to inherent uncertainties. Consequently, pose estimation of a grasped object is usually performed based on visual perception. However, visual…

Robotics · Computer Science 2024-01-18 Osher Azulay , Inbar Ben-David , Avishai Sintov

Low-cost consumer depth cameras and deep learning have enabled reasonable 3D hand pose estimation from single depth images. In this paper, we present an approach that estimates 3D hand pose from regular RGB images. This task has far more…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Christian Zimmermann , Thomas Brox

Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign language…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiayi Wang , Franziska Mueller , Florian Bernard , Suzanne Sorli , Oleksandr Sotnychenko , Neng Qian , Miguel A. Otaduy , Dan Casas , Christian Theobalt

Egocentric 3D human pose estimation using a single fisheye camera has become popular recently as it allows capturing a wide range of daily activities in unconstrained environments, which is difficult for traditional outside-in motion…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jian Wang , Lingjie Liu , Weipeng Xu , Kripasindhu Sarkar , Christian Theobalt

We study the problem of estimating the body movements of a camera wearer from egocentric videos. Current methods for ego-body pose estimation rely on temporally dense sensor data, such as IMU measurements from spatially sparse body parts…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Seunggeun Chi , Pin-Hao Huang , Enna Sachdeva , Hengbo Ma , Karthik Ramani , Kwonjoon Lee

We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Anastasia Tkach , Shreyas Hampali , Linguang Zhang , Elliot J. Crowley , Cem Keskin

Contactless hand pose estimation requires sensors that provide precise spatial information and low computational complexity for real-time processing. Unlike vision-based systems, radar offers lighting independence and direct motion…

Signal Processing · Electrical Eng. & Systems 2024-06-21 Johanna Bräunig , Vanessa Wirth , Marc Stamminger , Ingrid Ullmann , Martin Vossiek

Over the past decade, there has been a growing interest in human pose estimation. Although much work has been done on 2D pose estimation, 3D pose estimation has still been relatively studied less. In this paper, we propose a top-bottom…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Sungeun Hong , Wonjin Jung , Ilsang Woo , Seung Wook Kim