English
Related papers

Related papers: HandDGP: Camera-Space Hand Mesh Prediction with Di…

200 papers

3D meshes are a fundamental representation widely used in computer science and engineering. In robotics, they are particularly valuable because they capture objects in a form that aligns directly with how robots interact with the physical…

Robotics · Computer Science 2026-01-01 Qian Wang , Omar Abdellall , Tony Gao , Xiatao Sun , Daniel Rakita

Articulated hand pose and shape estimation is an important problem for vision-based applications such as augmented reality and animation. In contrast to the existing methods which optimize only for joint positions, we propose a fully…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Jameel Malik , Ahmed Elhayek , Fabrizio Nunnari , Kiran Varanasi , Kiarash Tamaddon , Alexis Heloir , Didier Stricker

Reconstructing a 3D hand mesh from a single RGB image is challenging due to complex articulations, self-occlusions, and depth ambiguities. Traditional discriminative methods, which learn a deterministic mapping from a 2D image to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Muhammad Usama Saleem , Ekkasit Pinyoanuntapong , Mayur Jagdishbhai Patel , Hongfei Xue , Ahmed Helmy , Srijan Das , Pu Wang

Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less straightforward for predicting the position of 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yihong Lin , Xianjia Wu , Xilai Wang , Jianqiao Hu , Songju Lei , Xiandong Li , Wenxiong Kang

Understanding how humans interact with the world necessitates accurate 3D hand pose estimation, a task complicated by the hand's high degree of articulation, frequent occlusions, self-occlusions, and rapid motions. While most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Enes Duran , Muhammed Kocabas , Vasileios Choutas , Zicong Fan , Michael J. Black

In natural conversation and interaction, our hands often overlap or are in contact with each other. Due to the homogeneous appearance of hands, this makes estimating the 3D pose of interacting hands from images difficult. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Zicong Fan , Adrian Spurr , Muhammed Kocabas , Siyu Tang , Michael J. Black , Otmar Hilliges

As a fundamental and challenging problem in computer vision, hand pose estimation aims to estimate the hand joint locations from depth images. Typically, the problem is modeled as learning a mapping function from images to hand joint…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yiming Wu , Wei Ji , Xi Li , Gang Wang , Jianwei Yin , Fei Wu

Cascaded regression method is a fast and accurate method on finding 2D pose of objects in RGB images. It is able to find the accurate pose of objects in an image by a great number of corrections on the good initial guess of the pose of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Wenye He

Automatically determining three-dimensional human pose from monocular RGB image data is a challenging problem. The two-dimensional nature of the input results in intrinsic ambiguities which make inferring depth particularly difficult.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-09 Aiden Nibali , Zhen He , Stuart Morgan , Luke Prendergast

Reconstructing interacting hands from a single RGB image is a very challenging task. On the one hand, severe mutual occlusion and similar local appearance between two hands confuse the extraction of visual features, resulting in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Pengfei Ren , Chao Wen , Xiaozheng Zheng , Zhou Xue , Haifeng Sun , Qi Qi , Jingyu Wang , Jianxin Liao

Predicting natural and diverse 3D hand gestures from the upper body dynamics is a practical yet challenging task in virtual avatar creation. Previous works usually overlook the asymmetric motions between two hands and generate two hands in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xingqun Qi , Chen Liu , Muyi Sun , Lincheng Li , Changjie Fan , Xin Yu

Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Christian Zimmermann , Duygu Ceylan , Jimei Yang , Bryan Russell , Max Argus , Thomas Brox

Deterministic models for 3D hand pose reconstruction, whether single-staged or cascaded, struggle with pose ambiguities caused by self-occlusions and complex hand articulations. Existing cascaded approaches refine predictions in a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Taeyun Woo , Jinah Park , Tae-Kyun Kim

Hand segmentation and fingertip detection play an indispensable role in hand gesture-based human-machine interaction systems. In this study, we propose a method to discriminate hand components and to locate fingertips in RGB-D images. The…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Duong Hai Nguyen , Tai Nhu Do , In-Seop Na , Soo-Hyung Kim

Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hao Meng , Sheng Jin , Wentao Liu , Chen Qian , Mengxiang Lin , Wanli Ouyang , Ping Luo

Hand pose represents key information for action recognition in the egocentric perspective, where the user is interacting with objects. We propose to improve egocentric 3D hand pose estimation based on RGB frames only by using pseudo-depth…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wiktor Mucha , Michael Wray , Martin Kampel

We present a method for recovering the dense 3D surface of the hand by regressing the vertex coordinates of a mesh model from a single depth map. To this end, we use a two-stage 2D fully convolutional network architecture. In the first…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

Estimating metric relative camera pose from a pair of images is of great importance for 3D reconstruction and localisation. However, conventional two-view pose estimation methods are not metric, with camera translation known only up to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yumin Li , Dylan Campbell

We present a deep learning-based multitask framework for joint 3D human pose estimation and action recognition from RGB video sequences. Our approach proceeds along two stages. In the first, we run a real-time 2D pose detector to determine…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

6D pose estimation of textureless objects is a valuable but challenging task for many robotic applications. In this work, we propose a framework to address this challenge using only RGB images acquired from multiple viewpoints. The core…

Robotics · Computer Science 2023-02-23 Jun Yang , Wenjie Xue , Sahar Ghavidel , Steven L. Waslander