English
Related papers

Related papers: 3D Hand Shape and Pose from Images in the Wild

200 papers

We introduce a neural implicit representation for grasps of objects from multiple robotic hands. Different grasps across multiple robotic hands are encoded into a shared latent space. Each latent vector is learned to decode to the 3D shape…

Robotics · Computer Science 2022-07-11 Ninad Khargonkar , Neil Song , Zesheng Xu , Balakrishnan Prabhakaran , Yu Xiang

As 3D human pose estimation can now be achieved with very high accuracy in the supervised learning scenario, tackling the case where 3D pose annotations are not available has received increasing attention. In particular, several methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Krishna Kanth Nakka , Mathieu Salzmann

We propose a unified formulation for the problem of 3D human pose estimation from a single raw RGB image that reasons jointly about 2D joint estimation and 3D pose reconstruction to improve both tasks. We take an integrated approach that…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Denis Tome , Chris Russell , Lourdes Agapito

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

We address the challenges in estimating 3D human poses from multiple views under occlusion and with limited overlapping views. We approach multi-view, single-person 3D human pose reconstruction as a regression problem and propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Olivier Moliner , Sangxia Huang , Kalle Åström

Human pose analysis has garnered significant attention within both the research community and practical applications, owing to its expanding array of uses, including gaming, video surveillance, sports performance analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Lijuan Zhou , Xiang Meng , Zhihuan Liu , Mengqi Wu , Zhimin Gao , Pichao Wang

Category-level 6D object pose and size estimation is to predict full pose configurations of rotation, translation, and size for object instances observed in single, arbitrary views of cluttered scenes. In this paper, we propose a new method…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiehong Lin , Zewei Wei , Zhihao Li , Songcen Xu , Kui Jia , Yuanqing Li

State-of-the-art methods for 3D hand pose estimation from depth images require large amounts of annotated training data. We propose to model the statistical relationships of 3D hand poses and corresponding depth images using two deep…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

Estimating 3D hand pose from 2D images is a difficult, inverse problem due to the inherent scale and depth ambiguities. Current state-of-the-art methods train fully supervised deep neural networks with 3D ground-truth data. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Adrian Spurr , Umar Iqbal , Pavlo Molchanov , Otmar Hilliges , Jan Kautz

We propose the first approach to the problem of inferring the depth map of a human hand based on a single RGB image. We achieve this with a Convolutional Neural Network (CNN) that employs a stacked hourglass model as its main building…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Vassilis C. Nicodemou , Iason Oikonomidis , Georgios Tzimiropoulos , Antonis Argyros

Learning a good 3D human pose representation is important for human pose related tasks, e.g. human 3D pose estimation and action recognition. Within all these problems, preserving the intrinsic pose information and adapting to view…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Qiang Nie , Ziwei Liu , Yunhui Liu

Non-parametric mesh reconstruction has recently shown significant progress in 3D hand and body applications. In these methods, mesh vertices and edges are visible to neural networks, enabling the possibility to establish a direct mapping…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shijian Jiang , Guwen Han , Danhang Tang , Yang Zhou , Xiang Li , Jiming Chen , Qi Ye

Hand shadow art is a captivating art form, creatively using hand shadows to reproduce expressive shapes on the wall. In this work, we study an inverse problem: given a target shape, find the poses of left and right hands that together best…

Computational Geometry · Computer Science 2025-05-13 Hao Xu , Yinqiao Wang , Niloy J. Mitra , Shuaicheng Liu , Pheng-Ann Heng , Chi-Wing Fu

3D hand pose estimation (HPE) is the process of locating the joints of the hand in 3D from any visual input. HPE has recently received an increased amount of attention due to its key role in a variety of human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Leyla Khaleghi , Joshua Marshall , Ali Etemad

Numerous fields, such as ecology, biology, and neuroscience, use animal recordings to track and measure animal behaviour. Over time, a significant volume of such data has been produced, but some computer vision techniques cannot explore it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Jose Sosa , Sharn Perry , Jane Alty , David Hogg

Recently, 3D hand reconstruction has gained more attention in human-computer cooperation, especially for hand-object interaction scenario. However, it still remains huge challenge due to severe hand-occlusion caused by interaction, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Feng Shuang , Wenbo He , Shaodong Li

We propose DeepMetaHandles, a 3D conditional generative model based on mesh deformation. Given a collection of 3D meshes of a category and their deformation handles (control points), our method learns a set of meta-handles for each shape,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Minghua Liu , Minhyuk Sung , Radomir Mech , Hao Su

In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bosang Kim , Jonghyun Kim , Hyotae Lee , Lanying Jin , Jeongwon Ha , Dowoo Kwon , Jungpyo Kim , Wonhyeok Im , KyungMin Jin , Jungho Lee

Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to factor surface…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Keyang Zhou , Bharat Lal Bhatnagar , Gerard Pons-Moll

The ability to estimate the 3D human shape and pose from images can be useful in many contexts. Recent approaches have explored using graph convolutional networks and achieved promising results. The fact that the 3D shape is represented by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Xin Yu , Jeroen van Baar , Siheng Chen