English
Related papers

Related papers: DeepHandMesh: A Weakly-supervised Deep Encoder-Dec…

200 papers

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

With an enormous number of hand images generated over time, unleashing pose knowledge from unlabeled images for supervised hand mesh estimation is an emerging yet challenging topic. To alleviate this issue, semi-supervised and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zuyan Liu , Gaojie Lin , Congyi Wang , Min Zheng , Feida Zhu

Transformer encoder architectures have recently achieved state-of-the-art results on monocular 3D human mesh reconstruction, but they require a substantial number of parameters and expensive computations. Due to the large memory overhead…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Junhyeong Cho , Kim Youwang , Tae-Hyun Oh

Reconstructing hand-held objects from monocular RGB images is an appealing yet challenging task. In this task, contacts between hands and objects provide important cues for recovering the 3D geometry of the hand-held objects. Though recent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Junxing Hu , Hongwen Zhang , Zerui Chen , Mengcheng Li , Yunlong Wang , Yebin Liu , Zhenan Sun

Despite the impressive performance obtained by recent single-image hand modeling techniques, they lack the capability to capture sufficient details of the 3D hand mesh. This deficiency greatly limits their applications when high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Tianyu Luan , Yuanhao Zhai , Jingjing Meng , Zhong Li , Zhang Chen , Yi Xu , Junsong Yuan

Virtual reality has proved to be useful in applications in several fields ranging from gaming, medicine, and training to development of interfaces that enable human-robot collaboration. It empowers designers to explore applications outside…

Human-Computer Interaction · Computer Science 2023-07-24 Debasmita Mukherjee , Ritwik Singhai , Homayoun Najjaran

Multi-view hand mesh reconstruction is a critical task for applications in virtual reality and human-computer interaction, but it remains a formidable challenge. Although existing multi-view hand reconstruction methods achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jian Yang , Jiakun Li , Guoming Li , Zhen Shen , Huai-Yu Wu , Zhaoxin Fan , Heng Huang

We present HiFiHR, a high-fidelity hand reconstruction approach that utilizes render-and-compare in the learning-based framework from a single image, capable of generating visually plausible and accurate 3D hand meshes while recovering…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jiayin Zhu , Zhuoran Zhao , Linlin Yang , Angela Yao

Direct mesh fitting for 3D hand shape reconstruction is highly accurate. However, the reconstructed meshes are prone to artifacts and do not appear as plausible hand shapes. Conversely, parametric models like MANO ensure plausible hand…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Ziwei Yu , Chen Li , Linlin Yang , Xiaoxu Zheng , Michael Bi Mi , Gim Hee Lee , Angela Yao

Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to factor surface…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Keyang Zhou , Bharat Lal Bhatnagar , Gerard Pons-Moll

3D hand-mesh reconstruction from RGB images facilitates many applications, including augmented reality (AR). However, this requires not only real-time speed and accurate hand pose and shape but also plausible mesh-image alignment. While…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiao Tang , Tianyu Wang , Chi-Wing Fu

We present a novel deep learning architecture for fusing static multi-exposure images. Current multi-exposure fusion (MEF) approaches use hand-crafted features to fuse input sequence. However, the weak hand-crafted representations are not…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 K. Ram Prabhakar , V. Sai Srikar , R. Venkatesh Babu

Human hands possess remarkable dexterity and have long served as a source of inspiration for robotic manipulation. In this work, we propose a human $\textbf{H}$and$\textbf{-In}$formed visual representation learning framework to solve…

Machine Learning · Computer Science 2023-10-16 Yanjie Ze , Yuyao Liu , Ruizhe Shi , Jiaxin Qin , Zhecheng Yuan , Jiashun Wang , Huazhe Xu

Reconstructing 3D hand meshes from monocular RGB images has attracted increasing amount of attention due to its enormous potential applications in the field of AR/VR. Most state-of-the-art methods attempt to tackle this task in an anonymous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Deying Kong , Linguang Zhang , Liangjian Chen , Haoyu Ma , Xiangyi Yan , Shanlin Sun , Xingwei Liu , Kun Han , Xiaohui Xie

The human hand is the main medium through which we interact with our surroundings, making its digitization an important problem. While there are several works modeling the geometry of hands, little attention has been paid to capturing…

Accurately recovering the dense 3D mesh of both hands from monocular images poses considerable challenges due to occlusions and projection ambiguity. Most of the existing methods extract features from color images to estimate the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jinwei Ren , Jianke Zhu

3D reconstruction of hand-object manipulations is important for emulating human actions. Most methods dealing with challenging object manipulation scenarios, focus on hands reconstruction in isolation, ignoring physical and kinematic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Ahmed Tawfik Aboukhadra , Jameel Malik , Nadia Robertini , Ahmed Elhayek , Didier Stricker

We present in this work the first end-to-end deep learning based method that predicts both 3D hand shape and pose from RGB images in the wild. Our network consists of the concatenation of a deep convolutional encoder, and a fixed…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Adnane Boukhayma , Rodrigo de Bem , Philip H. S. Torr

We present a novel deep learning-based approach to the 3D reconstruction of clothed humans using weak supervision via 2D normal maps. Given a single RGB image or multiview images, our network infers a signed distance function (SDF)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jane Wu , Diego Thomas , Ronald Fedkiw

3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases. Current state-of-the art methods focus on estimating dense…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Qingjie Meng , Wenjia Bai , Declan P O'Regan , and Daniel Rueckert