English
Related papers

Related papers: Consistent 3D Hand Reconstruction in Video via sel…

200 papers

Reconstructing 3D models of dynamic, real-world objects with high-fidelity textures from monocular frame sequences has been a challenging problem in recent years. This difficulty stems from factors such as shadows, indirect illumination,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Alakh Aggarwal , Ningna Wang , Xiaohu Guo

Articulated hand pose estimation is a challenging task for human-computer interaction. The state-of-the-art hand pose estimation algorithms work only with one or a few subjects for which they have been calibrated or trained. Particularly,…

Human-Computer Interaction · Computer Science 2017-12-11 Jameel Malik , Ahmed Elhayek , Didier Stricker

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

The estimation of 3D human body pose and shape from a single image has been extensively studied in recent years. However, the texture generation problem has not been fully discussed. In this paper, we propose an end-to-end learning strategy…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jian Wang , Yunshan Zhong , Yachun Li , Chi Zhang , Yichen Wei

In this paper, we present DIREG3D, a holistic framework for 3D Hand Tracking. The proposed framework is capable of utilizing camera intrinsic parameters, 3D geometry, intermediate 2D cues, and visual information to regress parameters for…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Ashar Ali , Upal Mahbub , Gokce Dane , Gerhard Reitmayr

Estimating 3D hand pose from 2D images is a difficult, inverse problem due to the inherent scale and depth ambiguities. Current state-of-the-art methods train fully supervised deep neural networks with 3D ground-truth data. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Adrian Spurr , Umar Iqbal , Pavlo Molchanov , Otmar Hilliges , Jan Kautz

We propose a robust and accurate method for reconstructing 3D hand mesh from monocular images. This is a very challenging problem, as hands are often severely occluded by objects. Previous works often have disregarded 2D hand pose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Shuaibing Wang , Shunli Wang , Dingkang Yang , Mingcheng Li , Ziyun Qian , Liuzhen Su , Lihua Zhang

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

Detecting and matching robust viewpoint-invariant keypoints is critical for visual SLAM and Structure-from-Motion. State-of-the-art learning-based methods generate training samples via homography adaptation to create 2D synthetic views with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Jiexiong Tang , Rares Ambrus , Vitor Guizilini , Sudeep Pillai , Hanme Kim , Patric Jensfelt , Adrien Gaidon

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , Haichao Zhu

Manually annotating accurate 3D hand poses is extremely time-consuming and labor-intensive. Existing self-supervised hand pose estimation methods leverage the discrepancy between input images and rendered outputs, or multi-view consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianhao Han , Haoyang Zhang , Liang Xie , Haochen Chang , Kun Gao , Yuan Cheng , Pengfei Ren , Erwei Yin

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image. Our approach uses a new neural network architecture that exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Yuxiao Zhou , Marc Habermann , Ikhsanul Habibie , Ayush Tewari , Christian Theobalt , Feng Xu

Reconstructing the hand mesh from one single RGB image is a challenging task because hands are often occluded by other objects. Most previous works attempt to explore more additional information and adopt attention mechanisms for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zixun Jiao , Xihan Wang , Zhaoqiang Xia , Lianhe Shao , Quanli Gao

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

The emergence of virtual reality has necessitated the generation of detailed and customizable 3D hand models for interaction in the virtual world. However, the current methods for 3D hand model generation are both expensive and cumbersome,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Green Rosh , Prateek Kukreja , Vishakha SR , Pawan Prasad B H

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

Deducing a 3D human pose from a single 2D image is inherently challenging because multiple 3D poses can correspond to the same 2D representation. 3D data can resolve this pose ambiguity, but it is expensive to record and requires an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Christian Keilstrup Ingwersen , Rasmus Tirsgaard , Rasmus Nylander , Janus Nørtoft Jensen , Anders Bjorholm Dahl , Morten Rieger Hannemose

This paper presents a simple yet powerful method for 3D human mesh reconstruction from a single RGB image. Most recently, the non-local interactions of the whole mesh vertices have been effectively estimated in the transformer while the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Jeonghwan Kim , Mi-Gyeong Gwon , Hyunwoo Park , Hyukmin Kwon , Gi-Mun Um , Wonjun Kim