English
Related papers

Related papers: Implicit 3D Human Mesh Recovery using Consistency …

200 papers

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

We propose a method for in-hand 3D scanning of an unknown object with a monocular camera. Our method relies on a neural implicit surface representation that captures both the geometry and the appearance of the object, however, by contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shreyas Hampali , Tomas Hodan , Luan Tran , Lingni Ma , Cem Keskin , Vincent Lepetit

Single-image human mesh recovery provides a compact 3D, person-centric representation that supports analysis, animation, AR and VR, rehabilitation, and human-computer interaction. However, prevailing systems impose an intact-limb prior and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jiaying Ying , Heming Du , Kaihao Zhang , Sean M. Tweedy , Xin Yu

In recent years, point cloud perception tasks have been garnering increasing attention. This paper presents the first attempt to estimate 3D human body mesh from sparse LiDAR point clouds. We found that the major challenge in estimating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Bohao Fan , Wenzhao Zheng , Jianjiang Feng , Jie Zhou

We present an approach for 3D global human mesh recovery from monocular videos recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions and tracks human bodies even when they go outside the camera's field of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ye Yuan , Umar Iqbal , Pavlo Molchanov , Kris Kitani , Jan Kautz

We present deep neural network methodology to reconstruct the 3d pose and shape of people, given an input RGB image. We rely on a recently introduced, expressivefull body statistical 3d human model, GHUM, trained end-to-end, and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Zanfir , William T. Freeman , Rahul Sukthankar , Cristian Sminchisescu

Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images. By directly mapping raw pixels to model parameters, these methods can produce parametric models in a feed-forward manner…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Hongwen Zhang , Yating Tian , Xinchi Zhou , Wanli Ouyang , Yebin Liu , Limin Wang , Zhenan Sun

3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sandro Lombardi , Bangbang Yang , Tianxing Fan , Hujun Bao , Guofeng Zhang , Marc Pollefeys , Zhaopeng Cui

It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model-based approaches are limited to predict the shape and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Lixiang Lin , Jianke Zhu

Existing Human NeRF methods for reconstructing 3D humans typically rely on multiple 2D images from multi-view cameras or monocular videos captured from fixed camera views. However, in real-world scenarios, human images are often captured…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Shoukang Hu , Fangzhou Hong , Liang Pan , Haiyi Mei , Lei Yang , Ziwei Liu

Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Shima Kamyab , Ali Ghodsi , S. Zohreh Azimifar

In this paper, a low parameter deep learning framework utilizing the Non-metric Multi-Dimensional scaling (NMDS) method, is proposed to recover the 3D shape of 2D landmarks on a human face, in a single input image. Hence, NMDS approach is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Shima Kamyab , Zohreh Azimifar

Recognition of human poses and actions is crucial for autonomous systems to interact smoothly with people. However, cameras generally capture human poses in 2D as images and videos, which can have significant appearance variations across…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Ting Liu , Jennifer J. Sun , Long Zhao , Jiaping Zhao , Liangzhe Yuan , Yuxiao Wang , Liang-Chieh Chen , Florian Schroff , Hartwig Adam

We introduce SAM 3D Body (3DB), a promptable model for single-image full-body 3D human mesh recovery (HMR) that demonstrates state-of-the-art performance, with strong generalization and consistent accuracy in diverse in-the-wild conditions.…

While three-dimensional (3D) shape and pose estimation is a highly researched area that has yielded significant advances, the resulting methods, despite performing well for the adult population, generally fail to generalize effectively to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Georgios Chatzichristodoulou , Niki Efthymiou , Panagiotis Filntisis , Georgios Pavlakos , Petros Maragos

We propose a viewpoint invariant model for 3D human pose estimation from a single depth image. To achieve this, our discriminative model embeds local regions into a learned viewpoint invariant feature space. Formulated as a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Albert Haque , Boya Peng , Zelun Luo , Alexandre Alahi , Serena Yeung , Li Fei-Fei

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Raja Kumar , Jiahao Luo , Alex Pang , James Davis

We address the problem of fitting 3D human models to 3D scans of dressed humans. Classical methods optimize both the data-to-model correspondences and the human model parameters (pose and shape), but are reliable only when initialized close…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Bharat Lal Bhatnagar , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

In sports analytics, accurately capturing both the 3D locations and rotations of body joints is essential for understanding an athlete's biomechanics. While Human Mesh Recovery (HMR) models can estimate joint rotations, they often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Katja Ludwig , Yuliia Oksymets , Robin Schön , Daniel Kienzle , Rainer Lienhart

We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured and potentially partial observations of non-rigidly deforming shapes. Our goal is to achieve high-fidelity motion reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer