English
Related papers

Related papers: Realistic Clothed Human and Object Joint Reconstru…

200 papers

We present a novel method to learn temporally consistent 3D reconstruction of clothed people from a monocular video. Recent methods for 3D human reconstruction from monocular video using volumetric, implicit or parametric human shape…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Akin Caliskan , Armin Mustafa , Adrian Hilton

The combination of deep learning, artist-curated scans, and Implicit Functions (IF), is enabling the creation of detailed, clothed, 3D humans from images. However, existing methods are far from perfect. IF-based methods recover free-form…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yuliang Xiu , Jinlong Yang , Xu Cao , Dimitrios Tzionas , Michael J. Black

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

Single-view 3D shape retrieval is a challenging task that is increasingly important with the growth of available 3D data. Prior work that has studied this task has not focused on evaluating how realistic occlusions impact performance, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Qirui Wu , Daniel Ritchie , Manolis Savva , Angel X. Chang

Despite recent research advancements in reconstructing clothed humans from a single image, accurately restoring the "unseen regions" with high-level details remains an unsolved challenge that lacks attention. Existing methods often generate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yangyi Huang , Hongwei Yi , Yuliang Xiu , Tingting Liao , Jiaxiang Tang , Deng Cai , Justus Thies

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

4D reconstruction of human-object interaction is critical for immersive VR/AR experience and human activity understanding. Recent advances still fail to recover fine geometry and texture results from sparse RGB inputs, especially under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Guoxing Sun , Xin Chen , Yizhang Chen , Anqi Pang , Pei Lin , Yuheng Jiang , Lan Xu , Jingya Wang , Jingyi Yu

Dressed people reconstruction from images is a popular task with promising applications in the creative media and game industry. However, most existing methods reconstruct the human body and garments as a whole with the supervision of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yue Shi , Yuxuan Xiong , Jingyi Chai , Bingbing Ni , Wenjun Zhang

Advances in Deep Learning have recently made it possible to recover full 3D meshes of human poses from individual images. However, extension of this notion to videos for recovering temporally coherent poses still remains unexplored. A major…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Jian Liu , Naveed Akhtar , Ajmal Mian

Reconstructing textured 3D human models from a single image is fundamental for AR/VR and digital human applications. However, existing methods mostly focus on single individuals and thus fail in multi-human scenes, where naive composition…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Gwanghyun Kim , Junghun James Kim , Suh Yoon Jeon , Jason Park , Se Young Chun

We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured and potentially partial observations of non-rigidly deforming shapes. Our goal is to achieve high-fidelity motion reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sandro Lombardi , Bangbang Yang , Tianxing Fan , Hujun Bao , Guofeng Zhang , Marc Pollefeys , Zhaopeng Cui

3D object reconstruction is important for semantic scene understanding. It is challenging to reconstruct detailed 3D shapes from monocular images directly due to a lack of depth information, occlusion and noise. Most current methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Ziwei Liao , Steven L. Waslander

We consider the problem of obtaining dense 3D reconstructions of humans from single and partially occluded views. In such cases, the visual evidence is usually insufficient to identify a 3D reconstruction uniquely, so we aim at recovering…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Benjamin Biggs , Sébastien Ehrhadt , Hanbyul Joo , Benjamin Graham , Andrea Vedaldi , David Novotny

High-quality 4D reconstruction of human performance with complex interactions to various objects is essential in real-world scenarios, which enables numerous immersive VR/AR applications. However, recent advances still fail to provide…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Zhuo Su , Lan Xu , Dawei Zhong , Zhong Li , Fan Deng , Shuxue Quan , Lu Fang

Our work aims to reconstruct a 3D object that is held and rotated by a hand in front of a static RGB camera. Previous methods that use implicit neural representations to recover the geometry of a generic hand-held object from multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Shijian Jiang , Qi Ye , Rengan Xie , Yuchi Huo , Xiang Li , Yang Zhou , Jiming Chen

Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible. Deep learning based 3D reconstruction approaches allow us to recover 3D shapes from 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ziyi Chang , George Alex Koulieris , Hubert P. H. Shum

4D modeling of human-object interactions is critical for numerous applications. However, efficient volumetric capture and rendering of complex interaction scenarios, especially from sparse inputs, remain challenging. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yuheng Jiang , Suyi Jiang , Guoxing Sun , Zhuo Su , Kaiwen Guo , Minye Wu , Jingyi Yu , Lan Xu

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hao Zhang , Fang Li , Samyak Rawlekar , Narendra Ahuja