English
Related papers

Related papers: SelfRecon: Self Reconstruction Your Digital Avatar…

200 papers

High-quality, animatable 3D human avatar reconstruction from monocular videos offers significant potential for reducing reliance on complex hardware, making it highly practical for applications in game development, augmented reality, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Xia Yuan , Hai Yuan , Wenyi Ge , Ying Fu , Xi Wu , Guanyu Xing

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one coupling feature,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Sun Yu , Ye Yun , Liu Wu , Gao Wenpeng , Fu YiLi , Mei Tao

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Reconstructing 3D clothed humans from monocular camera data is highly challenging due to viewpoint limitations and image ambiguity. While implicit function-based approaches, combined with prior knowledge from parametric models, have made…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yong Deng , Baoxing Li , Xu Zhao

Monocular 3D reconstruction of articulated object categories is challenging due to the lack of training data and the inherent ill-posedness of the problem. In this work we use video self-supervision, forcing the consistency of consecutive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Filippos Kokkinos , Iasonas Kokkinos

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hao Zhang , Fang Li , Samyak Rawlekar , Narendra Ahuja

Articulated 3D reconstruction has valuable applications in various domains, yet it remains costly and demands intensive work from domain experts. Recent advancements in template-free learning methods show promising results with monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Tao Tu , Ming-Feng Li , Chieh Hubert Lin , Yen-Chi Cheng , Min Sun , Ming-Hsuan Yang

Reconstructing complete and animatable 3D human avatars from monocular videos remains challenging, particularly under severe occlusions. While 3D Gaussian Splatting has enabled photorealistic human rendering, existing methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jinlong Fan , Shanshan Zhao , Liang Zheng , Jing Zhang , Yuxiang Yang , Mingming Gong

Current monocular 3D scene reconstruction (3DR) works are either fully-supervised, or not generalizable, or implicit in 3D representation. We propose a novel framework - MonoSelfRecon that for the first time achieves explicit 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Runfa Li , Upal Mahbub , Vasudev Bhaskaran , Truong Nguyen

We address the issue of physical implausibility in multi-view neural reconstruction. While implicit representations have gained popularity in multi-view 3D reconstruction, previous work struggles to yield physically plausible results,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Junfeng Ni , Yixin Chen , Bohan Jing , Nan Jiang , Bin Wang , Bo Dai , Puhao Li , Yixin Zhu , Song-Chun Zhu , Siyuan Huang

It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model-based approaches are limited to predict the shape and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Lixiang Lin , Jianke Zhu

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Recent breakthroughs in single-image 3D portrait reconstruction have enabled telepresence systems to stream 3D portrait videos from a single camera in real-time, potentially democratizing telepresence. However, per-frame 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Shengze Wang , Xueting Li , Chao Liu , Matthew Chan , Michael Stengel , Josef Spjut , Henry Fuchs , Shalini De Mello , Koki Nagano

We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffer from artifacts, where bodies float above the ground or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tanuj Sur , Shashank Tripathi , Nikos Athanasiou , Ha Linh Nguyen , Kai Xu , Michael J. Black , Angela Yao

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details as additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Xingyu Ren , Alexandros Lattas , Baris Gecer , Jiankang Deng , Chao Ma , Xiaokang Yang , Stefanos Zafeiriou

We propose Mesh4D, a feed-forward model for monocular 4D mesh reconstruction. Given a monocular video of a dynamic object, our model reconstructs the object's complete 3D shape and motion, represented as a deformation field. Our key…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zeren Jiang , Chuanxia Zheng , Iro Laina , Diane Larlus , Andrea Vedaldi

Self-occlusion is common when capturing people in the wild, where the performer do not follow predefined motion scripts. This challenges existing monocular human reconstruction systems that assume full body visibility. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhuoyang Pan , Angjoo Kanazawa , Hang Gao

Current methods for learning realistic and animatable 3D clothed avatars need either posed 3D scans or 2D images with carefully controlled user poses. In contrast, our goal is to learn an avatar from only 2D images of people in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuliang Xiu , Jinlong Yang , Dimitrios Tzionas , Michael J. Black

Monocular video human mesh recovery is essential for digital humans, avatar animation, and embodied simulation, where both temporal stability and expressive whole-body motion are required. Existing video HMR methods produce coherent body…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Wenhao Shen , Ming Zhou , Hengyuan Zhang , Siyuan Bian , Youjiang Xu , Xi Lin