English
Related papers

Related papers: Prior-Guided Multi-View 3D Head Reconstruction

200 papers

We present a deep learning pipeline that leverages network self-prior to recover a full 3D model consisting of both a triangular mesh and a texture map from the colored 3D point cloud. Different from previous methods either exploiting 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Xingkui Wei , Zhengqing Chen , Yanwei Fu , Zhaopeng Cui , Yinda Zhang

Many learning-based approaches have difficulty scaling to unseen data, as the generality of its learned prior is limited to the scale and variations of the training samples. This holds particularly true with 3D learning tasks, given the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Mingyue Yang , Yuxin Wen , Weikai Chen , Yongwei Chen , Kui Jia

Recent advances in 3D perception have shown impressive progress in understanding geometric structures of 3Dshapes and even scenes. Inspired by these advances in geometric understanding, we aim to imbue image-based perception with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Ji Hou , Saining Xie , Benjamin Graham , Angela Dai , Matthias Nießner

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Single-view 3D hair reconstruction is challenging, due to the wide range of shape variations among diverse hairstyles. Current state-of-the-art methods are specialized in recovering un-braided 3D hairs and often take braided styles as their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yujian Zheng , Yuda Qiu , Leyang Jin , Chongyang Ma , Haibin Huang , Di Zhang , Pengfei Wan , Xiaoguang Han

Undoubtedly, high-fidelity 3D hair plays an indispensable role in digital humans. However, existing monocular hair modeling methods are either tricky to deploy in digital systems (e.g., due to their dependence on complex user interactions…

Graphics · Computer Science 2022-05-10 Keyu Wu , Yifan Ye , Lingchen Yang , Hongbo Fu , Kun Zhou , Youyi Zheng

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

Implicit neural representations, represented by Neural Radiance Fields (NeRF), have dominated research in 3D computer vision by virtue of high-quality visual results and data-driven benefits. However, their realistic applications are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yaokun Li , Chao Gou , Guang Tan

This paper addresses the problem of reconstructing a scene online at the level of objects given an RGB-D video sequence. While current object-aware neural implicit representations hold promise, they are limited in online reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Thomas Chabal , Shizhe Chen , Jean Ponce , Cordelia Schmid

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

We address the problem of recovering the 3D geometry of a human face from a set of facial images in multiple views. While recent studies have shown impressive progress in 3D Morphable Model (3DMM) based facial reconstruction, the settings…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fanzi Wu , Linchao Bao , Yajing Chen , Yonggen Ling , Yibing Song , Songnan Li , King Ngi Ngan , Wei Liu

Learning neural implicit representations has achieved remarkable performance in 3D reconstruction from multi-view images. Current methods use volume rendering to render implicit representations into either RGB or depth images that are…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Pengchong Hu , Zhizhong Han

The reconstruction of indoor scenes from multi-view RGB images is challenging due to the coexistence of flat and texture-less regions alongside delicate and fine-grained regions. Recent methods leverage neural radiance fields aided by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Sheng Ye , Yubin Hu , Matthieu Lin , Yu-Hui Wen , Wang Zhao , Yong-Jin Liu , Wenping Wang

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Ziyi Chen , Xiaolong Wu , Yu Zhang

We present an approach for the reconstruction of textured 3D meshes of human heads from one or few views. Since such few-shot reconstruction is underconstrained, it requires prior knowledge which is hard to impose on traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Egor Burkov , Ruslan Rakhimov , Aleksandr Safin , Evgeny Burnaev , Victor Lempitsky

State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge. However, most of these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xiaobin Hu , Wenqi Ren , John LaMaster , Xiaochun Cao , Xiaoming Li , Zechao Li , Bjoern Menze , Wei Liu

Signed Distance Functions (SDFs) are vital implicit representations to represent high fidelity 3D surfaces. Current methods mainly leverage a neural network to learn an SDF from various supervisions including signed distances, 3D point…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chao Chen , Yu-Shen Liu , Zhizhong Han

Recently, deep learning-based 3D face reconstruction methods have demonstrated promising advancements in terms of quality and efficiency. Nevertheless, these techniques face challenges in effectively handling occluded scenes and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dapeng Zhao

Decompositional reconstruction of 3D scenes, with complete shapes and detailed texture of all objects within, is intriguing for downstream applications but remains challenging, particularly with sparse views as input. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Junfeng Ni , Yu Liu , Ruijie Lu , Zirui Zhou , Song-Chun Zhu , Yixin Chen , Siyuan Huang