English
Related papers

Related papers: Self-supervised Re-renderable Facial Albedo Recons…

200 papers

Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yu Deng , Jiaolong Yang , Sicheng Xu , Dong Chen , Yunde Jia , Xin Tong

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

In this study, we introduce a novel two-stage technique for decomposing and reconstructing facial features from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Daisheng Jin , Jiangbei Hu , Baixin Xu , Yuxin Dai , Chen Qian , Ying He

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

State-of-the-art methods for 3D reconstruction of faces from a single image require 2D-3D pairs of ground-truth data for supervision. Such data is costly to acquire, and most datasets available in the literature are restricted to pairs for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Yifan Xing , Rahul Tewari , Paulo R. S. Mendonca

In recent years, there has been significant progress in 2D generative face models fueled by applications such as animation, synthetic data generation, and digital avatars. However, due to the absence of 3D information, these 2D models often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Aashish Rai , Hiresh Gupta , Ayush Pandey , Francisco Vicente Carrasco , Shingo Jason Takagi , Amaury Aubel , Daeil Kim , Aayush Prakash , Fernando de la Torre

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Recovering the 3D structure of an object from a single image is a challenging task due to its ill-posed nature. One approach is to utilize the plentiful photos of the same object category to learn a strong 3D shape prior for the object.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Long-Nhat Ho , Anh Tuan Tran , Quynh Phung , Minh Hoai

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details as additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Xingyu Ren , Alexandros Lattas , Baris Gecer , Jiankang Deng , Chao Ma , Xiaokang Yang , Stefanos Zafeiriou

Over the last years, many face analysis tasks have accomplished astounding performance, with applications including face generation and 3D face reconstruction from a single "in-the-wild" image. Nevertheless, to the best of our knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Abhijeet Ghosh , Stefanos Zafeiriou

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses. This is because the uncertainty of the estimated 2D landmarks will affect the quality of face reconstruction. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Kun Li , Jing Yang , Nianhong Jiao , Jinsong Zhang , Yu-Kun Lai

Reconstructing human avatars using generative priors is essential for achieving versatile and realistic avatar models. Traditional approaches often rely on volumetric representations guided by generative models, but these methods require…

Graphics · Computer Science 2025-11-12 Jiacheng Wu , Ruiqi Zhang , Jie Chen

Previous face inverse rendering methods often require synthetic data with ground truth and/or professional equipment like a lighting stage. However, a model trained on synthetic data or using pre-defined lighting priors is typically unable…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Meng Wang , Xiaojie Guo , Wenjing Dai , Jiawan Zhang

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

We present a novel 3D face reconstruction technique that leverages sparse photometric stereo (PS) and latest advances on face registration/modeling from a single image. We observe that 3D morphable faces approach provides a reasonable…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Xuan Cao , Zhang Chen , Anpei Chen , Xin Chen , Cen Wang , Jingyi Yu

Recent works have shown exciting results in unsupervised image de-rendering -- learning to decompose 3D shape, appearance, and lighting from single-image collections without explicit supervision. However, many of these assume simplistic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Shangzhe Wu , Ameesh Makadia , Jiajun Wu , Noah Snavely , Richard Tucker , Angjoo Kanazawa

This paper presents a novel framework to recover \emph{detailed} avatar from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, texture, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Hao Zhu , Xinxin Zuo , Haotian Yang , Sen Wang , Xun Cao , Ruigang Yang

This paper presents a method to reconstruct high-quality textured 3D models from both multi-view and single-view images. The reconstruction is posed as an adaptation problem and is done progressively where in the first stage, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro