English
Related papers

Related papers: High-Quality 3D Head Reconstruction from Any Singl…

200 papers

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Simon Giebenhain , Tobias Kirschstein , Markos Georgopoulos , Martin Rünz , Lourdes Agapito , Matthias Nießner

Advances in 3D reconstruction have enabled high-quality 3D capture, but require a user to collect hundreds to thousands of images to create a 3D scene. We present CAT3D, a method for creating anything in 3D by simulating this real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Ruiqi Gao , Aleksander Holynski , Philipp Henzler , Arthur Brussee , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron , Ben Poole

3D content creation is referred to as one of the most fundamental tasks of computer graphics. And many 3D modeling algorithms from 2D images or curves have been developed over the past several decades. Designers are allowed to align some…

Graphics · Computer Science 2018-06-25 Zhongping Ji , Xiao Qi , Yigang Wang , Gang Xu , Peng Du , Qing Wu

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yushi Lan , Feitong Tan , Di Qiu , Qiangeng Xu , Kyle Genova , Zeng Huang , Sean Fanello , Rohit Pandey , Thomas Funkhouser , Chen Change Loy , Yinda Zhang

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a…

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

We present a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time. Given a single RGB input, our image encoder directly predicts a canonical triplane…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Alex Trevithick , Matthew Chan , Michael Stengel , Eric R. Chan , Chao Liu , Zhiding Yu , Sameh Khamis , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

In this paper, we tackle the problem of 3D human shape estimation from single RGB images. While the recent progress in convolutional neural networks has allowed impressive results for 3D human pose estimation, estimating the full 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Valentin Gabeur , Jean-Sebastien Franco , Xavier Martin , Cordelia Schmid , Gregory Rogez

We focus on reconstructing high-fidelity radiance fields of human heads, capturing their animations over time, and synthesizing re-renderings from novel viewpoints at arbitrary time steps. To this end, we propose a new multi-view capture…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Tobias Kirschstein , Shenhan Qian , Simon Giebenhain , Tim Walter , Matthias Nießner

Traditionally, creating photo-realistic 3D head avatars requires a studio-level multi-view capture setup and expensive optimization during test-time, limiting the use of digital human doubles to the VFX industry or offline renderings. To…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tobias Kirschstein , Javier Romero , Artem Sevastopolsky , Matthias Nießner , Shunsuke Saito

Near-range portrait photographs often contain perspective distortion artifacts that bias human perception and challenge both facial recognition and reconstruction techniques. We present the first deep learning based approach to remove such…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Yajie Zhao , Zeng Huang , Tianye Li , Weikai Chen , Chloe LeGendre , Xinglei Ren , Jun Xing , Ari Shapiro , Hao Li

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

This paper presents a framework for efficient 3D clothed avatar reconstruction. By combining the advantages of the high accuracy of optimization-based methods and the efficiency of learning-based methods, we propose a coarse-to-fine way to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Tingting Liao , Xiaomei Zhang , Yuliang Xiu , Hongwei Yi , Xudong Liu , Guo-Jun Qi , Yong Zhang , Xuan Wang , Xiangyu Zhu , Zhen Lei

Synthesizing high-fidelity head avatars is a central problem for computer vision and graphics. While head avatar synthesis algorithms have advanced rapidly, the best ones still face great obstacles in real-world scenarios. One of the vital…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Dongwei Pan , Long Zhuo , Jingtan Piao , Huiwen Luo , Wei Cheng , Yuxin Wang , Siming Fan , Shengqi Liu , Lei Yang , Bo Dai , Ziwei Liu , Chen Change Loy , Chen Qian , Wayne Wu , Dahua Lin , Kwan-Yee Lin

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

Caricature is a type of artistic style of human faces that attracts considerable attention in the entertainment industry. So far a few 3D caricature generation methods exist and all of them require some caricature information (e.g., a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Zipeng Ye , Mengfei Xia , Yanan Sun , Ran Yi , Minjing Yu , Juyong Zhang , Yu-Kun Lai , Yong-jin Liu

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li

Many deep learning based 3D face reconstruction methods have been proposed recently, however, few of them have applications in games. Current game character customization systems either require players to manually adjust considerable face…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Jiangke Lin , Yi Yuan , Zhengxia Zou