English
Related papers

Related papers: VariTex: Variational Neural Face Textures

200 papers

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Despite the recent advance of Generative Adversarial Networks (GANs) in high-fidelity image synthesis, there lacks enough understanding of how GANs are able to map a latent code sampled from a random distribution to a photo-realistic image.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yujun Shen , Jinjin Gu , Xiaoou Tang , Bolei Zhou

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

Unsupervised learning of 3D-aware generative adversarial networks has lately made much progress. Some recent work demonstrates promising results of learning human generative models using neural articulated radiance fields, yet their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xinya Chen , Jiaxin Huang , Yanrui Bin , Lu Yu , Yiyi Liao

Hair plays a significant role in personal identity and appearance, making it an essential component of high-quality, photorealistic avatars. Existing approaches either focus on modeling the facial region only or rely on personalized models,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ziyan Wang , Giljoo Nam , Aljaz Bozic , Chen Cao , Jason Saragih , Michael Zollhoefer , Jessica Hodgins

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

We present AvatarTex, a high-fidelity facial texture reconstruction framework capable of generating both stylized and photorealistic textures from a single image. Existing methods struggle with stylized avatars due to the lack of diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuda Qiu , Zitong Xiao , Yiwei Zuo , Zisheng Ye , Weikai Chen , Xiaoguang Han

We propose a new method for learning a generalized animatable neural human representation from a sparse set of multi-view imagery of multiple persons. The learned representation can be used to synthesize novel view images of an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yiming Wang , Qingzhe Gao , Libin Liu , Lingjie Liu , Christian Theobalt , Baoquan Chen

Deep learning-based face recognition continues to face challenges due to its reliance on huge datasets obtained from web crawling, which can be costly to gather and raise significant real-world privacy concerns. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Minsoo Kim , Min-Cheol Sagong , Gi Pyo Nam , Junghyun Cho , Ig-Jae Kim

The modern computer graphics pipeline can synthesize images at remarkable visual quality; however, it requires well-defined, high-quality 3D content as input. In this work, we explore the use of imperfect 3D content, for instance, obtained…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Justus Thies , Michael Zollhöfer , Matthias Nießner

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

Recent facial image synthesis methods have been mainly based on conditional generative models. Sketch-based conditions can effectively describe the geometry of faces, including the contours of facial components, hair structures, as well as…

Graphics · Computer Science 2021-07-20 Shu-Yu Chen , Feng-Lin Liu , Yu-Kun Lai , Paul L. Rosin , Chunpeng Li , Hongbo Fu , Lin Gao

In recent advances of deep generative models, face reenactment -manipulating and controlling human face, including their head movement-has drawn much attention for its wide range of applicability. Despite its strong expressiveness, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Takuya Yashima , Takuya Narihira , Tamaki Kojima

Based on a combined data set of 4000 high resolution facial scans, we introduce a non-linear morphable face model, capable of producing multifarious face geometry of pore-level resolution, coupled with material attributes for use in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Ruilong Li , Karl Bladin , Yajie Zhao , Chinmay Chinara , Owen Ingraham , Pengda Xiang , Xinglei Ren , Pratusha Prasad , Bipin Kishore , Jun Xing , Hao Li

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

Advances in the realm of Generative Adversarial Networks (GANs) have led to architectures capable of producing amazingly realistic images such as StyleGAN2, which, when trained on the FFHQ dataset, generates images of human faces from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mengyu Yang , David Rokeby , Xavier Snelgrove

Semantic image synthesis is a process for generating photorealistic images from a single semantic mask. To enrich the diversity of multimodal image synthesis, previous methods have controlled the global appearance of an output image by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yuki Endo , Yoshihiro Kanamori

This paper investigates a novel problem of generating images from visual attributes. We model the image as a composite of foreground and background and develop a layered generative model with disentangled latent variables that can be…

Machine Learning · Computer Science 2016-10-11 Xinchen Yan , Jimei Yang , Kihyuk Sohn , Honglak Lee

Synthesis of face images from visual attributes is an important problem in computer vision and biometrics due to its applications in law enforcement and entertainment. Recent advances in deep generative networks have made it possible to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Xing Di , Vishal M. Patel