English
Related papers

Related papers: Freestyle 3D-Aware Portrait Synthesis Based on Com…

200 papers

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

While 2D generative adversarial networks have enabled high-resolution image synthesis, they largely lack an understanding of the 3D world and the image formation process. Thus, they do not provide precise control over camera viewpoint or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Katja Schwarz , Yiyi Liao , Michael Niemeyer , Andreas Geiger

Recently, 3D generative domain adaptation has emerged to adapt the pre-trained generator to other domains without collecting massive datasets and camera pose distributions. Typically, they leverage large-scale pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hengjia Li , Yang Liu , Yibo Zhao , Haoran Cheng , Yang Yang , Linxuan Xia , Zekai Luo , Qibo Qiu , Boxi Wu , Tu Zheng , Zheng Yang , Deng Cai

With the remarkable recent progress on learning deep generative models, it becomes increasingly interesting to develop models for controllable image synthesis from reconfigurable inputs. This paper focuses on a recent emerged task,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Sun , Tianfu Wu

We propose a novel multi-texture synthesis model based on generative adversarial networks (GANs) with a user-controllable mechanism. The user control ability allows to explicitly specify the texture which should be generated by the model.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Aibek Alanov , Max Kochurov , Denis Volkhonskiy , Daniil Yashkov , Evgeny Burnaev , Dmitry Vetrov

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Aviv Gabbay , Yedid Hoshen

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

Recently, synthesizing personalized characters from a single user-given portrait has received remarkable attention as a drastic popularization of social media and the metaverse. The input image is not always in frontal view, thus it is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , David Han , Hanseok Ko

We present RodinHD, which can generate high-fidelity 3D avatars from a portrait image. Existing methods fail to capture intricate details such as hairstyles which we tackle in this paper. We first identify an overlooked problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Bowen Zhang , Yiji Cheng , Chunyu Wang , Ting Zhang , Jiaolong Yang , Yansong Tang , Feng Zhao , Dong Chen , Baining Guo

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Runchuan Zhu , Naye Ji , Youbing Zhao , Fan Zhang

In this paper we present, to the best of our knowledge, the first method to learn a generative model of 3D shapes from natural images in a fully unsupervised way. For example, we do not use any ground truth 3D or 2D annotations, stereo…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Attila Szabó , Givi Meishvili , Paolo Favaro

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

The advance of Generative Adversarial Networks (GANs) enables realistic face image synthesis. However, synthesizing face images that preserve facial identity as well as have high diversity within each identity remains challenging. To…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yujun Shen , Bolei Zhou , Ping Luo , Xiaoou Tang

Rendering novel, relit views of a human head, given a monocular portrait image as input, is an inherently underconstrained problem. The traditional graphics solution is to explicitly decompose the input image into geometry, material and…

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Advances in face rotation, along with other face-based generative tasks, are more frequent as we advance further in topics of deep learning. Even as impressive milestones are achieved in synthesizing faces, the importance of preserving…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Yu Yin , Joseph P. Robinson , Songyao Jiang , Yue Bai , Can Qin , Yun Fu

We propose a new procedure to guide training of a data-driven shape generative model using a structure-aware loss function. Complex 3D shapes often can be summarized using a coarsely defined structure which is consistent and robust across…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Elena Balashova , Vivek Singh , Jiangping Wang , Brian Teixeira , Terrence Chen , Thomas Funkhouser

Talking head synthesis, an advanced method for generating portrait videos from a still image driven by specific content, has garnered widespread attention in virtual reality, augmented reality and game production. Recently, significant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Ming Meng , Yufei Zhao , Bo Zhang , Yonggui Zhu , Weimin Shi , Maxwell Wen , Zhaoxin Fan

We present Free-HeadGAN, a person-generic neural talking head synthesis system. We show that modeling faces with sparse 3D facial landmarks are sufficient for achieving state-of-the-art generative performance, without relying on strong…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Michail Christos Doukas , Evangelos Ververas , Viktoriia Sharmanska , Stefanos Zafeiriou

This article presents an evolutionary approach for synthetic human portraits generation based on the latent space exploration of a generative adversarial network. The idea is to produce different human face images very similar to a given…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Benjamín Machín , Sergio Nesmachnow , Jamal Toutouh