English
Related papers

Related papers: Self-Supervised Geometry-Aware Encoder for Style-B…

200 papers

Recently, deep learning-based 3D face reconstruction methods have demonstrated promising advancements in terms of quality and efficiency. Nevertheless, these techniques face challenges in effectively handling occluded scenes and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dapeng Zhao

Our goal with this survey is to provide an overview of the state of the art deep learning methods for face generation and editing using StyleGAN. The survey covers the evolution of StyleGAN, from PGGAN to StyleGAN3, and explores relevant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Andrew Melnik , Maksim Miasayedzenkau , Dzianis Makarovets , Dzianis Pirshtuk , Eren Akbulut , Dennis Holzmann , Tarek Renusch , Gustav Reichert , Helge Ritter

Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods generate only one result for each masked image, even though there…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Dongsik Yoon , Jeong-gi Kwak , Yuanming Li , David Han , Hanseok Ko

Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering images from different camera viewpoints. This prevents them…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yue Wu , Yu Deng , Jiaolong Yang , Fangyun Wei , Qifeng Chen , Xin Tong

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for…

Machine Learning · Computer Science 2021-04-22 Anton Cherepkov , Andrey Voynov , Artem Babenko

In this paper, we address the challenging problem of 3D toonification, which involves transferring the style of an artistic domain onto a target 3D face with stylized geometry and texture. Although fine-tuning a pre-trained 3D GAN on the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Junzhe Zhang , Yushi Lan , Shuai Yang , Fangzhou Hong , Quan Wang , Chai Kiat Yeo , Ziwei Liu , Chen Change Loy

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Wonjoon Jin , Nuri Ryu , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

Empirical works suggest that various semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to generate images. To perform real image editing, it requires an accurate mapping from the real image to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Guangjie Leng , Yekun Zhu , Zhi-Qin John Xu

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

Advances in the realm of Generative Adversarial Networks (GANs) have led to architectures capable of producing amazingly realistic images such as StyleGAN2, which, when trained on the FFHQ dataset, generates images of human faces from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mengyu Yang , David Rokeby , Xavier Snelgrove

Recently, deep learning-based 3D face reconstruction methods have demonstrated promising advancements in terms of quality and efficiency. Nevertheless, these techniques face challenges in effectively handling occluded scenes and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dapeng Zhao

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Recently, a surge of advanced facial editing techniques have been proposed that leverage the generative power of a pre-trained StyleGAN. To successfully edit an image this way, one must first project (or invert) the image into the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Daniel Roich , Ron Mokady , Amit H. Bermano , Daniel Cohen-Or

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

Machine Learning · Computer Science 2021-02-25 Toan Pham Van , Tam Minh Nguyen , Ngoc N. Tran , Hoai Viet Nguyen , Linh Bao Doan , Huy Quang Dao , Thanh Ta Minh

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

StyleGAN2 was demonstrated to be a powerful image generation engine that supports semantic editing. However, in order to manipulate a real-world image, one first needs to be able to retrieve its corresponding latent representation in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Erez Sheffi , Michael Rotman , Lior Wolf

GAN inversion is indispensable for applying the powerful editability of GAN to real images. However, existing methods invert video frames individually often leading to undesired inconsistent results over time. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yangyang Xu , Shengfeng He , Kwan-Yee K. Wong , Ping Luo

As research on image inversion advances, the process is generally divided into two stages. The first step is Image Embedding, involves using an encoder or optimization procedure to embed an image and obtain its corresponding latent code.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Xuekun Zhao , Pu Cao , Xiaoya Yang , Mingjian Zhang , Lu Yang , Qing Song