English
Related papers

Related papers: Designing an Encoder for StyleGAN Image Manipulati…

200 papers

In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Shuai Yang , Kai Qiao

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHQ…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Rameen Abdal , Yipeng Qin , Peter Wonka

3D GAN inversion aims to project a single image into the latent space of a 3D Generative Adversarial Network (GAN), thereby achieving 3D geometry reconstruction. While there exist encoders that achieve good results in 3D GAN inversion, they…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bahri Batuhan Bilecen , Ahmet Berke Gokmen , Aysegul Dundar

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyoungkook Kang , Seongtae Kim , Sunghyun Cho

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

The task of age transformation illustrates the change of an individual's appearance over time. Accurately modeling this complex transformation over an input facial image is extremely challenging as it requires making convincing, possibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Several research groups have shown that Generative Adversarial Networks (GANs) can generate photo-realistic images in recent years. Using the GANs, a map is created between a latent code and a photo-realistic image. This process can also be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Andrea Giardina , Soumya Subhra Paria , Adhikari Kaustubh

Intrinsic images, in the original sense, are image-like maps of scene properties like depth, normal, albedo or shading. This paper demonstrates that StyleGAN can easily be induced to produce intrinsic images. The procedure is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Anand Bhattad , Daniel McKee , Derek Hoiem , D. A. Forsyth

Image inpainting seeks a semantically consistent way to recover the corrupted image in the light of its unmasked content. Previous approaches usually reuse the well-trained GAN as effective prior to generate realistic patches for missing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Yongsheng Yu , Libo Zhang , Heng Fan , Tiejian Luo

As research on image inversion advances, the process is generally divided into two stages. The first step is Image Embedding, involves using an encoder or optimization procedure to embed an image and obtain its corresponding latent code.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Xuekun Zhao , Pu Cao , Xiaoya Yang , Mingjian Zhang , Lu Yang , Qing Song

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka

We tackle the task of NeRF inversion for style-based neural radiance fields, (e.g., StyleNeRF). In the task, we aim to learn an inversion function to project an input image to the latent space of a NeRF generator and then synthesize novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yu-Jhe Li , Tao Xu , Bichen Wu , Ningyuan Zheng , Xiaoliang Dai , Albert Pumarola , Peizhao Zhang , Peter Vajda , Kris Kitani

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kushal Jain , Ankith Varun J , Anoop Namboodiri

3D GAN inversion aims to achieve high reconstruction fidelity and reasonable 3D geometry simultaneously from a single image input. However, existing 3D GAN inversion methods rely on time-consuming optimization for each individual case. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ziyang Yuan , Yiming Zhu , Yu Li , Hongyu Liu , Chun Yuan

Existing GAN inversion methods are stuck in a paradox that the inverted codes can either achieve high-fidelity reconstruction, or retain the editing capability. Having only one of them clearly cannot realize real image editing. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Yangyang Xu , Yong Du , Wenpeng Xiao , Xuemiao Xu , Shengfeng He