English
Related papers

Related papers: Overparameterization Improves StyleGAN Inversion

200 papers

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anand Bhattad , Viraj Shah , Derek Hoiem , D. A. Forsyth

GAN inversion and editing via StyleGAN maps an input image into the embedding spaces ($\mathcal{W}$, $\mathcal{W^+}$, and $\mathcal{F}$) to simultaneously maintain image fidelity and meaningful manipulation. From latent space $\mathcal{W}$…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hongyu Liu , Yibing Song , Qifeng Chen

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

We propose a novel architecture for GAN inversion, which we call Feature-Style encoder. The style encoder is key for the manipulation of the obtained latent codes, while the feature encoder is crucial for optimal image reconstruction. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim

Recently, a surge of advanced facial editing techniques have been proposed that leverage the generative power of a pre-trained StyleGAN. To successfully edit an image this way, one must first project (or invert) the image into the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Daniel Roich , Ron Mokady , Amit H. Bermano , Daniel Cohen-Or

Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first convert the input image into StyleGAN's latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yin Yu , Ghasedi Kamran , Wu HsiangTao , Yang Jiaolong , Tong Xi , Fu Yun

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

Recent advances in generative adversarial networks (GANs) have opened up the possibility of generating high-resolution photo-realistic images that were impossible to produce previously. The ability of GANs to sample from high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Arthur Conmy , Subhadip Mukherjee , Carola-Bibiane Schönlieb

This paper addresses the problem of super-resolution: constructing a highly resolved (HR) image from a low resolved (LR) one. Recent unsupervised approaches search the latent space of a StyleGAN pre-trained on HR images, for the image that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Marzieh Gheisari , Auguste Genovesio

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Takumi Harada , Kazuyuki Aihara , Hiroyuki Sakai