English
Related papers

Related papers: Overparameterization Improves StyleGAN Inversion

200 papers

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

In StyleGAN, convolution kernels are shaped by both static parameters shared across images and dynamic modulation factors $w^+\in\mathcal{W}^+$ specific to each image. Therefore, $\mathcal{W}^+$ space is often used for image inversion and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Siwei Xia , Xueqi Hu , Li Sun , Qingli Li

GAN inversion aims to invert an input image into the latent space of a pre-trained GAN. Despite the recent advances in GAN inversion, there remain challenges to mitigate the tradeoff between distortion and editability, i.e. reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xudong Mao , Liujuan Cao , Aurele T. Gnanha , Zhenguo Yang , Qing Li , Rongrong Ji

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Current methods for image-to-image translation produce compelling results, however, the applied transformation is difficult to control, since existing mechanisms are often limited and non-intuitive. We propose ParGAN, a generalization of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

We propose Image2StyleGAN++, a flexible image editing framework with many applications. Our framework extends the recent Image2StyleGAN in three ways. First, we introduce noise optimization as a complement to the $W^+$ latent space…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Rameen Abdal , Yipeng Qin , Peter Wonka

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHQ…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Rameen Abdal , Yipeng Qin , Peter Wonka

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance this input so that the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yangyang Xu Zeyang Zhou , Shengfeng He