English
Related papers

Related papers: Diverse Inpainting and Editing with GAN Inversion

200 papers

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

StyleGAN models show editing capabilities via their semantically interpretable latent organizations which require successful GAN inversion methods to edit real images. Many works have been proposed for inverting images into StyleGAN's…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Ahmet Burak Yildirim , Hamza Pehlivan , Aysegul Dundar

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

Recently, there has been a surge of diverse methods for performing image editing by employing pre-trained unconditional generators. Applying these methods on real images, however, remains a challenge, as it necessarily requires the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Omer Tov , Yuval Alaluf , Yotam Nitzan , Or Patashnik , Daniel Cohen-Or

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

Image inpainting seeks a semantically consistent way to recover the corrupted image in the light of its unmasked content. Previous approaches usually reuse the well-trained GAN as effective prior to generate realistic patches for missing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Yongsheng Yu , Libo Zhang , Heng Fan , Tiejian Luo

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

GAN inversion and editing via StyleGAN maps an input image into the embedding spaces ($\mathcal{W}$, $\mathcal{W^+}$, and $\mathcal{F}$) to simultaneously maintain image fidelity and meaningful manipulation. From latent space $\mathcal{W}$…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hongyu Liu , Yibing Song , Qifeng Chen

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Egor Sevriugov , Ivan Oseledets

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen
‹ Prev 1 2 3 10 Next ›