English
Related papers

Related papers: Diverse Inpainting and Editing with GAN Inversion

200 papers

We propose Image2StyleGAN++, a flexible image editing framework with many applications. Our framework extends the recent Image2StyleGAN in three ways. First, we introduce noise optimization as a complement to the $W^+$ latent space…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Rameen Abdal , Yipeng Qin , Peter Wonka

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

Interactive fashion image manipulation, which enables users to edit images with sketches and color strokes, is an interesting research problem with great application value. Existing works often treat it as a general inpainting task and do…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Haoye Dong , Xiaodan Liang , Yixuan Zhang , Xujie Zhang , Zhenyu Xie , Bowen Wu , Ziqi Zhang , Xiaohui Shen , Jian Yin

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for…

Machine Learning · Computer Science 2021-04-22 Anton Cherepkov , Andrey Voynov , Artem Babenko

Image inpainting is a widely used technique in computer vision for reconstructing missing or damaged pixels in images. Recent advancements with Generative Adversarial Networks (GANs) have demonstrated superior performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Nafiz Al Asad , Md. Appel Mahmud Pranto , Shbiruzzaman Shiam , Musaddeq Mahmud Akand , Mohammad Abu Yousuf , Khondokar Fida Hasan , Mohammad Ali Moni

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

Modern Generative Adversarial Networks are capable of creating artificial, photorealistic images from latent vectors living in a low-dimensional learned latent space. It has been shown that a wide range of images can be projected into this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Jonas Wulff , Antonio Torralba

We present a novel high-fidelity generative adversarial network (GAN) inversion framework that enables attribute editing with image-specific details well-preserved (e.g., background, appearance, and illumination). We first analyze the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Tengfei Wang , Yong Zhang , Yanbo Fan , Jue Wang , Qifeng Chen

Area of image inpainting over relatively large missing regions recently advanced substantially through adaptation of dedicated deep neural networks. However, current network solutions still introduce undesired artifacts and noise to the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Ugur Demir , Gozde Unal

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Generative Adversarial Networks (GANs) can synthesize abundant photo-realistic synthetic aperture radar (SAR) images. Some recent GANs (e.g., InfoGAN), are even able to edit specific properties of the synthesized images by introducing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhenpeng Feng , Milos Dakovic , Hongbing Ji , Mingzhe Zhu , Ljubisa Stankovic

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

The task of inverting real images into StyleGAN's latent space to manipulate their attributes has been extensively studied. However, existing GAN inversion methods struggle to balance high reconstruction quality, effective editability, and…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Jhon Lopez , Carlos Hinojosa , Henry Arguello , Bernard Ghanem

In this short report, we present a simple, yet effective approach to editing real images via generative adversarial networks (GAN). Unlike previous techniques, that treat all editing tasks as an operation that affects pixel values in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 David Futschik , Michal Lukáč , Eli Shechtman , Daniel Sýkora

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

The last decades are marked by massive and diverse image data, which shows increasingly high resolution and quality. However, some images we obtained may be corrupted, affecting the perception and the application of downstream tasks. A…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Yanbo Wang , Chuming Lin , Donghao Luo , Ying Tai , Zhizhong Zhang , Yuan Xie

Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms are usually required…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Min Jin Chong , Hsin-Ying Lee , David Forsyth