English
Related papers

Related papers: Diverse Inpainting and Editing with GAN Inversion

200 papers

We present a generic image-to-image translation framework, pixel2style2pixel (pSp). Our pSp framework is based on a novel encoder network that directly generates a series of style vectors which are fed into a pretrained StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Elad Richardson , Yuval Alaluf , Or Patashnik , Yotam Nitzan , Yaniv Azar , Stav Shapiro , Daniel Cohen-Or

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pramuditha Perera , Mahdi Abavisani , Vishal M. Patel

Deep neural advancements have recently brought remarkable image synthesis performance to the field of image inpainting. The adaptation of generative adversarial networks (GAN) in particular has accelerated significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Dongmin Cha , Daijin Kim

Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing with large holes in complex images. This is partially due to the lack of effective network structures that can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi , Jiebo Luo

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

In image editing, the most common task is pasting objects from one image to the other and then eventually adjusting the manifestation of the foreground object with the background object. This task is called image compositing. But image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shivangi Aneja , Soham Mazumder

StyleGAN has demonstrated the ability of GANs to synthesize highly-realistic faces of imaginary people from random noise. One limitation of GAN-based image generation is the difficulty of controlling the features of the generated image, due…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Zhuo He , Paul Henderson , Nicolas Pugeault

We study the 3D-aware image attribute editing problem in this paper, which has wide applications in practice. Recent methods solved the problem by training a shared encoder to map images into a 3D generator's latent space or by per-image…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Jianhui Li , Jianmin Li , Haoji Zhang , Shilong Liu , Zhengyi Wang , Zihao Xiao , Kaiwen Zheng , Jun Zhu

Inpainting is a learned interpolation technique that is based on generative modeling and used to populate masked or missing pieces in an image; it has wide applications in picture editing and retouching. Recently, inpainting started being…

Machine Learning · Computer Science 2021-06-02 David Khachaturov , Ilia Shumailov , Yiren Zhao , Nicolas Papernot , Ross Anderson

The Generator of a Generative Adversarial Network (GAN) is trained to transform latent vectors drawn from a prior distribution into realistic looking photos. These latent vectors have been shown to encode information about the content of…

Machine Learning · Computer Science 2018-10-10 Nicholas Egan , Jeffrey Zhang , Kevin Shen

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Hendrik Strobelt , William Peebles , Jonas Wulff , Bolei Zhou , Jun-Yan Zhu , Antonio Torralba

Generative adversarial nets (GANs) have been successfully applied in many fields like image generation, inpainting, super-resolution and drug discovery, etc., by now, the inner process of GANs is far from been understood. To get deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Ziqiang Li , Rentuo Tao , Hongjing Niu , Bin Li

Intrinsic images, in the original sense, are image-like maps of scene properties like depth, normal, albedo or shading. This paper demonstrates that StyleGAN can easily be induced to produce intrinsic images. The procedure is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Anand Bhattad , Daniel McKee , Derek Hoiem , D. A. Forsyth

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Image Inpainting is one of the very popular tasks in the field of image processing with broad applications in computer vision. In various practical applications, images are often deteriorated by noise due to the presence of corrupted, lost,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Harsh Patel , Amey Kulkarni , Shivam Sahni , Udit Vyas

Generative Adversarial Networks (GANs) have achieved state-of-the-art performance for several image generation and manipulation tasks. Different works have improved the limited understanding of the latent space of GANs by embedding images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Christian Bartz , Joseph Bethge , Haojin Yang , Christoph Meinel

We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quality results, but…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Aravinda Reddy PN , K. Sreenivasa Rao , Raghavendra Ramachandra , Pabitra mitra

The recent GAN inversion methods have been able to successfully invert the real image input to the corresponding editable latent code in StyleGAN. By combining with the language-vision model (CLIP), some text-driven image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yunpeng Bai , Zihan Zhong , Chao Dong , Weichen Zhang , Guowei Xu , Chun Yuan

Image inpainting is currently a hot topic within the field of computer vision. It offers a viable solution for various applications, including photographic restoration, video editing, and medical imaging. Deep learning advancements, notably…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Omar Elharrouss , Rafat Damseh , Abdelkader Nasreddine Belkacem , Elarbi Badidi , Abderrahmane Lakas