中文
相关论文

相关论文: Diverse Inpainting and Editing with GAN Inversion

200 篇论文

Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from…

图像与视频处理 · 电气工程与系统科学 2020-07-22 Michael Goebel , Lakshmanan Nataraj , Tejaswi Nanjundaswamy , Tajuddin Manhar Mohammed , Shivkumar Chandrasekaran , B. S. Manjunath

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to a natural image. This property emerges from the disentangled nature of the…

计算机视觉与模式识别 · 计算机科学 2021-07-12 Mustafa Shukor , Xu Yao , Bharath Bhushan Damodaran , Pierre Hellier

We show that pre-trained Generative Adversarial Networks (GANs), e.g., StyleGAN, can be used as a latent bank to improve the restoration quality of large-factor image super-resolution (SR). While most existing SR approaches attempt to…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Kelvin C. K. Chan , Xintao Wang , Xiangyu Xu , Jinwei Gu , Chen Change Loy

With the remarkable recent progress on learning deep generative models, it becomes increasingly interesting to develop models for controllable image synthesis from reconfigurable inputs. This paper focuses on a recent emerged task,…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Wei Sun , Tianfu Wu

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

This paper addresses the problem of finding interpretable directions in the latent space of pre-trained Generative Adversarial Networks (GANs) to facilitate controllable image synthesis. Such interpretable directions correspond to…

计算机视觉与模式识别 · 计算机科学 2021-11-24 James Oldfield , Markos Georgopoulos , Yannis Panagakis , Mihalis A. Nicolaou , Ioannis Patras

Recently, manipulation of real-world images has been highly elaborated along with the development of Generative Adversarial Networks (GANs) and corresponding encoders, which embed real-world images into the latent space. However, designing…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Seungjun Moon , Gyeong-Moon Park

Deep learning techniques, especially Generative Adversarial Networks (GANs) have significantly improved image inpainting and image-to-image translation tasks over the past few years. To the best of our knowledge, the problem of combining…

图像与视频处理 · 电气工程与系统科学 2022-06-23 Aref Abedjooy , Mehran Ebrahimi

In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and the text, and…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Jihoon Lee , Yunhong Min , Hwidong Kim , Sangtae Ahn

In the majority of GAN architectures, the latent space is defined as a set of vectors of given dimensionality. Such representations are not easily interpretable and do not capture spatial information of image content directly. In this work,…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Maciej Sypetkowski

This study introduces a novel method for inpainting normal maps using a generative adversarial network (GAN). Normal maps, often derived from a lightstage, are crucial in performance capture but can have obscured areas due to movement…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Hancheng Zuo , Bernard Tiddeman

Semantic inpainting or image completion alludes to the task of inferring arbitrary large missing regions in images based on image semantics. Since the prediction of image pixels requires an indication of high-level context, this makes it…

计算机视觉与模式识别 · 计算机科学 2023-07-28 Priyansh Saxena , Raahat Gupta , Akshat Maheshwari , Saumil Maheshwari

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

图像与视频处理 · 电气工程与系统科学 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

This paper studies the problem of StyleGAN inversion, which plays an essential role in enabling the pretrained StyleGAN to be used for real image editing tasks. The goal of StyleGAN inversion is to find the exact latent code of the given…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Tianyi Wei , Dongdong Chen , Wenbo Zhou , Jing Liao , Weiming Zhang , Lu Yuan , Gang Hua , Nenghai Yu

Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow…

计算机视觉与模式识别 · 计算机科学 2018-03-29 Chao Yang , Yuhang Song , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

Seamlessly blending features from multiple images is extremely challenging because of complex relationships in lighting, geometry, and partial occlusion which cause coupling between different parts of the image. Even though recent work on…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Peihao Zhu , Rameen Abdal , John Femiani , Peter Wonka