English
Related papers

Related papers: ManiGAN: Text-Guided Image Manipulation

200 papers

Most existing text-to-image generation methods adopt a multi-stage modular architecture which has three significant problems: 1) Training multiple networks increases the run time and affects the convergence and stability of the generative…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhenxing Zhang , Lambert Schomaker

Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existing approaches gain controllability of generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xingang Pan , Ayush Tewari , Thomas Leimkühler , Lingjie Liu , Abhimitra Meka , Christian Theobalt

It is well-known that GANs are difficult to train, and several different techniques have been proposed in order to stabilize their training. In this paper, we propose a novel training method called manifold-matching, and a new GAN model…

We introduce EnhanceGAN, an adversarial learning based model that performs automatic image enhancement. Traditional image enhancement frameworks typically involve training models in a fully-supervised manner, which require expensive…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Yubin Deng , Chen Change Loy , Xiaoou Tang

In this paper, we propose an Attentional Generative Adversarial Network (AttnGAN) that allows attention-driven, multi-stage refinement for fine-grained text-to-image generation. With a novel attentional generative network, the AttnGAN can…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Tao Xu , Pengchuan Zhang , Qiuyuan Huang , Han Zhang , Zhe Gan , Xiaolei Huang , Xiaodong He

In this work, we propose TediGAN, a novel framework for multi-modal image generation and manipulation with textual descriptions. The proposed method consists of three components: StyleGAN inversion module, visual-linguistic similarity…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

Over the last decade, the process of automatic image colorization has been of significant interest for several application areas including restoration of aged or degraded images. This problem is highly ill-posed due to the large degrees of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Kamyar Nazeri , Eric Ng , Mehran Ebrahimi

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for…

Machine Learning · Computer Science 2021-04-22 Anton Cherepkov , Andrey Voynov , Artem Babenko

Deep neural networks (DNN) are commonly used to denoise and sharpen X-ray computed tomography (CT) images with the goal of reducing patient X-ray dosage while maintaining reconstruction quality. However, naive application of DNN-based…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Madhuri Nagare , Gregery T. Buzzard , Charles A. Bouman

There are five features to consider when using generative adversarial networks to apply makeup to photos of the human face. These features include (1) facial components, (2) interactive color adjustments, (3) makeup variations, (4)…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Daichi Horita , Kiyoharu Aizawa

Unlike a conventional background inpainting approach that infers a missing area from image patches similar to the background, face completion requires semantic knowledge about the target object for realistic outputs. Current image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Haofu Liao , Gareth Funka-Lea , Yefeng Zheng , Jiebo Luo , S. Kevin Zhou

Generative Adversarial Networks (GANs) have facilitated a new direction to tackle the image-to-image transformation problem. Different GANs use generator and discriminator networks with different losses in the objective function. Still…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Kancharagunta Kishan Babu , Shiv Ram Dubey

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

Area of image inpainting over relatively large missing regions recently advanced substantially through adaptation of dedicated deep neural networks. However, current network solutions still introduce undesired artifacts and noise to the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Ugur Demir , Gozde Unal

Improving the aesthetic quality of images is challenging and eager for the public. To address this problem, most existing algorithms are based on supervised learning methods to learn an automatic photo enhancer for paired data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Zhangkai Ni , Wenhan Yang , Shiqi Wang , Lin Ma , Sam Kwong

Text-guided image manipulation tasks have recently gained attention in the vision-and-language community. While most of the prior studies focused on single-turn manipulation, our goal in this paper is to address the more challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Shoya Matsumori , Yuki Abe , Kosuke Shingyouchi , Komei Sugiura , Michita Imai

Generative Adversarial Networks (GANs) have emerged as a prominent research focus for image editing tasks, leveraging the powerful image generation capabilities of the GAN framework to produce remarkable results.However, prevailing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ruicheng Zhang , Guoheng Huang , Yejing Huo , Xiaochen Yuan , Zhizhen Zhou , Xuhang Chen , Guo Zhong

Image inpainting is a widely used technique in computer vision for reconstructing missing or damaged pixels in images. Recent advancements with Generative Adversarial Networks (GANs) have demonstrated superior performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Nafiz Al Asad , Md. Appel Mahmud Pranto , Shbiruzzaman Shiam , Musaddeq Mahmud Akand , Mohammad Abu Yousuf , Khondokar Fida Hasan , Mohammad Ali Moni