English
Related papers

Related papers: Cycle-Consistent Inverse GAN for Text-to-Image Syn…

200 papers

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate…

Machine Learning · Computer Science 2018-12-24 Yedid Hoshen , Jitendra Malik

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim

CycleGAN provides a framework to train image-to-image translation with unpaired datasets using cycle consistency loss [4]. While results are great in many applications, the pixel level cycle consistency can potentially be problematic and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Tongzhou Wang , Yihan Lin

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Dat Viet Thanh Nguyen , Phong Tran The , Tan M. Dinh , Cuong Pham , Anh Tuan Tran

Recent image-to-image translation models have shown great success in mapping local textures between two domains. Existing approaches rely on a cycle-consistency constraint that supervises the generators to learn an inverse mapping. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wenju Xu , Guanghui Wang

The generative adversarial network (GAN) framework has emerged as a powerful tool for various image and video synthesis tasks, allowing the synthesis of visual content in an unconditional or input-conditional manner. It has enabled the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Ming-Yu Liu , Xun Huang , Jiahui Yu , Ting-Chun Wang , Arun Mallya

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

We propose a novel hierarchical approach for text-to-image synthesis by inferring semantic layout. Instead of learning a direct mapping from text to image, our algorithm decomposes the generation process into multiple steps, in which it…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Seunghoon Hong , Dingdong Yang , Jongwook Choi , Honglak Lee

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and the text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Jihoon Lee , Yunhong Min , Hwidong Kim , Sangtae Ahn

Generative Adversarial Networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Lei Chen , Le Wu , Zhenzhen Hu , Meng Wang

Applying generative adversarial networks (GANs) to text-related tasks is challenging due to the discrete nature of language. One line of research resolves this issue by employing reinforcement learning (RL) and optimizing the next-word…

Computation and Language · Computer Science 2020-11-05 Yanghoon Kim , Seungpil Won , Seunghyun Yoon , Kyomin Jung

Generating photo-realistic images from a text description is a challenging problem in computer vision. Previous works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Tao Hu , Chengjiang Long , Chunxia Xiao

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Recent studies on unsupervised image-to-image translation have made a remarkable progress by training a pair of generative adversarial networks with a cycle-consistent loss. However, such unsupervised methods may generate inferior results…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Minjun Li , Haozhi Huang , Lin Ma , Wei Liu , Tong Zhang , Yu-Gang Jiang

The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks. We extend this framework by exploring approximately invertible architectures which are well…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Tycho F. A. van der Ouderaa , Daniel E. Worrall

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand