English
Related papers

Related papers: Improving Text to Image Generation using Mode-seek…

200 papers

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

Computation and Language · Computer Science 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language processing, and achieves…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 He Huang , Philip S. Yu , Changhu Wang

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed…

Neural and Evolutionary Computing · Computer Science 2016-06-07 Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , Honglak Lee

This paper presents a novel method to deal with the challenging task of generating photographic images conditioned on semantic image descriptions. Our method introduces accompanying hierarchical-nested adversarial objectives inside the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Zizhao Zhang , Yuanpu Xie , Lin Yang

The problem of generating textual descriptions for the visual data has gained research attention in the recent years. In contrast to that the problem of generating visual data from textual descriptions is still very challenging, because it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Bulla Rajesh , Nandakishore Dusa , Mohammed Javed , Shiv Ram Dubey , P. Nagabhushan

The recent success of Generative Adversarial Networks (GAN) is a result of their ability to generate high quality images from a latent vector space. An important application is the generation of images from a text description, where the…

Machine Learning · Computer Science 2019-05-17 Hamid Eghbal-zadeh , Lukas Fischer , Thomas Hoch

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jorge Agnese , Jonathan Herrera , Haicheng Tao , Xingquan Zhu

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

One of the major challenges in training deep neural networks for text-to-image generation is the significant linguistic discrepancy between ground-truth captions of each image in most popular datasets. The large difference in the choice of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mahmoud Ahmed , Omer Moussa , Ismail Shaheen , Mohamed Abdelfattah , Amr Abdalla , Marwan Eid , Hesham Eraqi , Mohamed Moustafa

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation. However, generators in these networks are of complicated architectures with large number…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Han Shu , Yunhe Wang , Xu Jia , Kai Han , Hanting Chen , Chunjing Xu , Qi Tian , Chang Xu

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

Text-to-image generation models have progressed considerably in recent years, which can now generate impressive realistic images from arbitrary text. Most of such models are trained on web-scale image-text paired datasets, which may not be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yufan Zhou , Chunyuan Li , Changyou Chen , Jianfeng Gao , Jinhui Xu

Generative adversarial networks (GANs) have achieved significant success in generating real-valued data. However, the discrete nature of text hinders the application of GAN to text-generation tasks. Instead of using the standard GAN…

Computation and Language · Computer Science 2020-08-13 Liqun Chen , Shuyang Dai , Chenyang Tao , Dinghan Shen , Zhe Gan , Haichao Zhang , Yizhe Zhang , Lawrence Carin

Text-to-image synthesis (T2I) aims to generate photo-realistic images which are semantically consistent with the text descriptions. Existing methods are usually built upon conditional generative adversarial networks (GANs) and initialize an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Kai Hu , Wentong Liao , Michael Ying Yang , Bodo Rosenhahn