中文
相关论文

相关论文: Improving Text to Image Generation using Mode-seek…

200 篇论文

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

计算与语言 · 计算机科学 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language processing, and achieves…

计算机视觉与模式识别 · 计算机科学 2018-11-20 He Huang , Philip S. Yu , Changhu Wang

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed…

神经与进化计算 · 计算机科学 2016-06-07 Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , Honglak Lee

This paper presents a novel method to deal with the challenging task of generating photographic images conditioned on semantic image descriptions. Our method introduces accompanying hierarchical-nested adversarial objectives inside the…

计算机视觉与模式识别 · 计算机科学 2018-04-10 Zizhao Zhang , Yuanpu Xie , Lin Yang

The problem of generating textual descriptions for the visual data has gained research attention in the recent years. In contrast to that the problem of generating visual data from textual descriptions is still very challenging, because it…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Bulla Rajesh , Nandakishore Dusa , Mohammed Javed , Shiv Ram Dubey , P. Nagabhushan

The recent success of Generative Adversarial Networks (GAN) is a result of their ability to generate high quality images from a latent vector space. An important application is the generation of images from a text description, where the…

机器学习 · 计算机科学 2019-05-17 Hamid Eghbal-zadeh , Lukas Fischer , Thomas Hoch

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

机器学习 · 计算机科学 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

机器学习 · 计算机科学 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Jorge Agnese , Jonathan Herrera , Haicheng Tao , Xingquan Zhu

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

机器学习 · 计算机科学 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

人机交互 · 计算机科学 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

One of the major challenges in training deep neural networks for text-to-image generation is the significant linguistic discrepancy between ground-truth captions of each image in most popular datasets. The large difference in the choice of…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Mahmoud Ahmed , Omer Moussa , Ismail Shaheen , Mohamed Abdelfattah , Amr Abdalla , Marwan Eid , Hesham Eraqi , Mohamed Moustafa

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation. However, generators in these networks are of complicated architectures with large number…

计算机视觉与模式识别 · 计算机科学 2019-07-26 Han Shu , Yunhe Wang , Xu Jia , Kai Han , Hanting Chen , Chunjing Xu , Qi Tian , Chang Xu

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

机器学习 · 计算机科学 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

Text-to-image generation models have progressed considerably in recent years, which can now generate impressive realistic images from arbitrary text. Most of such models are trained on web-scale image-text paired datasets, which may not be…

计算机视觉与模式识别 · 计算机科学 2022-10-26 Yufan Zhou , Chunyuan Li , Changyou Chen , Jianfeng Gao , Jinhui Xu

Generative adversarial networks (GANs) have achieved significant success in generating real-valued data. However, the discrete nature of text hinders the application of GAN to text-generation tasks. Instead of using the standard GAN…

计算与语言 · 计算机科学 2020-08-13 Liqun Chen , Shuyang Dai , Chenyang Tao , Dinghan Shen , Zhe Gan , Haichao Zhang , Yizhe Zhang , Lawrence Carin

Text-to-image synthesis (T2I) aims to generate photo-realistic images which are semantically consistent with the text descriptions. Existing methods are usually built upon conditional generative adversarial networks (GANs) and initialize an…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Kai Hu , Wentong Liao , Michael Ying Yang , Bodo Rosenhahn