English
Related papers

Related papers: CAGAN: Text-To-Image Generation with Combined Atte…

200 papers

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Generative Adversarial Networks (GANs) produce impressive results on unconditional image generation when powered with large-scale image datasets. Yet generated images are still easy to spot especially on datasets with high variance (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Ning Yu , Guilin Liu , Aysegul Dundar , Andrew Tao , Bryan Catanzaro , Larry Davis , Mario Fritz

Most existing text-to-image synthesis tasks are static single-turn generation, based on pre-defined textual descriptions of images. To explore more practical and interactive real-life applications, we introduce a new task - Interactive…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Yu Cheng , Zhe Gan , Yitong Li , Jingjing Liu , Jianfeng Gao

Altering the content of an image with photo editing tools is a tedious task for an inexperienced user. Especially, when modifying the visual attributes of a specific object in an image without affecting other constituents such as background…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dawei Zhu , Aditya Mogadala , Dietrich Klakow

Using real road testing to optimize autonomous driving algorithms is time-consuming and capital-intensive. To solve this problem, we propose a GAN-based model that is capable of generating high-quality images across different domains. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Hanzhen Zhang , Liguo Zhou , Ruining Wang , Alois Knoll

Text-to-image synthesis aims to generate a photo-realistic image from a given natural language description. Previous works have made significant progress with Generative Adversarial Networks (GANs). Nonetheless, it is still hard to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Eunyeong Jeon , Kunhee Kim , Daijin Kim

Generating images with conditional descriptions gains increasing interests in recent years. However, existing conditional inputs are suffering from either unstructured forms (captions) or limited information and expensive labeling (scene…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Tao Ma , Yikang Li

Automatically generating the descriptions of an image, i.e., image captioning, is an important and fundamental topic in artificial intelligence, which bridges the gap between computer vision and natural language processing. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Shiyang Yan , Yuan Xie , Fangyu Wu , Jeremy S. Smith , Wenjin Lu , Bailing Zhang

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin

Text-to-image synthesis refers to generating visual-realistic and semantically consistent images from given textual descriptions. Previous approaches generate an initial low-resolution image and then refine it to be high-resolution. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoran Sun , Yang Wang , Haipeng Liu , Biao Qian

In this paper, we propose a novel cross-attention-based generative adversarial network (GAN) for the challenging person image generation task. Cross-attention is a novel and intuitive multi-modal fusion method in which an…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Hao Tang , Ling Shao , Nicu Sebe , Luc Van Gool

Conditional image generation is an active research topic including text2image and image translation. Recently image manipulation with linguistic instruction brings new challenges of multimodal conditional generation. However, traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Zhenhuan Liu , Jincan Deng , Liang Li , Shaofei Cai , Qianqian Xu , Shuhui Wang , Qingming Huang

Caricature generation is an interesting yet challenging task. The primary goal is to generate plausible caricatures with reasonable exaggerations given face images. Conventional caricature generation approaches mainly use low-level…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Wenbin Li , Wei Xiong , Haofu Liao , Jing Huo , Yang Gao , Jiebo Luo

Learning to generate natural scenes has always been a daunting task in computer vision. This is even more laborious when generating images with very different views. When the views are very different, the view fields have little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hao Ding , Songsong Wu , Hao Tang , Fei Wu , Guangwei Gao , Xiao-Yuan Jing

Faces generated using generative adversarial networks (GANs) have reached unprecedented realism. These faces, also known as "Deep Fakes", appear as realistic photographs with very little pixel-level distortions. While some work has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Manan Oza , Sukalpa Chanda , David Doermann

Despite the tremendous success in text-to-image generative models, localized text-to-image generation (that is, generating objects or features at specific locations in an image while maintaining a consistent overall generation) still…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yutong He , Ruslan Salakhutdinov , J. Zico Kolter

Conditional image modeling based on textual descriptions is a relatively new domain in unsupervised learning. Previous approaches use a latent variable model and generative adversarial networks. While the formers are approximated by using…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tehseen Zia , Shahan Arif , Shakeeb Murtaza , Mirza Ahsan Ullah

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

In this paper, we present an efficient and effective single-stage framework (DiverGAN) to generate diverse, plausible and semantically consistent images according to a natural-language description. DiverGAN adopts two novel word-level…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhenxing Zhang , Lambert Schomaker