English
Related papers

Related papers: CAGAN: Text-To-Image Generation with Combined Atte…

200 papers

Synthesizing high-quality realistic images from text descriptions is a challenging task. Existing text-to-image Generative Adversarial Networks generally employ a stacked architecture as the backbone yet still remain three flaws. First, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ming Tao , Hao Tang , Fei Wu , Xiao-Yuan Jing , Bing-Kun Bao , Changsheng Xu

Image generation tasks are traditionally undertaken using Convolutional Neural Networks (CNN) or Transformer architectures for feature aggregating and dispatching. Despite the frequent application of convolution and attention structures,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zihao Wang , Yiming Huang , Ziyu Zhou

Image super-resolution is one of the important computer vision techniques aiming to reconstruct high-resolution images from corresponding low-resolution ones. Most recently, deep learning-based approaches have been demonstrated for image…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Jie Cai , Zibo Meng , Chiu Man Ho

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

Machine Learning · Computer Science 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

The problem of generating textual descriptions for the visual data has gained research attention in the recent years. In contrast to that the problem of generating visual data from textual descriptions is still very challenging, because it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Bulla Rajesh , Nandakishore Dusa , Mohammed Javed , Shiv Ram Dubey , P. Nagabhushan

Image-to-image translation is to learn a mapping between images from a source domain and images from a target domain. In this paper, we introduce the attention mechanism directly to the generative adversarial network (GAN) architecture and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hajar Emami , Majid Moradi Aliabadi , Ming Dong , Ratna Babu Chinnam

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Generating images via the generative adversarial network (GAN) has attracted much attention recently. However, most of the existing GAN-based methods can only produce low-resolution images of limited quality. Directly generating…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Yong Guo , Qi Chen , Jian Chen , Qingyao Wu , Qinfeng Shi , Mingkui Tan

Fine-grained text to image synthesis involves generating images from texts that belong to different categories. In contrast to general text to image synthesis, in fine-grained synthesis there is high similarity between images of different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xu Ouyang , Ying Chen , Kaiyue Zhu , Gady Agam

The output of text-to-image synthesis systems should be coherent, clear, photo-realistic scenes with high semantic fidelity to their conditioned text descriptions. Our Cross-Modal Contrastive Generative Adversarial Network (XMC-GAN)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Han Zhang , Jing Yu Koh , Jason Baldridge , Honglak Lee , Yinfei Yang

Unsupervised image translation, which aims in translating two independent sets of images, is challenging in discovering the correct correspondences without paired data. Existing works build upon Generative Adversarial Network (GAN) such…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Shuang Ma , Jianlong Fu , Chang Wen Chen , Tao Mei

Conditional image generation is the task of generating diverse images using class label information. Although many conditional Generative Adversarial Networks (GAN) have shown realistic results, such methods consider pairwise relations…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Minguk Kang , Jaesik Park

Computed tomography (CT) uses X-ray measurements taken from sensors around the body to generate tomographic images of the human body. Conventional reconstruction algorithms can be used if the X-ray data are adequately sampled and of high…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Ruiwen Xing , Thomas Humphries , Dong Si

The traditional super-resolution methods that aim to minimize the mean square error usually produce the images with over-smoothed and blurry edges, due to the lose of high-frequency details. In this paper, we propose two novel techniques in…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Yitong Yan , Chuangchuang Liu , Changyou Chen , Xianfang Sun , Longcun Jin , Xiang Zhou

We introduce a self-attending task generative adversarial network (SATGAN) and apply it to the problem of augmenting synthetic high contrast scientific imagery of resident space objects with realistic noise patterns and sensor…

Machine Learning · Computer Science 2021-11-19 Nathan Toner , Justin Fletcher

The GAN-based infrared and visible image fusion methods have gained ever-increasing attention due to its effectiveness and superiority. However, the existing methods adopt the global pixel distribution of source images as the basis for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Xiaowen Liu , Renhua Wang , Hongtao Huo , Xin Yang , Jing Li

Text-to-image synthesis aims to generate natural images conditioned on text descriptions. The main difficulty of this task lies in effectively fusing text information into the image synthesis process. Existing methods usually adaptively…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Senmao Ye , Fei Liu , Minkui Tan

Motivated by the recent progress in generative models, we introduce a model that generates images from natural language descriptions. The proposed model iteratively draws patches on a canvas, while attending to the relevant words in the…

Machine Learning · Computer Science 2016-03-01 Elman Mansimov , Emilio Parisotto , Jimmy Lei Ba , Ruslan Salakhutdinov

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi