English
Related papers

Related papers: Text-to-Image-to-Text Translation using Cycle Cons…

200 papers

Image-to-image translation is the recent trend to transform images from one domain to another domain using generative adversarial network (GAN). The existing GAN models perform the training by only utilizing the input and output modalities…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Balaram Singh Kshatriya , Shiv Ram Dubey , Himangshu Sarma , Kunal Chaudhary , Meva Ram Gurjar , Rahul Rai , Sunny Manchanda

So far, research to generate captions from images has been carried out from the viewpoint that a caption holds sufficient information for an image. If it is possible to generate an image that is close to the input image from a generated…

Computation and Language · Computer Science 2019-03-26 Keisuke Hagiwara , Yusuke Mukuta , Tatsuya Harada

The problem of generating textual descriptions for the visual data has gained research attention in the recent years. In contrast to that the problem of generating visual data from textual descriptions is still very challenging, because it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Bulla Rajesh , Nandakishore Dusa , Mohammed Javed , Shiv Ram Dubey , P. Nagabhushan

Recently, generative adversarial networks have gained a lot of popularity for image generation tasks. However, such models are associated with complex learning mechanisms and demand very large relevant datasets. This work borrows concepts…

Machine Learning · Computer Science 2018-09-28 Shagan Sah , Chi Zhang , Thang Nguyen , Dheeraj Kumar Peri , Ameya Shringi , Raymond Ptucha

We investigate conditional adversarial networks as a general-purpose solution to image-to-image translation problems. These networks not only learn the mapping from input image to output image, but also learn a loss function to train this…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Phillip Isola , Jun-Yan Zhu , Tinghui Zhou , Alexei A. Efros

Interest in image-to-image translation has grown substantially in recent years with the success of unsupervised models based on the cycle-consistency assumption. The achievements of these models have been limited to a particular subset of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Matthew Amodio , Smita Krishnaswamy

Generative Adversarial Networks (GANs) are machine learning methods that are used in many important and novel applications. For example, in imaging science, GANs are effectively utilized in generating image datasets, photographs of human…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Soheyla Amirian , Thiab R. Taha , Khaled Rasheed , Hamid R. Arabnia

Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Cristian Bodnar

We describe a new approach that improves the training of generative adversarial nets (GANs) for synthesizing diverse images from a text input. Our approach is based on the conditional version of GANs and expands on previous work leveraging…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Miriam Cha , Youngjune L. Gwon , H. T. Kung

Fine-grained text to image synthesis involves generating images from texts that belong to different categories. In contrast to general text to image synthesis, in fine-grained synthesis there is high similarity between images of different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xu Ouyang , Ying Chen , Kaiyue Zhu , Gady Agam

Recently, image-to-image translation has been made much progress owing to the success of conditional Generative Adversarial Networks (cGANs). And some unpaired methods based on cycle consistency loss such as DualGAN, CycleGAN and DiscoGAN…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Ziqiang Zheng , Wang Chao , Zhibin Yu , Nan Wang , Haiyong Zheng , Bing Zheng

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs) and dual learning. However, existing models lack the ability to control the translated results in the target domain and their results…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jianxin Lin , Yingce Xia , Tao Qin , Zhibo Chen , Tie-Yan Liu

State-of-the-art offline handwriting text recognition systems tend to use neural networks and therefore require a large amount of annotated data to be trained. In order to partially satisfy this requirement, we propose a system based on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Eloi Alonso , Bastien Moysset , Ronaldo Messina

Deep learning techniques, especially Generative Adversarial Networks (GANs) have significantly improved image inpainting and image-to-image translation tasks over the past few years. To the best of our knowledge, the problem of combining…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Aref Abedjooy , Mehran Ebrahimi

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Xiaodan Liang , Hao Zhang , Eric P. Xing

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

Text-to-image synthesis is the task of generating images from text descriptions. Image generation, by itself, is a challenging task. When we combine image generation and text, we bring complexity to a new level: we need to combine data from…

Machine Learning · Computer Science 2020-04-27 Douglas M. Souza , Jônatas Wehrmann , Duncan D. Ruiz

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

Generative Adversarial Networks (GANs) have significantly advanced image processing, with Pix2Pix being a notable framework for image-to-image translation. This paper explores a novel application of Pix2Pix to transform abstract map images…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Zhenglin Li , Bo Guan , Yuanzhou Wei , Yiming Zhou , Jingyu Zhang , Jinxin Xu