English
Related papers

Related papers: Text to Image Generation with Semantic-Spatial Awa…

200 papers

Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Xiaodan Liang , Hao Zhang , Eric P. Xing

Text-guided image generation has witnessed unprecedented progress due to the development of diffusion models. Beyond text and image, sound is a vital element within the sphere of human perception, offering vivid representations and…

Graphics · Computer Science 2023-06-21 Yue Yang , Kaipeng Zhang , Yuying Ge , Wenqi Shao , Zeyue Xue , Yu Qiao , Ping Luo

Semantic image synthesis, i.e., generating images from user-provided semantic label maps, is an important conditional image generation task as it allows to control both the content as well as the spatial layout of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Tariq Berrada , Jakob Verbeek , Camille Couprie , Karteek Alahari

Recently, generative adversarial networks (GAN) have gathered a lot of interest. Their efficiency in generating unseen samples of high quality, especially images, has improved over the years. In the field of Natural Language Generation…

Computation and Language · Computer Science 2019-11-01 Jean-Benoit Delbrouck , Bastien Vanderplaetse , Stéphane Dupont

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

Magnetic Resonance Imaging (MRI) enables the acquisition of multiple image contrasts, such as T1-weighted (T1w) and T2-weighted (T2w) scans, each offering distinct diagnostic insights. However, acquiring all desired modalities increases…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Andrea Moschetto , Lemuel Puglisi , Alec Sargood , Pierluigi Dell'Acqua , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì

State-of-the-art methods for image-to-image translation with Generative Adversarial Networks (GANs) can learn a mapping from one domain to another domain using unpaired image data. However, these methods require the training of one specific…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Hao Tang , Dan Xu , Wei Wang , Yan Yan , Nicu Sebe

Text-to-image (T2I) generation has seen significant progress with diffusion models, enabling generation of photo-realistic images from text prompts. Despite this progress, existing methods still face challenges in following complex text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ashish Goswami , Satyam Kumar Modi , Santhosh Rishi Deshineni , Harman Singh , Prathosh A. P , Parag Singla

Despite high semantic alignment, modern text-to-image (T2I) generative models still struggle to synthesize diverse images from a given prompt. In this work, we enhance the T2I diversity through a geometric lens. Unlike most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ye Zhu , Kaleb S. Newman , Johannes F. Lutzeyer , Adriana Romero-Soriano , Michal Drozdzal , Olga Russakovsky

Instilling creativity in text-to-image (T2I) generation presents a significant challenge, as it requires synthesized images to exhibit not only visual novelty and surprise, but also artistic value. Current T2I models, however, are largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yue Yu , Haibo Chen , Shuo Chen , Jian Yang , Jun Li

Data augmentation has been recently leveraged as an effective regularizer in various vision-language deep neural networks. However, in text-to-image synthesis (T2Isyn), current augmentation wisdom still suffers from the semantic mismatch…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zhaorui Tan , Xi Yang , Kaizhu Huang

Image-to-image translation is to learn a mapping between images from a source domain and images from a target domain. In this paper, we introduce the attention mechanism directly to the generative adversarial network (GAN) architecture and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hajar Emami , Majid Moradi Aliabadi , Ming Dong , Ratna Babu Chinnam

Translating freehand sketches into photorealistic images remains a fundamental challenge in image synthesis, particularly due to the abstract, sparse, and stylistically diverse nature of sketches. Existing approaches, including GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Ali Zia , Muhammad Umer Ramzan , Usman Ali , Muhammad Faheem , Abdelwahed Khamis , Shahnawaz Qureshi

Text to image generation methods (T2I) are widely popular in generating art and other creative artifacts. While visual hallucinations can be a positive factor in scenarios where creativity is appreciated, such artifacts are poorly suited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Rodrigo Valerio , Joao Bordalo , Michal Yarom , Yonatan Bitton , Idan Szpektor , Joao Magalhaes

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

Generative Adversarial Networks (GANs) have revolutionized image synthesis through many applications like face generation, photograph editing, and image super-resolution. Image synthesis using GANs has predominantly been uni-modal, with few…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Rohan Wadhawan , Tanuj Drall , Shubham Singh , Shampa Chakraverty

Recent advances in text-to-image diffusion models have enabled the photorealistic generation of images from text prompts. Despite the great progress, existing models still struggle to generate compositional multi-concept images naturally,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hazarapet Tunanyan , Dejia Xu , Shant Navasardyan , Zhangyang Wang , Humphrey Shi

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for…

Machine Learning · Computer Science 2021-04-22 Anton Cherepkov , Andrey Voynov , Artem Babenko

Recent years witness the tremendous success of generative adversarial networks (GANs) in synthesizing photo-realistic images. GAN generator learns to compose realistic images and reproduce the real data distribution. Through that, a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Yinghao Xu , Yujun Shen , Jiapeng Zhu , Ceyuan Yang , Bolei Zhou

Despite data augmentation being a de facto technique for boosting the performance of deep neural networks, little attention has been paid to developing augmentation strategies for generative adversarial networks (GANs). To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Prateek Katiyar , Anna Khoreva