English
Related papers

Related papers: Scaling up GANs for Text-to-Image Synthesis

200 papers

Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jorge Agnese , Jonathan Herrera , Haicheng Tao , Xingquan Zhu

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

We show that pre-trained Generative Adversarial Networks (GANs) such as StyleGAN and BigGAN can be used as a latent bank to improve the performance of image super-resolution. While most existing perceptual-oriented approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Kelvin C. K. Chan , Xiangyu Xu , Xintao Wang , Jinwei Gu , Chen Change Loy

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

Synthesizing a realistic image from textual description is a major challenge in computer vision. Current text to image synthesis approaches falls short of producing a highresolution image that represent a text descriptor. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Haileleol Tibebu , Aadil Malik , Varuna De Silva

Recent advances in Generative Artificial Intelligence have fueled numerous applications, particularly those involving Generative Adversarial Networks (GANs), which are essential for synthesizing realistic photos and videos. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-07 Ziji Shi , Jialin Li , Yang You

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Egor Sevriugov , Ivan Oseledets

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Text-to-image synthesis refers to generating an image from a given text description, the key goal of which lies in photo realism and semantic consistency. Previous methods usually generate an initial image with sentence embedding and then…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shulan Ruan , Yong Zhang , Kun Zhang , Yanbo Fan , Fan Tang , Qi Liu , Enhong Chen

Generative Adversarial Networks (GANs), particularly StyleGAN and its variants, have demonstrated remarkable capabilities in generating highly realistic images. Despite their success, adapting these models to diverse tasks such as domain…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Abdul Basit Anees , Ahmet Canberk Baykal , Muhammed Burak Kizil , Duygu Ceylan , Erkut Erdem , Aykut Erdem

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed…

Neural and Evolutionary Computing · Computer Science 2016-06-07 Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , Honglak Lee

The state-of-the-art StyleGAN2 network supports powerful methods to create and edit art, including generating random images, finding images "like" some query, and modifying content or style. Further, recent advancements enable training with…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Vaibhav Vavilala , David Forsyth

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

StyleGAN models show editing capabilities via their semantically interpretable latent organizations which require successful GAN inversion methods to edit real images. Many works have been proposed for inverting images into StyleGAN's…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Ahmet Burak Yildirim , Hamza Pehlivan , Aysegul Dundar

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

Recently, Generative Adversarial Networks (GANs) have been successfully scaled to billion-scale large text-to-image datasets. However, training such models entails a high training cost, limiting some applications and research usage. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuya Kobayashi , Yuhta Takida , Takashi Shibuya , Yuki Mitsufuji