English
Related papers

Related papers: Scaling up GANs for Text-to-Image Synthesis

200 papers

Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the…

Neural and Evolutionary Computing · Computer Science 2021-10-29 Santiago Gonzalez , Mohak Kant , Risto Miikkulainen

Large-scale text-to-image diffusion models have made amazing advances. However, the status quo is to use text input alone, which can impede controllability. In this work, we propose GLIGEN, Grounded-Language-to-Image Generation, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yuheng Li , Haotian Liu , Qingyang Wu , Fangzhou Mu , Jianwei Yang , Jianfeng Gao , Chunyuan Li , Yong Jae Lee

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

In this paper, we perform an in-depth study of the properties and applications of aligned generative models. We refer to two models as aligned if they share the same architecture, and one of them (the child) is obtained from the other (the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Zongze Wu , Yotam Nitzan , Eli Shechtman , Dani Lischinski

This work integrates StyleGAN, DragGAN and Principal Component Analysis (PCA) to enhance the latent space efficiency and controllability of GAN-generated images. Style-GAN provides a structured latent space, DragGAN enables intuitive image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Kirsten Odendaal , Neela Kaushik , Spencer Halverson

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

We present a new perspective of achieving image synthesis by viewing this task as a visual token generation problem. Different from existing paradigms that directly synthesize a full image from a single input (e.g., a latent code), the new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Yanhong Zeng , Huan Yang , Hongyang Chao , Jianbo Wang , Jianlong Fu

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from…

Image and Video Processing · Electrical Eng. & Systems 2020-07-22 Michael Goebel , Lakshmanan Nataraj , Tejaswi Nanjundaswamy , Tajuddin Manhar Mohammed , Shivkumar Chandrasekaran , B. S. Manjunath

Generative Adversarial Networks (GANs) have been extremely successful in various application domains. Adversarial image synthesis has drawn increasing attention and made tremendous progress in recent years because of its wide range of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 William Roy , Glen Kelly , Robert Leer , Frederick Ricardo

StyleGAN is a state-of-art generative adversarial network architecture that generates random 2D high-quality synthetic facial data samples. In this paper, we recap the StyleGAN architecture and training methodology and present our…

Neural and Evolutionary Computing · Computer Science 2020-03-25 Viktor Varkarakis , Shabab Bazrafkan , Peter Corcoran

Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Nikolay Jetchev , Urs Bergmann , Roland Vollgraf

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

We consider the task of photo-realistic unconditional image generation (generate high quality, diverse samples that carry the same visual content as the image) on mobile platforms using Generative Adversarial Networks (GANs). In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa , Partha Pratim Pande

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Coarse building mass models are now routinely generated at scales ranging from individual buildings through to whole cities. For example, they can be abstracted from raw measurements, generated procedurally, or created manually. However,…

Graphics · Computer Science 2019-03-08 Tom Kelly , Paul Guerrero , Anthony Steed , Peter Wonka , Niloy J. Mitra

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu