English
Related papers

Related papers: RATLIP: Generative Adversarial CLIP Text-to-Image …

200 papers

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

This paper proposes an extension to the Generative Adversarial Networks (GANs), namely as ARTGAN to synthetically generate more challenging and complex images such as artwork that have abstract characteristics. This is in contrast to most…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Wei Ren Tan , Chee Seng Chan , Hernan Aguirre , Kiyoshi Tanaka

A large body of recent work has identified transformations in the latent spaces of generative adversarial networks (GANs) that consistently and interpretably transform generated images. But existing techniques for identifying these…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Sarah Schwettmann , Evan Hernandez , David Bau , Samuel Klein , Jacob Andreas , Antonio Torralba

State-of-the-art offline handwriting text recognition systems tend to use neural networks and therefore require a large amount of annotated data to be trained. In order to partially satisfy this requirement, we propose a system based on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Eloi Alonso , Bastien Moysset , Ronaldo Messina

Recent generative models produce near-photorealistic images, challenging the trustworthiness of photographs. Synthetic image detection (SID) has thus become an important area of research. Prior work has highlighted how synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Willi , Melanie Mathys , Michael Graber

Generative Adversarial Networks (GAN) have been widely investigated for image synthesis based on their powerful representation learning ability. In this work, we explore the StyleGAN and its application of synthetic food image generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wenjin Fu , Yue Han , Jiangpeng He , Sriram Baireddy , Mridul Gupta , Fengqing Zhu

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

Computation and Language · Computer Science 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

Generating photo-realistic images from a text description is a challenging problem in computer vision. Previous works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Tao Hu , Chengjiang Long , Chunxia Xiao

Generative adversarial networks are the state of the art approach towards learned synthetic image generation. Although early successes were mostly unsupervised, bit by bit, this trend has been superseded by approaches based on labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Ricard Durall , Kalun Ho , Franz-Josef Pfreundt , Janis Keuper

Recent 3D generative models have achieved remarkable performance in synthesizing high resolution photorealistic images with view consistency and detailed 3D shapes, but training them for diverse domains is challenging since it requires…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Gwanghyun Kim , Se Young Chun

Generative Adversarial Networks (GAN) have attracted much research attention recently, leading to impressive results for natural image generation. However, to date little success was observed in using GAN generated images for improving…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Xinlong Wang , Zhipeng Man , Mingyu You , Chunhua Shen

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Text-to-Image translation has been an active area of research in the recent past. The ability for a network to learn the meaning of a sentence and generate an accurate image that depicts the sentence shows ability of the model to think more…

Machine Learning · Computer Science 2018-08-15 Satya Krishna Gorti , Jeremy Ma

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

Recently, GAN inversion methods combined with Contrastive Language-Image Pretraining (CLIP) enables zero-shot image manipulation guided by text prompts. However, their applications to diverse real images are still difficult due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Gwanghyun Kim , Taesung Kwon , Jong Chul Ye

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Justin N. M. Pinkney , Chuan Li

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language processing, and achieves…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 He Huang , Philip S. Yu , Changhu Wang