English
Related papers

Related papers: Controllable Text-to-Image Generation

200 papers

Text-guided image generation aimed to generate desired images conditioned on given texts, while text-guided image manipulation refers to semantically edit parts of a given image based on specified texts. For these two similar tasks, the key…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Xiaozhou You , Jian Zhang

In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Xin Jin , Shu Zhao , Le Zhang , Xin Zhao , Qiang Deng , Chaoen Xiao

Recent advances in large pre-trained language models have demonstrated strong results in generating natural languages and significantly improved performances for many natural language generation (NLG) applications such as machine…

Computation and Language · Computer Science 2022-09-27 Nanyun Peng

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jihye Back

Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Stanislav Frolov , Prateek Bansal , Jörn Hees , Andreas Dengel

We propose a novel procedure which adds "content-addressability" to any given unconditional implicit model e.g., a generative adversarial network (GAN). The procedure allows users to control the generative process by specifying a set…

Machine Learning · Computer Science 2019-05-16 Wittawat Jitkrittum , Patsorn Sangkloy , Muhammad Waleed Gondal , Amit Raj , James Hays , Bernhard Schölkopf

In this paper, we propose a generative model, Temporal Generative Adversarial Nets (TGAN), which can learn a semantic representation of unlabeled videos, and is capable of generating videos. Unlike existing Generative Adversarial Nets…

Machine Learning · Computer Science 2017-08-21 Masaki Saito , Eiichi Matsumoto , Shunta Saito

In this short report, we present a simple, yet effective approach to editing real images via generative adversarial networks (GAN). Unlike previous techniques, that treat all editing tasks as an operation that affects pixel values in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 David Futschik , Michal Lukáč , Eli Shechtman , Daniel Sýkora

Cross-view image translation is challenging because it involves images with drastically different views and severe deformation. In this paper, we propose a novel approach named Multi-Channel Attention SelectionGAN (SelectionGAN) that makes…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Hao Tang , Dan Xu , Nicu Sebe , Yanzhi Wang , Jason J. Corso , Yan Yan

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Image generation today can produce somewhat realistic images from text prompts. However, if one asks the generator to synthesize a specific camera setting such as creating different fields of view using a 24mm lens versus a 70mm lens, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yu Yuan , Xijun Wang , Yichen Sheng , Prateek Chennuri , Xingguang Zhang , Stanley Chan

Generative Adversarial Networks (GANs) have obtained extraordinary success in the generation of realistic images, a domain where a lower pixel-level accuracy is acceptable. We study the problem, not yet tackled in the literature, of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Emanuele Ghelfi , Paolo Galeone , Michele De Simoni , Federico Di Mattia

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

Despite remarkable progress in image translation, the complex scene with multiple discrepant objects remains a challenging problem. The translated images have low fidelity and tiny objects in fewer details causing unsatisfactory performance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Liyun Zhang , Photchara Ratsamee , Bowen Wang , Zhaojie Luo , Yuki Uranishi , Manabu Higashida , Haruo Takemura

Generative Adversarial Networks (GANs) are susceptible to bias, learned from either the unbalanced data, or through mode collapse. The networks focus on the core of the data distribution, leaving the tails - or the edges of the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Yunzhe Liu , Rinon Gal , Amit H. Bermano , Baoquan Chen , Daniel Cohen-Or

In today's digital age, concerns about the dangers of AI-generated images are increasingly common. One powerful tool in this domain is StyleGAN (style-based generative adversarial networks), a generative adversarial network capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Julia Laubmann , Johannes Reschke

Recent advances show that Generative Adversarial Networks (GANs) can synthesize images with smooth variations along semantically meaningful latent directions, such as pose, expression, layout, etc. While this indicates that GANs implicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jiteng Mu , Shalini De Mello , Zhiding Yu , Nuno Vasconcelos , Xiaolong Wang , Jan Kautz , Sifei Liu

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman

Generative adversarial nets (GANs) have been successfully applied in many fields like image generation, inpainting, super-resolution and drug discovery, etc., by now, the inner process of GANs is far from been understood. To get deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Ziqiang Li , Rentuo Tao , Hongjing Niu , Bin Li