English
Related papers

Related papers: Style Generation: Image Synthesis based on Coarsel…

200 papers

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

Machine Learning · Computer Science 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Current text conditioned image generation methods output realistic looking images, but they fail to capture specific styles. Simply finetuning them on the target style datasets still struggles to grasp the style features. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Serkan Ozturk , Samet Hicsonmez , Pinar Duygulu

Synthesizing photo-realistic images from text descriptions is a challenging problem. Previous studies have shown remarkable progresses on visual quality of the generated images. In this paper, we consider semantics from the input text…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Guojun Yin , Bin Liu , Lu Sheng , Nenghai Yu , Xiaogang Wang , Jing Shao

Large-scale Text-to-Image (T2I) models have rapidly gained prominence across creative fields, generating visually compelling outputs from textual prompts. However, controlling these models to ensure consistent style remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Amir Hertz , Andrey Voynov , Shlomi Fruchter , Daniel Cohen-Or

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

We focus on the foundational task of Scene Staging: given a reference scene image and a text condition specifying an actor category to be generated in the scene and its spatial relation to the scene, the goal is to synthesize an output…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Cong Xie , Che Wang , Yan Zhang , Ruiqi Yu , Han Zou , Zheng Pan , Zhenpeng Zhan

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Despite significant progress on current state-of-the-art image generation models, synthesis of document images containing multiple and complex object layouts is a challenging task. This paper presents a novel approach, called DocSynth, to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Sanket Biswas , Pau Riba , Josep Lladós , Umapada Pal

Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Miriam Cha , Youngjune Gwon , H. T. Kung

Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zhiheng Li , Martin Renqiang Min , Kai Li , Chenliang Xu

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language processing, and achieves…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 He Huang , Philip S. Yu , Changhu Wang

We describe a new approach that improves the training of generative adversarial nets (GANs) for synthesizing diverse images from a text input. Our approach is based on the conditional version of GANs and expands on previous work leveraging…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Miriam Cha , Youngjune L. Gwon , H. T. Kung