English
Related papers

Related papers: Mini-DALLE3: Interactive Text to Image by Promptin…

200 papers

Accurate color alignment in text-to-image (T2I) generation is critical for applications such as fashion, product visualization, and interior design, yet current diffusion models struggle with nuanced and compound color terms (e.g., Tiffany…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sung-Lin Tsai , Bo-Lun Huang , Yu Ting Shen , Cheng Yu Yeo , Chiang Tseng , Bo-Kai Ruan , Wen-Sheng Lien , Hong-Han Shuai

Recent text-to-image (T2I) models have benefited from large-scale and high-quality data, demonstrating impressive performance. However, these T2I models still struggle to produce images that are aesthetically pleasing, geometrically…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jianshu Guo , Wenhao Chai , Jie Deng , Hsiang-Wei Huang , Tian Ye , Yichen Xu , Jiawei Zhang , Jenq-Neng Hwang , Gaoang Wang

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

During the last two years there has been a plethora of large generative models such as ChatGPT or Stable Diffusion that have been published. Concretely, these models are able to perform tasks such as being a general question and answering…

Machine Learning · Computer Science 2023-01-13 Roberto Gozalo-Brizuela , Eduardo C. Garrido-Merchan

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

Text-to-Image (T2I) generation has made significant advancements with diffusion models, yet challenges persist in handling complex instructions, ensuring fine-grained content control, and maintaining deep semantic consistency. Existing T2I…

Machine Learning · Computer Science 2025-08-08 Xiaoqi Dong , Xiangyu Zhou , Nicholas Evans , Yujia Lin

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

Recently, the strong latent Diffusion Probabilistic Model (DPM) has been applied to high-quality Text-to-Image (T2I) generation (e.g., Stable Diffusion), by injecting the encoded target text prompt into the gradually denoised diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Mingyang Yi , Aoxue Li , Yi Xin , Zhenguo Li

In the last two years, text-to-image diffusion models have become extremely popular. As their quality and usage increase, a major concern has been the need for better output control. In addition to prompt engineering, one effective method…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Clément Bonnet , Ariel N. Lee , Franck Wertel , Antoine Tamano , Tanguy Cizain , Pablo Ducru

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing…

Human-Computer Interaction · Computer Science 2023-01-06 Nassim Dehouche , Kullathida Dehouche

As the field of image generation rapidly advances, traditional diffusion models and those integrated with multimodal large language models (LLMs) still encounter limitations in interpreting complex prompts and preserving image consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xinyu Zhang , Mengxue Kang , Fei Wei , Shuang Xu , Yuhe Liu , Lin Ma

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

Text-to-image generative models can produce diverse high-quality images of concepts with a text prompt, which have demonstrated excellent ability in image generation, image translation, etc. We in this work study the problem of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Gan Sun , Wenqi Liang , Jiahua Dong , Jun Li , Zhengming Ding , Yang Cong

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Advanced diffusion-based Text-to-Image (T2I) models, such as the Stable Diffusion Model, have made significant progress in generating diverse and high-quality images using text prompts alone. However, when non-famous users require…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yang Li , Songlin Yang , Wei Wang , Jing Dong

Existing text-to-image (T2I) diffusion models usually struggle in interpreting complex prompts, especially those with quantity, object-attribute binding, and multi-subject descriptions. In this work, we introduce a semantic panel as the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yutong Feng , Biao Gong , Di Chen , Yujun Shen , Yu Liu , Jingren Zhou

The advancements in the domain of LLMs in recent years have surprised many, showcasing their remarkable capabilities and diverse applications. Their potential applications in various real-world scenarios have led to significant research on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Sujith Vemishetty , Advitiya Arora , Anupama Sharma

Large-scale text-to-image diffusion models have been a revolutionary milestone in the evolution of generative AI and multimodal technology, allowing wonderful image generation with natural-language text prompt. However, the issue of lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xiang Gao , Jiaying Liu

In recent years, Generative Artificial Intelligence (GenAI) has undergone a profound transformation in addressing intricate tasks involving diverse modalities such as textual, auditory, visual, and pictorial generation. Within this…

Artificial Intelligence · Computer Science 2024-08-02 Felipe Mahlow , André Felipe Zanella , William Alberto Cruz Castañeda , Regilene Aparecida Sarzi-Ribeiro