English
Related papers

Related papers: Prompt-Free Diffusion: Taking "Text" out of Text-t…

200 papers

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion…

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Text-to-image (T2I) models offer great potential for creating virtually limitless synthetic data, a valuable resource compared to fixed and finite real datasets. Previous works evaluate the utility of synthetic data from T2I models on three…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhang Xiaofeng , Aaron Courville , Michal Drozdzal , Adriana Romero-Soriano

Despite the progress in text-to-image generation, semantic image editing remains a challenge. Inversion-based algorithms unavoidably introduce reconstruction errors, while instruction-based models mainly suffer from limited dataset quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 En Ci , Shanyan Guan , Yanhao Ge , Yilin Zhang , Wei Li , Zhenyu Zhang , Jian Yang , Ying Tai

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing…

Human-Computer Interaction · Computer Science 2023-01-06 Nassim Dehouche , Kullathida Dehouche

The incredible generative ability of large-scale text-to-image (T2I) models has demonstrated strong power of learning complex structures and meaningful semantics. However, relying solely on text prompts cannot fully take advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Chong Mou , Xintao Wang , Liangbin Xie , Yanze Wu , Jian Zhang , Zhongang Qi , Ying Shan , Xiaohu Qie

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang

We consider the problem of customizing text-to-image diffusion models with user-supplied reference images. Given new prompts, the existing methods can capture the key concept from the reference images but fail to align the generated image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

Large-scale text-to-image (T2I) diffusion models excel at open-domain synthesis but still struggle with precise text rendering, especially for multi-line layouts, dense typography, and long-tailed scripts such as Chinese. Prior solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Ruiqiang Zhang , Hengyi Wang , Chang Liu , Guanjie Wang , Zehua Ma , Weiming Zhang

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

Cryptography and Security · Computer Science 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

Existing text-to-image (T2I) benchmarks largely rely on fixed prompt sets, leaving them vulnerable to overfitting and benchmark contamination once publicly released and repeatedly reused. In this work, we propose DynT2I-Eval, a fully…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Juntong Wang , Jiarui Wang , Huiyu Duan , Lewei Li , Guangtao Zhai , Xiongkuo Min

Text-to-image (T2I) customization aims to create images that embody specific visual concepts delineated in textual descriptions. However, existing works still face a main challenge, concept overfitting. To tackle this challenge, we first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Weili Zeng , Yichao Yan , Qi Zhu , Zhuo Chen , Pengzhi Chu , Weiming Zhao , Xiaokang Yang

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Advanced diffusion-based Text-to-Image (T2I) models, such as the Stable Diffusion Model, have made significant progress in generating diverse and high-quality images using text prompts alone. However, when non-famous users require…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yang Li , Songlin Yang , Wei Wang , Jing Dong

Text-to-image (T2I) models have significantly advanced in producing high-quality images. However, such models have the ability to generate images containing not-safe-for-work (NSFW) content, such as pornography, violence, political content,…

Cryptography and Security · Computer Science 2025-05-15 Longtian Wang , Xiaofei Xie , Tianlin Li , Yuhan Zhi , Chao Shen

Recent advances in diffusion models have notably enhanced text-to-image (T2I) generation quality, but they also raise the risk of generating unsafe content. Traditional safety methods like text blacklisting or harmful content classification…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zongsheng Cao , Yangfan He , Anran Liu , Jun Xie , Feng Chen , Zepeng Wang

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

Computation and Language · Computer Science 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

Text-to-image generative models have recently garnered significant attention due to their ability to generate images based on prompt descriptions. While these models have shown promising performance, concerns have been raised regarding the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Meiling Li , Zhenxing Qian , Xinpeng Zhang