English
Related papers

Related papers: On the Scalability of Diffusion-based Text-to-Imag…

200 papers

The incredible generative ability of large-scale text-to-image (T2I) models has demonstrated strong power of learning complex structures and meaningful semantics. However, relying solely on text prompts cannot fully take advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Chong Mou , Xintao Wang , Liangbin Xie , Yanze Wu , Jian Zhang , Zhongang Qi , Ying Shan , Xiaohu Qie

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Learning-based Text-to-Image (TTI) models like Stable Diffusion have revolutionized the way visual content is generated in various domains. However, recent research has shown that nonnegligible social bias exists in current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ruifei He , Chuhui Xue , Haoru Tan , Wenqing Zhang , Yingchen Yu , Song Bai , Xiaojuan Qi

Currently, the success of large language models (LLMs) illustrates that a unified multitasking approach can significantly enhance model usability, streamline deployment, and foster synergistic benefits across different tasks. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Bin Xia , Yuechen Zhang , Jingyao Li , Chengyao Wang , Yitong Wang , Xinglong Wu , Bei Yu , Jiaya Jia

Text encoders in diffusion models have rapidly evolved, transitioning from CLIP to T5-XXL. Although this evolution has significantly enhanced the models' ability to understand complex prompts and generate text, it also leads to a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Lifu Wang , Daqing Liu , Xinchen Liu , Xiaodong He

Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Benlei Cui , Bukun Huang , Zhizeng Ye , Xuemei Dong , Tuo Chen , Hui Xue , Dingkang Yang , Longtao Huang , Jingqun Tang , Haiwen Hong

Text-to-Image (T2I) diffusion/flow models have recently achieved remarkable progress in visual fidelity and text alignment. However, they remain limited when users need to precisely control image layouts, something that natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Amadou S. Sangare , Adrien Maglo , Mohamed Chaouch , Bertrand Luvison

The predominant approach to advancing text-to-image generation has been training-time scaling, where larger models are trained on more data using greater computational resources. While effective, this approach is computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Shufan Li , Konstantinos Kallidromitis , Akash Gokul , Arsh Koneru , Yusuke Kato , Kazuki Kozuka , Aditya Grover

Recently, pre-trained text-to-image (T2I) models have been extensively adopted for real-world image restoration because of their powerful generative prior. However, controlling these large models for image restoration usually requires a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Junyuan Deng , Xinyi Wu , Yongxing Yang , Congchao Zhu , Song Wang , Zhenyao Wu

Large-scale diffusion models have achieved state-of-the-art results on text-to-image synthesis (T2I) tasks. Despite their ability to generate high-quality yet creative images, we observe that attribution-binding and compositional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Weixi Feng , Xuehai He , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , Xin Eric Wang , William Yang Wang

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Visual generation grounded in Visual Foundation Model (VFM) representations offers a highly promising unified pathway for integrating visual understanding, perception, and generation. Despite this potential, training large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Minglei Shi , Haolin Wang , Borui Zhang , Wenzhao Zheng , Bohan Zeng , Ziyang Yuan , Xiaoshi Wu , Yuanxing Zhang , Huan Yang , Xintao Wang , Pengfei Wan , Kun Gai , Jie Zhou , Jiwen Lu

The rapid advancement of text-to-image Diffusion Models has led to their widespread public accessibility. However these models, trained on large internet datasets, can sometimes generate undesirable outputs. To mitigate this, approximate…

Machine Learning · Computer Science 2024-11-05 Andrea Schioppa , Emiel Hoogeboom , Jonathan Heek

As scaling laws in generative AI push performance, they also simultaneously concentrate the development of these models among actors with large computational resources. With a focus on text-to-image (T2I) generative models, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Vikash Sehwag , Xianghao Kong , Jingtao Li , Michael Spranger , Lingjuan Lyu

The text to medical image (T2MedI) with latent diffusion model has great potential to alleviate the scarcity of medical imaging data and explore the underlying appearance distribution of lesions in a specific patient status description.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Xu Han , Fangfang Fan , Jingzhao Rong , Zhen Li , Georges El Fakhri , Qingyu Chen , Xiaofeng Liu

Recent advancements in Virtual Try-On (VTO) have demonstrated exceptional efficacy in generating realistic images and preserving garment details, largely attributed to the robust generative capabilities of text-to-image (T2I) diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhenchen Wan , Yanwu Xu , Zhaoqing Wang , Feng Liu , Tongliang Liu , Mingming Gong

In this study, we aim to enhance the capabilities of diffusion-based text-to-image (T2I) generation models by integrating diverse modalities beyond textual descriptions within a unified framework. To this end, we categorize widely used…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Sungnyun Kim , Junsoo Lee , Kibeom Hong , Daesik Kim , Namhyuk Ahn

Text-to-Image (T2I) diffusion models have made remarkable advancements in generative modeling; however, they face a trade-off between inference speed and image quality, posing challenges for efficient deployment. Existing distilled T2I…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Senmao Li , Lei Wang , Kai Wang , Tao Liu , Jiehang Xie , Joost van de Weijer , Fahad Shahbaz Khan , Shiqi Yang , Yaxing Wang , Jian Yang

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

Diffusion models have made significant progress in both text-to-image (T2I) generation and text-guided image editing. However, these models are typically built with billions of parameters, leading to high latency and increased deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Kailai Feng , Yuxiang Wei , Bo Chen , Yang Pan , Hu Ye , Songwei Liu , Chenqian Yan , Yuan Gao