English
Related papers

Related papers: KOALA: Empirical Lessons Toward Memory-Efficient a…

200 papers

This paper presents SANA-Sprint, an efficient diffusion model for ultra-fast text-to-image (T2I) generation. SANA-Sprint is built on a pre-trained foundation model and augmented with hybrid distillation, dramatically reducing inference…

Graphics · Computer Science 2025-09-30 Junsong Chen , Shuchen Xue , Yuyang Zhao , Jincheng Yu , Sayak Paul , Junyu Chen , Han Cai , Song Han , Enze Xie

The Stable Diffusion Model (SDM) is a popular and efficient text-to-image (t2i) generation and image-to-image (i2i) generation model. Although there have been some attempts to reduce sampling steps, model distillation, and network…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jinchao Zhu , Yuxuan Wang , Xiaobing Tu , Siyuan Pan , Pengfei Wan , Gao Huang

Recent advancements in diffusion models have positioned them at the forefront of image generation. Despite their superior performance, diffusion models are not without drawbacks; they are characterized by complex architectures and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuda Song , Zehao Sun , Xuanwu Yin

Text-embedded image generation plays a critical role in industries such as graphic design, advertising, and digital content creation. Text-to-Image generation methods leveraging diffusion models, such as TextDiffuser-2, have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kazi Mahathir Rahman , Showrin Rahman , Sharmin Sultana Srishty

Prevailing Dataset Distillation (DD) methods leveraging generative models confront two fundamental limitations. First, despite pioneering the use of diffusion models in DD and delivering impressive performance, the vast majority of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Letian Zhou , Songhua Liu , Xinchao Wang

Recent advances in text-to-image generation have primarily relied on extensive datasets and parameter-heavy architectures. These requirements severely limit accessibility for researchers and practitioners who lack substantial computational…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Xianfeng Wu , Yajing Bai , Haoze Zheng , Harold Haodong Chen , Yexin Liu , Zihao Wang , Xuran Ma , Wen-Jie Shu , Xianzu Wu , Harry Yang , Ser-Nam Lim

The Diffusion Model (DM) has emerged as the SOTA approach for image synthesis. However, the existing DM cannot perform well on some image-to-image translation (I2I) tasks. Different from image synthesis, some I2I tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Radu Timotfe , Luc Van Gool

Text-to-image (T2I) generative models, such as Stable Diffusion and DALL-E, have shown remarkable proficiency in producing high-quality, realistic, and natural images from textual descriptions. However, these models sometimes fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Arash Marioriyad , Parham Rezaei , Mahdieh Soleymani Baghshah , Mohammad Hossein Rohban

Artificial Intelligence-Generated Content (AIGC) has made significant strides, with high-resolution text-to-image (T2I) generation becoming increasingly critical for improving users' Quality of Experience (QoE). Although…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Chongbin Yi , Yuxin Liang , Ziqi Zhou , Peng Yang

As text-to-image models grow increasingly powerful and complex, their burgeoning size presents a significant obstacle to widespread adoption, especially on resource-constrained devices. This paper presents a pioneering study on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Samarth N Ramesh , Zhixue Zhao

Latent Consistency Models (LCMs) have achieved impressive performance in accelerating text-to-image generative tasks, producing high-quality images with minimal inference steps. LCMs are distilled from pre-trained latent diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simian Luo , Yiqin Tan , Suraj Patil , Daniel Gu , Patrick von Platen , Apolinário Passos , Longbo Huang , Jian Li , Hang Zhao

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

Text-to-image (T2I) models have recently experienced rapid development, achieving astonishing performance in terms of fidelity and textual alignment capabilities. However, given a long paragraph (up to 512 words), these generation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Weijia Wu , Zhuang Li , Yefei He , Mike Zheng Shou , Chunhua Shen , Lele Cheng , Yan Li , Tingting Gao , Di Zhang

The recent wave of AI-generated content has witnessed the great development and success of Text-to-Image (T2I) technologies. By contrast, Text-to-Video (T2V) still falls short of expectations though attracting increasing interests. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhen Xing , Qi Dai , Han Hu , Zuxuan Wu , Yu-Gang Jiang

Despite the impressive synthesis quality of text-to-image (T2I) diffusion models, their black-box deployment poses significant regulatory challenges: Malicious actors can fine-tune these models to generate illegal content, circumventing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhuomeng Zhang , Fangqi Li , Chong Di , Hongyu Zhu , Hanyi Wang , Shilin Wang

Text-to-image (T2I) diffusion models, notably the unCLIP models (e.g., DALL-E-2), achieve state-of-the-art (SOTA) performance on various compositional T2I benchmarks, at the cost of significant computational resources. The unCLIP stack…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Maitreya Patel , Changhoon Kim , Sheng Cheng , Chitta Baral , Yezhou Yang

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ahmad Süleyman , Göksel Biricik

Recent methods exploit the powerful text-to-image (T2I) diffusion models for real-world image super-resolution (Real-ISR) and achieve impressive results compared to previous models. However, we observe two kinds of inconsistencies in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Junhao Gu , Peng-Tao Jiang , Hao Zhang , Mi Zhou , Jinwei Chen , Wenming Yang , Bo Li

The intensive computational burden of Stable Diffusion (SD) for text-to-image generation poses a significant hurdle for its practical application. To tackle this challenge, recent research focuses on methods to reduce sampling steps, such…

We introduce W\"urstchen, a novel architecture for text-to-image synthesis that combines competitive performance with unprecedented cost-effectiveness for large-scale text-to-image diffusion models. A key contribution of our work is to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Pablo Pernias , Dominic Rampas , Mats L. Richter , Christopher J. Pal , Marc Aubreville