中文
相关论文

相关论文: Supercharged One-step Text-to-Image Diffusion Mode…

200 篇论文

Diffusion models achieve high-quality sample generation at the cost of a lengthy multistep inference procedure. To overcome this, diffusion distillation techniques produce student generators capable of matching or surpassing the teacher in…

机器学习 · 计算机科学 2024-12-04 Yanke Song , Jonathan Lorraine , Weili Nie , Karsten Kreis , James Lucas

Diffusion models have opened the path to a wide range of text-based image editing frameworks. However, these typically build on the multi-step nature of the diffusion backwards process, and adapting them to distilled, fast-sampling methods…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Gilad Deutch , Rinon Gal , Daniel Garibi , Or Patashnik , Daniel Cohen-Or

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

机器学习 · 统计学 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Dawid Malarz , Artur Kasymov , Maciej Zięba , Jacek Tabor , Przemysław Spurek

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

In this paper, we unify more than 10 existing one-step diffusion distillation approaches, such as Diff-Instruct, DMD, SIM, SiD, $f$-distill, etc, inside a theory-driven framework which we name the \textbf{\emph{Uni-Instruct}}. Uni-Instruct…

机器学习 · 计算机科学 2025-10-23 Yifei Wang , Weimin Bai , Colin Zhang , Debing Zhang , Weijian Luo , He Sun

Although diffusion model has shown great potential for generating higher quality images than GANs, slow sampling speed hinders its wide application in practice. Progressive distillation is thus proposed for fast sampling by progressively…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Wujie Sun , Defang Chen , Can Wang , Deshi Ye , Yan Feng , Chun Chen

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

图像与视频处理 · 电气工程与系统科学 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Diffusion models are well known for their ability to generate a high-fidelity image for an input prompt through an iterative denoising process. Unfortunately, the high fidelity also comes at a high computational cost due the inherently…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Qinchan Li , Kenneth Chen , Changyue Su , Wittawat Jitkrittum , Qi Sun , Patsorn Sangkloy

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos

Safety mechanisms for diffusion and flow models have recently been developed along two distinct paths. In robot planning, control barrier functions are employed to guide generative trajectories away from obstacles at every denoising step by…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Mingyu Kim , Young-Heon Kim , Mijung Park

Prompt learning has demonstrated promising results in fine-tuning pre-trained multimodal models. However, the performance improvement is limited when applied to more complex and fine-grained tasks. The reason is that most existing methods…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Weicai Yan , Wang Lin , Zirun Guo , Ye Wang , Fangming Feng , Xiaoda Yang , Zehan Wang , Tao Jin

The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Zikai Zhou , Muyao Wang , Shitong Shao , Lichen Bai , Haoyi Xiong , Bo Han , Zeke Xie

Sampling from pretrained diffusion and flow-matching models typically requires many forward passes to generate diverse and high-fidelity images. Existing distillation methods often rely on multiple auxiliary networks, carefully designed…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Yuan Zhang , Chenyi Li , Guoqing Ma , Jiajun Zha , Yuanming Yang , Bo Wang , Wei Tang , Wenbo Li , Haoyang Huang , Nan Duan

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance these aspects, it…

机器学习 · 计算机科学 2025-06-04 Seyedmorteza Sadat , Otmar Hilliges , Romann M. Weber

Despite substantial progress in text-to-image generation, achieving precise text-image alignment remains challenging, particularly for prompts with rich compositional structure or imaginative elements. To address this, we introduce Negative…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Sangha Park , Eunji Kim , Yeongtak Oh , Jooyoung Choi , Sungroh Yoon

Drag-based image editing using generative models provides precise control over image contents, enabling users to manipulate anything in an image with a few clicks. However, prevailing methods typically adopt $n$-step iterations for latent…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Xuanjia Zhao , Jian Guan , Congyi Fan , Dongli Xu , Youtian Lin , Haiwei Pan , Pengming Feng

Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Jianze Li , Jiezhang Cao , Yong Guo , Wenbo Li , Yulun Zhang

Training-free guided sampling in diffusion models leverages off-the-shelf pre-trained networks, such as an aesthetic evaluation model, to guide the generation process. Current training-free guided sampling algorithms obtain the guidance…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Jiachun Pan , Hanshu Yan , Jun Hao Liew , Jiashi Feng , Vincent Y. F. Tan

The pursuit of efficient and controllable high-quality content generation remains a central challenge in artificial intelligence-generated content (AIGC). While one-step generators, enabled by diffusion distillation techniques, offer…

机器学习 · 计算机科学 2025-06-25 Yihong Luo , Shuchen Xue , Tianyang Hu , Jing Tang