English
Related papers

Related papers: Supercharged One-step Text-to-Image Diffusion Mode…

200 papers

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chaoyang Wang , Yunhai Tong

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

In image editing employing diffusion models, it is crucial to preserve the reconstruction fidelity to the original image while changing its style. Although existing methods ensure reconstruction fidelity through optimization, a drawback of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Daiki Miyake , Akihiro Iohara , Yu Saito , Toshiyuki Tanaka

While classifier-free guidance (CFG) is essential for conditional diffusion models, it doubles the number of neural function evaluations (NFEs) per inference step. To mitigate this inefficiency, we introduce adapter guidance distillation…

Machine Learning · Computer Science 2025-03-11 Cristian Perez Jensen , Seyedmorteza Sadat

Diffusion-based image compression has demonstrated impressive perceptual performance. However, it suffers from two critical drawbacks: (1) excessive decoding latency due to multi-step sampling, and (2) poor fidelity resulting from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zheng Chen , Mingde Zhou , Jinpei Guo , Jiale Yuan , Yifei Ji , Yulun Zhang

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

As Classifier-Free Guidance (CFG) has proven effective in conditional diffusion model sampling for improved condition alignment, many applications use a negated CFG term to filter out unwanted features from samples. However, simply negating…

Machine Learning · Computer Science 2024-11-27 Jinho Chang , Hyungjin Chung , Jong Chul Ye

We found that enforcing guidance throughout the sampling process is often counterproductive due to the model-fitting issue, where samples are 'tuned' to match the classifier's parameters rather than generalizing the expected condition. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Anh-Dung Dinh , Daochang Liu , Chang Xu

Classifier-Free Guidance (CFG) is a widely used technique for conditional generation and improving sample quality in continuous diffusion models, and its extensions to discrete diffusion has recently started to be investigated. In order to…

Machine Learning · Computer Science 2026-03-04 Kevin Rojas , Ye He , Chieh-Hsin Lai , Yuhta Takida , Yuki Mitsufuji , Molei Tao

In text-to-image generation, using negative prompts, which describe undesirable image characteristics, can significantly boost image quality. However, producing good negative prompts is manual and tedious. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Michael Ogezi , Ning Shi

Despite their strong performances on many generative tasks, diffusion models require a large number of sampling steps in order to generate realistic samples. This has motivated the community to develop effective methods to distill…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Weijian Luo , Zemin Huang , Zhengyang Geng , J. Zico Kolter , Guo-jun Qi

Sampling from diffusion models involves a slow iterative process that hinders their practical deployment, especially for interactive applications. To accelerate generation speed, recent approaches distill a multi-step diffusion model into a…

Machine Learning · Computer Science 2025-03-11 Yilun Xu , Weili Nie , Arash Vahdat

Diffusion distillation has emerged as a promising strategy for accelerating text-to-image (T2I) diffusion models by distilling a pretrained score network into a one- or few-step generator. While existing methods have made notable progress,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingyuan Zhou , Yi Gu , Zhendong Wang

Text-to-image diffusion models enable high-quality image generation but are computationally expensive. While prior work optimizes per-inference efficiency, we explore an orthogonal approach: reducing redundancy across correlated prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Dale Decatur , Thibault Groueix , Wang Yifan , Rana Hanocka , Vladimir Kim , Matheus Gadelha

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

Diffusion models (DMs) have demonstrated exceptional performance in text-to-image tasks, leading to their widespread use. With the introduction of classifier-free guidance (CFG), the quality of images generated by DMs is significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiadong Pan , Liang Li , Hongcheng Gao , Zheng-Jun Zha , Qingming Huang , Jiebo Luo

The advancements in automatic text-to-3D generation have been remarkable. Most existing methods use pre-trained text-to-image diffusion models to optimize 3D representations like Neural Radiance Fields (NeRFs) via latent-space denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Junzhe Zhu , Peiye Zhuang , Sanmi Koyejo

Denoising diffusion models excel at generating high-quality images conditioned on text prompts, yet their effectiveness heavily relies on careful guidance during the sampling process. Classifier-Free Guidance (CFG) provides a widely used…

Graphics · Computer Science 2026-03-04 Shai Yehezkel , Omer Dahary , Andrey Voynov , Daniel Cohen-Or

Recent advances have substantially improved real-time interactive video generation in the autoregressive regime. However, most existing few-step autoregressive video generation methods, often distilled from a corresponding many-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Jiaqi Feng , Justin Cui , Yuanhao Ban , Cho-Jui Hsieh