English
Related papers

Related papers: Bridging the Gap: Addressing Discrepancies in Diff…

200 papers

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Classifier-free guidance (CFG) is the de facto standard for conditional sampling in diffusion models, yet it often reduces sample diversity. Using tools from statistical physics, we analyze the emergence of generative distortions induced by…

Machine Learning · Statistics 2026-05-11 Enrico Ventura , Beatrice Achilli , Luca Ambrogioni , Carlo Lucibello

We introduce Spectral Guidance, a framework for controlling diffusion models by leveraging the intrinsic geometry of the generative process. As data is progressively corrupted by noise, only a small number of features remain informative for…

Machine Learning · Computer Science 2026-05-29 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Chenyan Xiong

Classifier-free guidance (CFG) is a fundamental tool in modern diffusion models for text-guided generation. Although effective, CFG has notable drawbacks. For instance, DDIM with CFG lacks invertibility, complicating image editing;…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Hyungjin Chung , Jeongsol Kim , Geon Yeong Park , Hyelin Nam , Jong Chul Ye

Diffusion models have demonstrated impressive generative capabilities, but their \textit{exposure bias} problem, described as the input mismatch between training and sampling, lacks in-depth exploration. In this paper, we systematically…

Machine Learning · Computer Science 2024-04-12 Mang Ning , Mingxiao Li , Jianlin Su , Albert Ali Salah , Itir Onal Ertugrul

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion and flow-based generative models, enabling high-quality conditional generation. A key theoretical challenge is characterizing the distribution induced by CFG,…

Machine Learning · Computer Science 2025-05-23 Krunoslav Lehman Pavasovic , Jakob Verbeek , Giulio Biroli , Marc Mezard

Classifier-free guidance (CFG) has become the standard method for enhancing the quality of conditional diffusion models. However, employing CFG requires either training an unconditional model alongside the main diffusion model or modifying…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Manuel Kansy , Otmar Hilliges , Romann M. Weber

Classifier-Free Guidance (CFG) is a widely used technique for improving conditional diffusion models by linearly combining the outputs of conditional and unconditional denoisers. While CFG enhances visual quality and improves alignment with…

Machine Learning · Computer Science 2025-05-28 Badr Moufad , Yazid Janati , Alain Durmus , Ahmed Ghorbel , Eric Moulines , Jimmy Olsson

Classifier-guided diffusion models generate conditional samples by augmenting the reverse-time score with the gradient of the log-probability predicted by a probabilistic classifier. In practice, this classifier is usually obtained by…

Machine Learning · Statistics 2026-02-06 Sharan Sahu , Arisina Banerjee , Yuchen Wu

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images through modifications…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Eleftherios Tsonis , Paraskevi Tzouveli , Athanasios Voulodimos

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

Machine Learning · Computer Science 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from…

Machine Learning · Computer Science 2024-06-03 Bartosz Cywiński , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski , Łukasz Kuciński

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Chenlin Meng , Robin Rombach , Ruiqi Gao , Diederik P. Kingma , Stefano Ermon , Jonathan Ho , Tim Salimans

While Classifier-Free Guidance (CFG) has become standard for improving sample fidelity in conditional diffusion models, it can harm diversity and induce memorization by applying constant guidance regardless of whether a particular sample…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Felix Koulischer , Florian Handke , Johannes Deleu , Thomas Demeester , Luca Ambrogioni

Recent advancements in diffusion models have revolutionized generative modeling. However, the impressive and vivid outputs they produce often come at the cost of significant model scaling and increased computational demands. Consequently,…

Machine Learning · Computer Science 2025-04-03 Jincheng Zhong , Xiangcheng Zhang , Jianmin Wang , Mingsheng Long

Popular guidance for denoising diffusion probabilistic model (DDPM) linearly combines distinct conditional models together to provide enhanced control over samples. However, this approach overlooks nonlinear effects that become significant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Candi Zheng , Yuan Lan

Diffusion models have recently achieved remarkable success in generative modeling, yet their training dynamics across different noise levels remain highly imbalanced, which can lead to inefficient optimization and unstable learning…

Machine Learning · Computer Science 2026-03-12 Nanlong Sun , Lei Shi

Classifier-free guidance (CFG) succeeds in condition diffusion models that use a guidance scale to balance the influence of conditional and unconditional terms. A high guidance scale is used to enhance the performance of the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Kaiyu Song , Hanjiang Lai