English
Related papers

Related papers: Factored Classifier-Free Guidance

200 papers

Classifier-free guidance (CFG) succeeds in condition diffusion models that use a guidance scale to balance the influence of conditional and unconditional terms. A high guidance scale is used to enhance the performance of the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Kaiyu Song , Hanjiang Lai

Classifier-Free Guidance (CFG) is a critical technique for enhancing the sample quality of visual generative models. However, in autoregressive (AR) multi-modal generation, CFG introduces design inconsistencies between language and visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Huayu Chen , Hang Su , Peize Sun , Jun Zhu

Classifier-Free Guidance (CFG) has recently emerged in text-to-image generation as a lightweight technique to encourage prompt-adherence in generations. In this work, we demonstrate that CFG can be used broadly as an inference-time…

Computation and Language · Computer Science 2023-07-03 Guillaume Sanchez , Honglu Fan , Alexander Spangher , Elad Levi , Pawan Sasanka Ammanamanchi , Stella Biderman

Machine learning models that automate decision-making are increasingly used in consequential areas such as loan approvals, pretrial bail approval, and hiring. Unfortunately, most of these models are black boxes, i.e., they are unable to…

Artificial Intelligence · Computer Science 2024-05-28 Sopam Dasgupta , Joaquín Arias , Elmer Salazar , Gopal Gupta

Classifier-Free Guidance (CFG) is a widely used mechanism for controlling diffusion-based generative models, yet its guidance scale is typically treated as a fixed hyperparameter throughout generation. This static design yields a suboptimal…

Computation and Language · Computer Science 2026-05-11 Fan Zhou , Tim Van de Cruys

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

Machine Learning · Computer Science 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu

This paper presents a comprehensive study on the role of Classifier-Free Guidance (CFG) in text-conditioned diffusion models from the perspective of inference efficiency. In particular, we relax the default choice of applying CFG in all…

This paper presents Model-guidance (MG), a novel objective for training diffusion model that addresses and removes of the commonly used Classifier-free guidance (CFG). Our innovative approach transcends the standard modeling of solely data…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zhicong Tang , Jianmin Bao , Dong Chen , Baining Guo

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt ($\varnothing$) generates a guidance signal prone to geometric entanglement. This is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shilong Han , Yuming Zhang , Hongxia Wang

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Classifier-free guidance (CFG) is a cornerstone of text-to-image diffusion models, yet its effectiveness is limited by the use of static guidance scales. This "one-size-fits-all" approach fails to adapt to the diverse requirements of…

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

Classifier-free guidance (CFG) is the workhorse for steering large diffusion models toward text-conditioned targets, yet its native application to rectified flow (RF) based models provokes severe off-manifold drift, yielding visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shreshth Saini , Shashank Gupta , Alan C. Bovik

Diffusion models (DMs) have demonstrated exceptional performance in text-to-image tasks, leading to their widespread use. With the introduction of classifier-free guidance (CFG), the quality of images generated by DMs is significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiadong Pan , Liang Li , Hongcheng Gao , Zheng-Jun Zha , Qingming Huang , Jiebo Luo

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance these aspects, it…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Otmar Hilliges , Romann M. Weber

Classifier-free guidance (CFG) is a key technique for improving conditional generation in diffusion models, enabling more accurate control while enhancing sample quality. It is natural to extend this technique to video diffusion, which…

Machine Learning · Computer Science 2025-07-25 Kiwhan Song , Boyuan Chen , Max Simchowitz , Yilun Du , Russ Tedrake , Vincent Sitzmann

Classifier-free guidance (CFG) has become the standard method for enhancing the quality of conditional diffusion models. However, employing CFG requires either training an unconditional model alongside the main diffusion model or modifying…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Manuel Kansy , Otmar Hilliges , Romann M. Weber

Diffusion models have achieved remarkable success in text-to-image synthesis, largely attributed to the use of classifier-free guidance (CFG), which enables high-quality, condition-aligned image generation. CFG combines the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mingi Kwon , Shin seong Kim , Jaeseok Jeong. Yi Ting Hsiao , Youngjung Uh

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models trained on Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Weichen Fan , Amber Yijia Zheng , Raymond A. Yeh , Ziwei Liu