English
Related papers

Related papers: TCFG: Tangential Damping Classifier-free Guidance

200 papers

Classifier-free guidance (CFG) is the workhorse for steering large diffusion models toward text-conditioned targets, yet its native application to rectified flow (RF) based models provokes severe off-manifold drift, yielding visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shreshth Saini , Shashank Gupta , Alan C. Bovik

Classifier-free guidance (CFG) is a core technique powering state-of-the-art image generation systems, yet its underlying mechanisms remain poorly understood. In this work, we begin by analyzing CFG in a simplified linear diffusion model,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xiang Li , Rongrong Wang , Qing Qu

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

Machine Learning · Computer Science 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu

Classifier-Free Guidance (CFG) has emerged as a central approach for enhancing semantic alignment in flow-based diffusion models. In this paper, we explore a unified framework called CFG-Ctrl, which reinterprets CFG as a control applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Hanyang Wang , Yiyang Liu , Jiawei Chi , Fangfu Liu , Ran Xue , Yueqi Duan

Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Dawid Malarz , Artur Kasymov , Maciej Zięba , Jacek Tabor , Przemysław Spurek

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

This paper presents a comprehensive study on the role of Classifier-Free Guidance (CFG) in text-conditioned diffusion models from the perspective of inference efficiency. In particular, we relax the default choice of applying CFG in all…

Current sampling mechanisms for conditional diffusion models rely mainly on Classifier Free Guidance (CFG) to generate high-quality images. However, CFG requires several denoising passes in each time step, e.g., up to three passes in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mehdi Noroozi , Alberto Gil Ramos , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Abhinav Mehrotra , Sourav Bhattacharya

While Classifier-Free Guidance (CFG) has become standard for improving sample fidelity in conditional diffusion models, it can harm diversity and induce memorization by applying constant guidance regardless of whether a particular sample…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Felix Koulischer , Florian Handke , Johannes Deleu , Thomas Demeester , Luca Ambrogioni

Classifier-Free Guidance (CFG) is a widely used technique for conditional generation and improving sample quality in continuous diffusion models, and its extensions to discrete diffusion has recently started to be investigated. In order to…

Machine Learning · Computer Science 2026-03-04 Kevin Rojas , Ye He , Chieh-Hsin Lai , Yuhta Takida , Yuki Mitsufuji , Molei Tao

In zero-shot text-to-speech, achieving a balance between fidelity to the target speaker and adherence to text content remains a challenge. While classifier-free guidance (CFG) strategies have shown promising results in image generation,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 John Zheng , Farhad Maleki

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Haosen Li , Wenshuo Chen , Lei Wang , Shaofeng Liang , Bowen Tian , Soning Lai , Yutao Yue

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models trained on Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Weichen Fan , Amber Yijia Zheng , Raymond A. Yeh , Ziwei Liu

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

Machine Learning · Computer Science 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

Score-based generative models require guidance in order to generate plausible, on-manifold samples. The most popular guidance method, Classifier-Free Guidance (CFG), is only applicable in settings with labeled data and requires training an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Eric Yeats , Darryl Hannan , Wilson Fearn , Timothy Doster , Henry Kvinge , Scott Mahan

This paper presents Model-guidance (MG), a novel objective for training diffusion model that addresses and removes of the commonly used Classifier-free guidance (CFG). Our innovative approach transcends the standard modeling of solely data…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zhicong Tang , Jianmin Bao , Dong Chen , Baining Guo

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Classifier-Free Guidance (CFG) significantly enhances controllability in generative models by interpolating conditional and unconditional predictions. However, standard CFG often employs a static unconditional input, which can be suboptimal…

Computation and Language · Computer Science 2025-05-27 Pengxiang Li , Shilin Yan , Joey Tsai , Renrui Zhang , Ruichuan An , Ziyu Guo , Xiaowei Gao

Classifier-free guidance (CFG) has become an essential component of modern conditional diffusion models. Although highly effective in practice, the underlying mechanisms by which CFG enhances quality, detail, and prompt alignment are not…

Machine Learning · Computer Science 2025-06-25 Seyedmorteza Sadat , Tobias Vontobel , Farnood Salehi , Romann M. Weber

In many engineering and applied science domains, high-dimensional nonlinear filtering is still a challenging problem. Recent advances in score-based diffusion models offer a promising alternative for posterior sampling but require repeated…

Machine Learning · Computer Science 2025-09-25 Zhijun Zeng , Weiye Gan , Junqing Chen , Zuoqiang Shi