English
Related papers

Related papers: In-situ Autoguidance: Eliciting Self-Correction in…

200 papers

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Guidance in image generation steers models towards higher-quality or more targeted outputs, typically achieved in Diffusion Models (DMs) via Classifier-free Guidance (CFG). However, recent Consistency Models (CMs), which offer fewer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Chia-Hong Hsu , Shiu-hong Kao , Randall Balestriero

Classifier-Free Guidance (CFG) significantly enhances controllability in generative models by interpolating conditional and unconditional predictions. However, standard CFG often employs a static unconditional input, which can be suboptimal…

Computation and Language · Computer Science 2025-05-27 Pengxiang Li , Shilin Yan , Joey Tsai , Renrui Zhang , Ruichuan An , Ziyu Guo , Xiaowei Gao

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Classifier-free guidance (CFG) is a core technique powering state-of-the-art image generation systems, yet its underlying mechanisms remain poorly understood. In this work, we begin by analyzing CFG in a simplified linear diffusion model,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xiang Li , Rongrong Wang , Qing Qu

Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Nithin Gopalakrishnan Nair , Vishal M Patel

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models trained on Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Weichen Fan , Amber Yijia Zheng , Raymond A. Yeh , Ziwei Liu

Classifier-Free Guidance (CFG) is a critical technique for enhancing the sample quality of visual generative models. However, in autoregressive (AR) multi-modal generation, CFG introduces design inconsistencies between language and visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Huayu Chen , Hang Su , Peize Sun , Jun Zhu

Classifier-free guidance (CFG) is a widely used technique for controllable generation in diffusion and flow-based models. Despite its empirical success, CFG relies on a heuristic linear extrapolation that is often sensitive to the guidance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jian-Feng Cai , Haixia Liu , Zhengyi Su , Chao Wang

Diffusion models have achieved remarkable success in text-to-image synthesis, largely attributed to the use of classifier-free guidance (CFG), which enables high-quality, condition-aligned image generation. CFG combines the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mingi Kwon , Shin seong Kim , Jaeseok Jeong. Yi Ting Hsiao , Youngjung Uh

Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Dawid Malarz , Artur Kasymov , Maciej Zięba , Jacek Tabor , Przemysław Spurek

Denoising diffusion models excel at generating high-quality images conditioned on text prompts, yet their effectiveness heavily relies on careful guidance during the sampling process. Classifier-Free Guidance (CFG) provides a widely used…

Graphics · Computer Science 2026-03-04 Shai Yehezkel , Omer Dahary , Andrey Voynov , Daniel Cohen-Or

Proper guidance strategies are essential to achieve high-quality generation results without retraining diffusion and flow-based text-to-image models. Existing guidance either requires specific training or strong inductive biases of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tiancheng Li , Weijian Luo , Zhiyang Chen , Liyuan Ma , Guo-Jun Qi

Classifier-free guidance (CFG) is the workhorse for steering large diffusion models toward text-conditioned targets, yet its native application to rectified flow (RF) based models provokes severe off-manifold drift, yielding visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shreshth Saini , Shashank Gupta , Alan C. Bovik

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Counterfactual generation aims to simulate realistic hypothetical outcomes under causal interventions. Diffusion models have emerged as a powerful tool for this task, combining DDIM inversion with conditional generation and classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Tian Xia , Fabio De Sousa Ribeiro , Rajat R Rasal , Avinash Kori , Raghav Mehta , Ben Glocker

Classifier-free guidance (CFG) has helped diffusion models achieve great conditional generation in various fields. Recently, more diffusion guidance methods have emerged with improved generation quality and human preference. However, can…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Dian Xie , Shitong Shao , Lichen Bai , Zikai Zhou , Bojun Cheng , Shuo Yang , Jun Wu , Zeke Xie

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

Machine Learning · Computer Science 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt ($\varnothing$) generates a guidance signal prone to geometric entanglement. This is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shilong Han , Yuming Zhang , Hongxia Wang