English
Related papers

Related papers: CFG++: Manifold-constrained Classifier Free Guidan…

200 papers

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other types of generative…

Machine Learning · Computer Science 2022-07-27 Jonathan Ho , Tim Salimans

Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Dar-Yen Chen , Hmrishav Bandyopadhyay , Kai Zou , Yi-Zhe Song

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Diffusion models achieve strong performance in generative modeling, but their success often relies heavily on classifier-free guidance (CFG), an inference-time heuristic that modifies the sampling trajectory. In theory, diffusion models…

Machine Learning · Computer Science 2026-05-14 Xiang Li , Yixuan Jia , Xiao Li , Jeffrey A. Fessler , Rongrong Wang , Qing Qu

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Classifier-Free Guidance (CFG) has recently emerged in text-to-image generation as a lightweight technique to encourage prompt-adherence in generations. In this work, we demonstrate that CFG can be used broadly as an inference-time…

Computation and Language · Computer Science 2023-07-03 Guillaume Sanchez , Honglu Fan , Alexander Spangher , Elad Levi , Pawan Sasanka Ammanamanchi , Stella Biderman

While classifier-free guidance (CFG) is essential for conditional diffusion models, it doubles the number of neural function evaluations (NFEs) per inference step. To mitigate this inefficiency, we introduce adapter guidance distillation…

Machine Learning · Computer Science 2025-03-11 Cristian Perez Jensen , Seyedmorteza Sadat

Diffusion models (DMs) have demonstrated an unparalleled ability to create diverse and high-fidelity images from text prompts. However, they are also well-known to vary substantially regarding both prompt adherence and quality. Negative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Alakh Desai , Nuno Vasconcelos

One-step text-to-image generator models offer advantages such as swift inference efficiency, flexible architectures, and state-of-the-art generation performance. In this paper, we study the problem of aligning one-step generator models with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Weijian Luo

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Classifier-Free Guidance (CFG) is a critical technique for enhancing the sample quality of visual generative models. However, in autoregressive (AR) multi-modal generation, CFG introduces design inconsistencies between language and visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Huayu Chen , Hang Su , Peize Sun , Jun Zhu

High-resolution image synthesis with diffusion models often suffers from energy instabilities and guidance artifacts that degrade visual quality. We analyze the latent energy landscape during sampling and propose adaptive classifier-free…

Graphics · Computer Science 2025-12-12 Ankit Sanjyal

The diffusion model presents a powerful ability to capture the entire (conditional) data distribution. However, due to the lack of sufficient training and data to learn to cover low-probability areas, the model will be penalized for failing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xingyu Zhou , Qifan Li , Xiaobin Hu , Hai Chen , Shuhang Gu

With the rapid development of text-to-vision generation diffusion models, classifier-free guidance has emerged as the most prevalent method for conditioning. However, this approach inherently requires twice as many steps for model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

Recent advances in diffusion models attempt to handle conditional generative tasks by utilizing a differentiable loss function for guidance without the need for additional training. While these methods achieved certain success, they often…

Machine Learning · Computer Science 2024-07-08 Lingxiao Yang , Shutong Ding , Yifan Cai , Jingyi Yu , Jingya Wang , Ye Shi

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Haosen Li , Wenshuo Chen , Lei Wang , Shaofeng Liang , Bowen Tian , Soning Lai , Yutao Yue

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images through modifications…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Eleftherios Tsonis , Paraskevi Tzouveli , Athanasios Voulodimos