中文
相关论文

相关论文: Guidance Is Not a Hyperparameter: Learning Dynamic…

200 篇论文

Classifier-Free Guidance (CFG) is a widely used inference-time technique to boost the image quality of diffusion models. Yet, its reliance on text conditions prevents its use in unconditional generation. We propose a simple method to enable…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Weijia Zhang , Yuehao Liu , Shanyan Guan , Wu Ran , Yanhao Ge , Wei Li , Chao Ma

Classifier-Free Guidance (CFG) is an essential component of text-to-image diffusion models, and understanding and advancing its operational mechanisms remains a central focus of research. Existing approaches stem from divergent theoretical…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Kaibo Wang , Jianda Mao , Tong Wu , Yang Xiang

Aligning large-scale text-to-image diffusion models with nuanced human preferences remains challenging. While direct preference optimization (DPO) is simple and effective, large-scale finetuning often shows a generalization gap. We take…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Zhou Jiang , Yandong Wen , Zhen Liu

We introduce Policy Gradient Guidance (PGG), a simple extension of classifier-free guidance from diffusion models to classical policy gradient methods. PGG augments the policy gradient with an unconditional branch and interpolates…

机器学习 · 计算机科学 2025-10-03 Jianing Qi , Hao Tang , Zhigang Zhu

Classifier-free guidance (CFG) is a fundamental tool in modern diffusion models for text-guided generation. Although effective, CFG has notable drawbacks. For instance, DDIM with CFG lacks invertibility, complicating image editing;…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Hyungjin Chung , Jeongsol Kim , Geon Yeong Park , Hyelin Nam , Jong Chul Ye

Classifier-free Guidance (CFG) is a widely used technique in modern diffusion models for enhancing sample quality and prompt adherence. However, through an empirical analysis on Gaussian mixture modeling with a closed-form solution, we…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Chubin Chen , Jiashu Zhu , Xiaokun Feng , Nisha Huang , Chen Zhu , Meiqi Wu , Fangyuan Mao , Jiahong Wu , Xiangxiang Chu , Xiu Li

Classifier-free guidance has become a staple for conditional generation with denoising diffusion models. However, a comprehensive understanding of classifier-free guidance is still missing. In this work, we carry out an empirical study to…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Xiaoming Zhao , Alexander G. Schwing

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

Classifier-Free Guidance (CFG) has been widely used in text-to-image diffusion models, where the CFG scale is introduced to control the strength of text guidance on the whole image space. However, we argue that a global CFG scale results in…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Dazhong Shen , Guanglu Song , Zeyue Xue , Fu-Yun Wang , Yu Liu

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

机器学习 · 统计学 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Classifier-Free Guidance (CFG) is a widely used technique for improving conditional diffusion models by linearly combining the outputs of conditional and unconditional denoisers. While CFG enhances visual quality and improves alignment with…

机器学习 · 计算机科学 2025-05-28 Badr Moufad , Yazid Janati , Alain Durmus , Ahmed Ghorbel , Eric Moulines , Jimmy Olsson

Classifier-free guidance (CFG) has become the standard method for enhancing the quality of conditional diffusion models. However, employing CFG requires either training an unconditional model alongside the main diffusion model or modifying…

机器学习 · 计算机科学 2025-06-04 Seyedmorteza Sadat , Manuel Kansy , Otmar Hilliges , Romann M. Weber

Counterfactual generation aims to simulate realistic hypothetical outcomes under causal interventions. Diffusion models have emerged as a powerful tool for this task, combining DDIM inversion with conditional generation and classifier-free…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Tian Xia , Fabio De Sousa Ribeiro , Rajat R Rasal , Avinash Kori , Raghav Mehta , Ben Glocker

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

机器学习 · 计算机科学 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

Classifier-free guidance (CFG) is the de facto standard for conditional sampling in diffusion models, yet it often reduces sample diversity. Using tools from statistical physics, we analyze the emergence of generative distortions induced by…

机器学习 · 统计学 2026-05-11 Enrico Ventura , Beatrice Achilli , Luca Ambrogioni , Carlo Lucibello

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance these aspects, it…

机器学习 · 计算机科学 2025-06-04 Seyedmorteza Sadat , Otmar Hilliges , Romann M. Weber

This paper presents Model-guidance (MG), a novel objective for training diffusion model that addresses and removes of the commonly used Classifier-free guidance (CFG). Our innovative approach transcends the standard modeling of solely data…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Zhicong Tang , Jianmin Bao , Dong Chen , Baining Guo

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

图形学 · 计算机科学 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…