English
Related papers

Related papers: Training-Free Guidance Beyond Differentiability: S…

200 papers

Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the…

Methodology · Statistics 2010-11-23 Matthew A. Taddy , Robert B. Gramacy , Nicholas G. Polson

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

With the rapid development of text-to-vision generation diffusion models, classifier-free guidance has emerged as the most prevalent method for conditioning. However, this approach inherently requires twice as many steps for model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

Reinforcement learning with stochastic optimal control offers a promising framework for diffusion fine-tuning, where a pre-trained diffusion model is optimized to generate paths that lead to a reward-tilted distribution. While these…

Machine Learning · Computer Science 2025-09-30 Sophia Tang , Yuchen Zhu , Molei Tao , Pranam Chatterjee

Guidance in conditional diffusion generation is of great importance for sample quality and controllability. However, existing guidance schemes are to be desired. On one hand, mainstream methods such as classifier guidance and…

Machine Learning · Computer Science 2023-10-18 Jiajun Ma , Tianyang Hu , Wenjia Wang , Jiacheng Sun

Training-free guidance methods for continuous data have seen an explosion of interest due to the fact that they enable foundation diffusion models to be paired with interchangable guidance models. Currently, equivalent guidance methods for…

Machine Learning · Statistics 2024-09-12 Thomas J. Kerby , Kevin R. Moon

This paper presents a diffusion-based recommender system that incorporates classifier-free guidance. Most current recommender systems provide recommendations using conventional methods such as collaborative or content-based filtering.…

Information Retrieval · Computer Science 2024-09-17 Noah Buchanan , Susan Gauch , Quan Mai

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Classifier-Free Guidance (CFG) is an essential component of text-to-image diffusion models, and understanding and advancing its operational mechanisms remains a central focus of research. Existing approaches stem from divergent theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Kaibo Wang , Jianda Mao , Tong Wu , Yang Xiang

Can a text-to-image diffusion model be used as a training objective for adapting a GAN generator to another domain? In this paper, we show that the classifier-free guidance can be leveraged as a critic and enable generators to distill…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kunpeng Song , Ligong Han , Bingchen Liu , Dimitris Metaxas , Ahmed Elgammal

In this paper, we propose Tortoise and Hare Guidance (THG), a training-free strategy that accelerates diffusion sampling while maintaining high-fidelity generation. We demonstrate that the noise estimate and the additional guidance term…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yunghee Lee , Byeonghyun Pak , Junwha Hong , Hoseong Kim

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion and flow-based generative models, enabling high-quality conditional generation. A key theoretical challenge is characterizing the distribution induced by CFG,…

Machine Learning · Computer Science 2025-05-23 Krunoslav Lehman Pavasovic , Jakob Verbeek , Giulio Biroli , Marc Mezard

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Code generation is increasingly critical for real-world applications. Still, diffusion-based large language models continue to struggle with this demand. Unlike free-form text, code requires syntactic precision; even minor structural…

Computation and Language · Computer Science 2026-01-07 Yiming Zeng , Jinghan Cao , Zexin Li , Yiming Chen , Tao Ren , Zhuochun Li , Dawei Xiang , Xidong Wu , Shangqian Gao , Tingting Yu

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

Flow matching has shown state-of-the-art performance in various generative tasks, ranging from image generation to decision-making, where generation under energy guidance (abbreviated as guidance in the following) is pivotal. However, the…

Machine Learning · Computer Science 2025-05-27 Ruiqi Feng , Chenglei Yu , Wenhao Deng , Peiyan Hu , Tailin Wu

Classifier-Free Guidance (CFG) is a widely used mechanism for controlling diffusion-based generative models, yet its guidance scale is typically treated as a fixed hyperparameter throughout generation. This static design yields a suboptimal…

Computation and Language · Computer Science 2026-05-11 Fan Zhou , Tim Van de Cruys

Diffusion models are emerging expressive generative models, in which a large number of time steps (inference steps) are required for a single image generation. To accelerate such tedious process, reducing steps uniformly is considered as an…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Lijiang Li , Huixia Li , Xiawu Zheng , Jie Wu , Xuefeng Xiao , Rui Wang , Min Zheng , Xin Pan , Fei Chao , Rongrong Ji

Proper guidance strategies are essential to achieve high-quality generation results without retraining diffusion and flow-based text-to-image models. Existing guidance either requires specific training or strong inductive biases of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tiancheng Li , Weijian Luo , Zhiyang Chen , Liyuan Ma , Guo-Jun Qi

Classifier-free guidance (CFG) is a widely used technique for improving the perceptual quality of samples from conditional diffusion models. It operates by linearly combining conditional and unconditional score estimates using a guidance…

Machine Learning · Computer Science 2025-10-02 Alexandre Galashov , Ashwini Pokle , Arnaud Doucet , Arthur Gretton , Mauricio Delbracio , Valentin De Bortoli