English
Related papers

Related papers: Adaptive Guidance: Training-free Acceleration of C…

200 papers

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

Machine Learning · Computer Science 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Alon Wolf , Chen Katzir , Kfir Aberman , Or Patashnik

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Various weather modelling problems (e.g., weather forecasting, optimizing turbine placements, etc.) require ample access to high-resolution, highly accurate wind data. Acquiring such high-resolution wind data, however, remains a challenging…

Machine Learning · Computer Science 2025-12-17 Jacob Schnell , Aditya Makkar , Gunadi Gani , Aniket Srinivasan Ashok , Darren Lo , Mike Optis , Alexander Wong , Yuhao Chen

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG).…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Donghoon Ahn , Hyoungwon Cho , Jaewon Min , Wooseok Jang , Jungwoo Kim , SeonHwa Kim , Hyun Hee Park , Kyong Hwan Jin , Seungryong Kim

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

Machine Learning · Computer Science 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

In zero-shot text-to-speech, achieving a balance between fidelity to the target speaker and adherence to text content remains a challenge. While classifier-free guidance (CFG) strategies have shown promising results in image generation,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 John Zheng , Farhad Maleki

Diffusion models have demonstrated strong generative performance when using guidance methods such as classifier-free guidance (CFG), which enhance output quality by modifying the sampling trajectory. These methods typically improve a target…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kwanyoung Kim

Diffusion models (DMs) have demonstrated an unparalleled ability to create diverse and high-fidelity images from text prompts. However, they are also well-known to vary substantially regarding both prompt adherence and quality. Negative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Alakh Desai , Nuno Vasconcelos

Guidance in image generation steers models towards higher-quality or more targeted outputs, typically achieved in Diffusion Models (DMs) via Classifier-free Guidance (CFG). However, recent Consistency Models (CMs), which offer fewer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Chia-Hong Hsu , Shiu-hong Kao , Randall Balestriero

Classifier-free guidance (CFG) succeeds in condition diffusion models that use a guidance scale to balance the influence of conditional and unconditional terms. A high guidance scale is used to enhance the performance of the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Kaiyu Song , Hanjiang Lai

We introduce Policy Gradient Guidance (PGG), a simple extension of classifier-free guidance from diffusion models to classical policy gradient methods. PGG augments the policy gradient with an unconditional branch and interpolates…

Machine Learning · Computer Science 2025-10-03 Jianing Qi , Hao Tang , Zhigang Zhu

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Classifier-free guidance (CFG) has become a widely adopted and practical approach for enhancing generation quality and improving condition alignment. Recent studies have explored guidance mechanisms for unconditional generation, yet these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chaoyang Wang , Tianmeng Yang , Jingdong Wang , Yunhai Tong

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Temporal sequential tasks challenge humanoid robots, as existing Diffusion Policy (DP) and Action Chunking with Transformers (ACT) methods often lack temporal context, resulting in local optima traps and excessive repetitive actions. To…

Robotics · Computer Science 2025-10-14 Yuang Lu , Song Wang , Xiao Han , Xuri Zhang , Yucong Wu , Zhicheng He

Score-based generative models require guidance in order to generate plausible, on-manifold samples. The most popular guidance method, Classifier-Free Guidance (CFG), is only applicable in settings with labeled data and requires training an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Eric Yeats , Darryl Hannan , Wilson Fearn , Timothy Doster , Henry Kvinge , Scott Mahan