English
Related papers

Related papers: Stage-wise Dynamics of Classifier-Free Guidance in…

200 papers

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Diffusion models generate synthetic images through an iterative refinement process. However, the misalignment between the simulation-free objective and the iterative process often causes accumulated gradient error along the sampling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Liangyu Yuan , Yufei Huang , Mingkun Lei , Tong Zhao , Ruoyu Wang , Changxi Chi , Yiwei Wang , Chi Zhang

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt ($\varnothing$) generates a guidance signal prone to geometric entanglement. This is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shilong Han , Yuming Zhang , Hongxia Wang

Classifier-Free Guidance (CFG) is essential for high-fidelity conditional generation in flow matching, yet it imposes significant computational overhead by requiring dual forward passes at each sampling step. In this work, we address this…

Artificial Intelligence · Computer Science 2026-05-08 Xin Peng , Ang Gao

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other types of generative…

Machine Learning · Computer Science 2022-07-27 Jonathan Ho , Tim Salimans

The diffusion model presents a powerful ability to capture the entire (conditional) data distribution. However, due to the lack of sufficient training and data to learn to cover low-probability areas, the model will be penalized for failing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xingyu Zhou , Qifan Li , Xiaobin Hu , Hai Chen , Shuhang Gu

Classifier free guidance is a standard method for conditional sampling in diffusion models, but its sampling rule is not aligned with the objective used in training. This mismatch induces a structural sampling error through the interaction…

Machine Learning · Computer Science 2026-05-27 Nakgyu Yang , Yechan Lee , SooJean Han

Counterfactual generation aims to simulate realistic hypothetical outcomes under causal interventions. Diffusion models have emerged as a powerful tool for this task, combining DDIM inversion with conditional generation and classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Tian Xia , Fabio De Sousa Ribeiro , Rajat R Rasal , Avinash Kori , Raghav Mehta , Ben Glocker

Classifier-Free Guidance (CFG) is a critical technique for enhancing the sample quality of visual generative models. However, in autoregressive (AR) multi-modal generation, CFG introduces design inconsistencies between language and visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Huayu Chen , Hang Su , Peize Sun , Jun Zhu

Diffusion models have emerged as a pivotal advancement in generative models, setting new standards to the quality of the generated instances. In the current paper we aim to underscore a discrepancy between conventional training methods and…

Machine Learning · Computer Science 2023-11-03 Niket Patel , Luis Salamanca , Luis Barba

Classifier-free guidance has become a staple for conditional generation with denoising diffusion models. However, a comprehensive understanding of classifier-free guidance is still missing. In this work, we carry out an empirical study to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiaoming Zhao , Alexander G. Schwing

Current sampling mechanisms for conditional diffusion models rely mainly on Classifier Free Guidance (CFG) to generate high-quality images. However, CFG requires several denoising passes in each time step, e.g., up to three passes in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mehdi Noroozi , Alberto Gil Ramos , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Abhinav Mehrotra , Sourav Bhattacharya

Classifier-Free Guidance (CFG) has been a default technique in various visual generative models, yet it requires inference from both conditional and unconditional models during sampling. We propose to build visual models that are free from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Huayu Chen , Kai Jiang , Kaiwen Zheng , Jianfei Chen , Hang Su , Jun Zhu

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Temporal sequential tasks challenge humanoid robots, as existing Diffusion Policy (DP) and Action Chunking with Transformers (ACT) methods often lack temporal context, resulting in local optima traps and excessive repetitive actions. To…

Robotics · Computer Science 2025-10-14 Yuang Lu , Song Wang , Xiao Han , Xuri Zhang , Yucong Wu , Zhicheng He

Classifier-Free Guidance (CFG) serves as the de facto control mechanism for conditional diffusion, yet high guidance scales notoriously induce oversaturation, texture artifacts, and structural collapse. We attribute this failure to a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zexi Jia , Pengcheng Luo , Zhengyao Fang , Jinchao Zhang , Jie Zhou

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

Graphics · Computer Science 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi