English
Related papers

Related papers: MAMBO-G: Magnitude-Aware Mitigation for Boosted Gu…

200 papers

Recent progress in diffusion models has greatly enhanced video generation quality, yet these models still require fine-tuning to improve specific dimensions like instance preservation, motion rationality, composition, and physical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Xiaoyi Bao , Jindi Lv , Xiaofeng Wang , Zheng Zhu , Xinze Chen , YuKun Zhou , Jiancheng Lv , Xingang Wang , Guan Huang

Group Relative Policy Optimization has emerged as essential for aligning video diffusion models with human preferences, but faces a critical computational bottleneck: training a 14B parametered model typically demands hundreds of GPU days…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xiaoxuan He , Siming Fu , Zeyue Xue , Weijie Wang , Ruizhe He , Yuming Li , Dacheng Yin , Shuai Dong , Haoyang Huang , Hongfa Wang , Nan Duan , Bohan Zhuang

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance these aspects, it…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Otmar Hilliges , Romann M. Weber

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models trained on Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Weichen Fan , Amber Yijia Zheng , Raymond A. Yeh , Ziwei Liu

Classifier-free guidance (CFG) is the workhorse for steering large diffusion models toward text-conditioned targets, yet its native application to rectified flow (RF) based models provokes severe off-manifold drift, yielding visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shreshth Saini , Shashank Gupta , Alan C. Bovik

In this paper, we present \textbf{\textit{FasterCache}}, a novel training-free strategy designed to accelerate the inference of video diffusion models with high-quality generation. By analyzing existing cache-based methods, we observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zhengyao Lv , Chenyang Si , Junhao Song , Zhenyu Yang , Yu Qiao , Ziwei Liu , Kwan-Yee K. Wong

Classifier-Free Guidance (CFG) has been a default technique in various visual generative models, yet it requires inference from both conditional and unconditional models during sampling. We propose to build visual models that are free from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Huayu Chen , Kai Jiang , Kaiwen Zheng , Jianfei Chen , Hang Su , Jun Zhu

Diffusion models have achieved remarkable success in text-to-image synthesis, largely attributed to the use of classifier-free guidance (CFG), which enables high-quality, condition-aligned image generation. CFG combines the conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mingi Kwon , Shin seong Kim , Jaeseok Jeong. Yi Ting Hsiao , Youngjung Uh

While classifier-free guidance (CFG) is essential for conditional diffusion models, it doubles the number of neural function evaluations (NFEs) per inference step. To mitigate this inefficiency, we introduce adapter guidance distillation…

Machine Learning · Computer Science 2025-03-11 Cristian Perez Jensen , Seyedmorteza Sadat

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

High-resolution image synthesis with diffusion models often suffers from energy instabilities and guidance artifacts that degrade visual quality. We analyze the latent energy landscape during sampling and propose adaptive classifier-free…

Graphics · Computer Science 2025-12-12 Ankit Sanjyal

Classifier-free guidance (CFG) is a fundamental tool in modern diffusion models for text-guided generation. Although effective, CFG has notable drawbacks. For instance, DDIM with CFG lacks invertibility, complicating image editing;…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Hyungjin Chung , Jeongsol Kim , Geon Yeong Park , Hyelin Nam , Jong Chul Ye

Advancements in diffusion models have significantly improved video quality, directing attention to fine-grained controllability. However, many existing methods depend on fine-tuning large-scale video models for specific tasks, which becomes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Sangwon Jang , Taekyung Ki , Jaehyeong Jo , Jaehong Yoon , Soo Ye Kim , Zhe Lin , Sung Ju Hwang

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi

Diffusion models generate synthetic images through an iterative refinement process. However, the misalignment between the simulation-free objective and the iterative process often causes accumulated gradient error along the sampling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Liangyu Yuan , Yufei Huang , Mingkun Lei , Tong Zhao , Ruoyu Wang , Changxi Chi , Yiwei Wang , Chi Zhang

While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sampling artifacts. This necessitates generating multiple candidates, yet verifying them creates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Daewon Yoon , Hyeongseok Lee , Wonsik Shin , Sangyu Han , Nojun Kwak

Denoising diffusion models excel at generating high-quality images conditioned on text prompts, yet their effectiveness heavily relies on careful guidance during the sampling process. Classifier-Free Guidance (CFG) provides a widely used…

Graphics · Computer Science 2026-03-04 Shai Yehezkel , Omer Dahary , Andrey Voynov , Daniel Cohen-Or

Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-to-image diffusion models. It operates by combining the conditional and unconditional predictions using a fixed weight. However, recent works vary the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Xi Wang , Nicolas Dufour , Nefeli Andreou , Marie-Paule Cani , Victoria Fernandez Abrevaya , David Picard , Vicky Kalogeiton

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

Machine Learning · Computer Science 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu