中文
相关论文

相关论文: Composite Classifier-Free Guidance for Multi-Modal…

200 篇论文

Classifier-free guidance (CFG) is widely used in diffusion models but often introduces over-contrast and over-saturation artifacts at higher guidance strengths. We present EP-CFG (Energy-Preserving Classifier-Free Guidance), which addresses…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Kai Zhang , Fujun Luan , Sai Bi , Jianming Zhang

Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Dawid Malarz , Artur Kasymov , Maciej Zięba , Jacek Tabor , Przemysław Spurek

Text-to-image diffusion models are capable of generating high-quality images, but suboptimal pre-trained text representations often result in these images failing to align closely with the given text prompts. Classifier-free guidance (CFG)…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen , Siwei Lyu

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

机器学习 · 计算机科学 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

Classifier-free guidance (CFG) succeeds in condition diffusion models that use a guidance scale to balance the influence of conditional and unconditional terms. A high guidance scale is used to enhance the performance of the conditional…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Kaiyu Song , Hanjiang Lai

Diffusion models achieve strong performance in generative modeling, but their success often relies heavily on classifier-free guidance (CFG), an inference-time heuristic that modifies the sampling trajectory. In theory, diffusion models…

机器学习 · 计算机科学 2026-05-14 Xiang Li , Yixuan Jia , Xiao Li , Jeffrey A. Fessler , Rongrong Wang , Qing Qu

Classifier-Free Guidance (CFG) significantly enhances controllability in generative models by interpolating conditional and unconditional predictions. However, standard CFG often employs a static unconditional input, which can be suboptimal…

计算与语言 · 计算机科学 2025-05-27 Pengxiang Li , Shilin Yan , Joey Tsai , Renrui Zhang , Ruichuan An , Ziyu Guo , Xiaowei Gao

Classifier-free Guidance (CFG) lets practitioners trade-off fidelity against diversity in Diffusion Models (DMs). The practicality of CFG is however hindered by DMs sampling cost. On the other hand, Consistency Models (CMs) generate images…

机器学习 · 计算机科学 2026-04-13 Chia-Hong Hsu , Randall Balestriero

Classifier-Free Guidance (CFG) is a cornerstone of modern conditional diffusion models, yet its reliance on the fixed or heuristic dynamic guidance weight is predominantly empirical and overlooks the inherent dynamics of the diffusion…

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

机器学习 · 计算机科学 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

机器学习 · 计算机科学 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu

Adjoint-based design optimizations are usually computationally expensive and those costs scale with resolution. To address this, researchers have proposed machine learning approaches for inverse design that can predict higher-resolution…

机器学习 · 计算机科学 2024-08-19 Milad Habibi , Mark Fuge

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other types of generative…

机器学习 · 计算机科学 2022-07-27 Jonathan Ho , Tim Salimans

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Haosen Li , Wenshuo Chen , Lei Wang , Shaofeng Liang , Bowen Tian , Soning Lai , Yutao Yue

Classifier-free guidance (CFG) has helped diffusion models achieve great conditional generation in various fields. Recently, more diffusion guidance methods have emerged with improved generation quality and human preference. However, can…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Dian Xie , Shitong Shao , Lichen Bai , Zikai Zhou , Bojun Cheng , Shuo Yang , Jun Wu , Zeke Xie

Continuous Conditional Diffusion Model (CCDM) is a diffusion-based framework designed to generate high-quality images conditioned on continuous regression labels. Although CCDM has demonstrated clear advantages over prior approaches across…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Xin Ding , Yun Chen , Sen Zhang , Kao Zhang , Nenglun Chen , Peibei Cao , Yongwei Wang , Fei Wu

Classifier-free guidance (CFG) is a key technique for improving conditional generation in diffusion models, enabling more accurate control while enhancing sample quality. It is natural to extend this technique to video diffusion, which…

机器学习 · 计算机科学 2025-07-25 Kiwhan Song , Boyuan Chen , Max Simchowitz , Yilun Du , Russ Tedrake , Vincent Sitzmann

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt ($\varnothing$) generates a guidance signal prone to geometric entanglement. This is a key factor…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Shilong Han , Yuming Zhang , Hongxia Wang

Diffusion models have demonstrated remarkable capabilities in generating high-quality samples and enhancing performance across diverse domains through Classifier-Free Guidance (CFG). However, the quality of generated samples is highly…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Ao Chen , Lihe Ding , Tianfan Xue