中文
相关论文

相关论文: Guidance Is Not a Hyperparameter: Learning Dynamic…

200 篇论文

Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate…

High-resolution image synthesis with diffusion models often suffers from energy instabilities and guidance artifacts that degrade visual quality. We analyze the latent energy landscape during sampling and propose adaptive classifier-free…

图形学 · 计算机科学 2025-12-12 Ankit Sanjyal

Negative Prompting (NP) is widely utilized in diffusion models, particularly in text-to-image applications, to prevent the generation of undesired features. In this paper, we show that conventional NP is limited by the assumption of a…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Felix Koulischer , Johannes Deleu , Gabriel Raya , Thomas Demeester , Luca Ambrogioni

Diffusion models have achieved remarkable success in text-to-image synthesis, largely attributed to the use of classifier-free guidance (CFG), which enables high-quality, condition-aligned image generation. CFG combines the conditional…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Mingi Kwon , Shin seong Kim , Jaeseok Jeong. Yi Ting Hsiao , Youngjung Uh

Diffusion models have recently gained prominence in offline reinforcement learning due to their ability to effectively learn high-performing, generalizable policies from static datasets. Diffusion-based planners facilitate long-horizon…

机器学习 · 计算机科学 2025-10-27 Donghyeon Ki , JunHyeok Oh , Seong-Woong Shim , Byung-Jun Lee

The diffusion model presents a powerful ability to capture the entire (conditional) data distribution. However, due to the lack of sufficient training and data to learn to cover low-probability areas, the model will be penalized for failing…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Xingyu Zhou , Qifan Li , Xiaobin Hu , Hai Chen , Shuhang Gu

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-to-image diffusion models. It operates by combining the conditional and unconditional predictions using a fixed weight. However, recent works vary the…

计算机视觉与模式识别 · 计算机科学 2025-01-23 Xi Wang , Nicolas Dufour , Nefeli Andreou , Marie-Paule Cani , Victoria Fernandez Abrevaya , David Picard , Vicky Kalogeiton

Classifier-free guidance (CFG) is widely used in diffusion models but often introduces over-contrast and over-saturation artifacts at higher guidance strengths. We present EP-CFG (Energy-Preserving Classifier-Free Guidance), which addresses…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Kai Zhang , Fujun Luan , Sai Bi , Jianming Zhang

Diffusion models have emerged as the dominant paradigm for high-quality image generation, yet their computational expense remains substantial due to iterative denoising. Classifier-Free Guidance (CFG) significantly enhances generation…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Ruitong Sun , Tianze Yang , Wei Niu , Jin Sun

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

In diffusion and flow-matching generative models, guidance techniques are widely used to improve sample quality and consistency. Classifier-free guidance (CFG) is the de facto choice in modern systems and achieves this by contrasting…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Ankit Yadav , Ta Duc Huy , Lingqiao Liu

Diffusion models generate synthetic images through an iterative refinement process. However, the misalignment between the simulation-free objective and the iterative process often causes accumulated gradient error along the sampling…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Liangyu Yuan , Yufei Huang , Mingkun Lei , Tong Zhao , Ruoyu Wang , Changxi Chi , Yiwei Wang , Chi Zhang

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

机器学习 · 计算机科学 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

机器学习 · 计算机科学 2026-05-19 Kwanyoung Kim

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt ($\varnothing$) generates a guidance signal prone to geometric entanglement. This is a key factor…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Shilong Han , Yuming Zhang , Hongxia Wang

Score-based generative models require guidance in order to generate plausible, on-manifold samples. The most popular guidance method, Classifier-Free Guidance (CFG), is only applicable in settings with labeled data and requires training an…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Eric Yeats , Darryl Hannan , Wilson Fearn , Timothy Doster , Henry Kvinge , Scott Mahan

Classifier-Free Guidance (CFG) has been a default technique in various visual generative models, yet it requires inference from both conditional and unconditional models during sampling. We propose to build visual models that are free from…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Huayu Chen , Kai Jiang , Kaiwen Zheng , Jianfei Chen , Hang Su , Jun Zhu

Diffusion models typically employ static or heuristic classifier-free guidance (CFG) schedules, which often fail to adapt across timesteps and noise conditions. In this work, we introduce a quantum reinforcement learning (QRL) controller…

量子物理 · 物理学 2025-09-18 Chi-Sheng Chen , En-Jui Kuo