中文
相关论文

相关论文: Saddle-Free Guidance: Improved On-Manifold Samplin…

200 篇论文

Diffusion models achieve strong performance in generative modeling, but their success often relies heavily on classifier-free guidance (CFG), an inference-time heuristic that modifies the sampling trajectory. In theory, diffusion models…

机器学习 · 计算机科学 2026-05-14 Xiang Li , Yixuan Jia , Xiao Li , Jeffrey A. Fessler , Rongrong Wang , Qing Qu

We introduce segmentation-free guidance, a novel method designed for text-to-image diffusion models like Stable Diffusion. Our method does not require retraining of the diffusion model. At no additional compute cost, it uses the diffusion…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Kambiz Azarian , Debasmit Das , Qiqi Hou , Fatih Porikli

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

机器学习 · 计算机科学 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

In generative modeling, we often wish to produce samples that maximize a user-specified reward such as aesthetic quality or alignment with human preferences, a problem known as \textit{guidance}. Despite their widespread use, existing…

机器学习 · 计算机科学 2026-05-21 Jerry Y. Huang , Justin Lin , Sheel Shah , Kartik Nair , Nicholas M. Boffi

We study masked discrete diffusion models with classifier-free guidance (CFG). Assuming no score error nor discretization error, we derive an explicit solution to the guided reverse dynamics, so that how guidance influences the sampling…

机器学习 · 统计学 2025-06-13 He Ye , Rojas Kevin , Tao Molei

Classifier-Free Guidance (CFG), which combines the conditional and unconditional score functions with two coefficients summing to one, serves as a practical technique for diffusion model sampling. Theoretically, however, denoising with CFG…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Mengfei Xia , Nan Xue , Yujun Shen , Ran Yi , Tieliang Gong , Yong-Jin Liu

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

图形学 · 计算机科学 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Dongjun Kim , Yeongmin Kim , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

In zero-shot text-to-speech, achieving a balance between fidelity to the target speaker and adherence to text content remains a challenge. While classifier-free guidance (CFG) strategies have shown promising results in image generation,…

音频与语音处理 · 电气工程与系统科学 2026-03-25 John Zheng , Farhad Maleki

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

音频与语音处理 · 电气工程与系统科学 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen

Score Distillation Sampling (SDS) has emerged as the de facto approach for text-to-content generation in non-image domains. In this paper, we reexamine the SDS process and introduce a straightforward interpretation that demystifies the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Oren Katzir , Or Patashnik , Daniel Cohen-Or , Dani Lischinski

Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Alon Wolf , Chen Katzir , Kfir Aberman , Or Patashnik

Unconditional generation -- the problem of modeling data distribution without relying on human-annotated labels -- is a long-standing and fundamental challenge in generative models, creating a potential of learning from large-scale…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Tianhong Li , Dina Katabi , Kaiming He

We introduce Value Sign Flip (VSF), a simple and efficient method for incorporating negative prompt guidance in few-step diffusion and flow-matching image generation models. Unlike existing approaches such as classifier-free guidance (CFG),…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Wenqi Guo , Shan Du

Classifier-Free Guidance (CFG) serves as the de facto control mechanism for conditional diffusion, yet high guidance scales notoriously induce oversaturation, texture artifacts, and structural collapse. We attribute this failure to a…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Zexi Jia , Pengcheng Luo , Zhengyao Fang , Jinchao Zhang , Jie Zhou

In diffusion and flow-matching generative models, guidance techniques are widely used to improve sample quality and consistency. Classifier-free guidance (CFG) is the de facto choice in modern systems and achieves this by contrasting…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Ankit Yadav , Ta Duc Huy , Lingqiao Liu

Diffusion models have emerged as a powerful tool for generating high-quality images, videos, and 3D content. While sampling guidance techniques like CFG improve quality, they reduce diversity and motion. Autoguidance mitigates these issues…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Junha Hyung , Kinam Kim , Susung Hong , Min-Jung Kim , Jaegul Choo

We found that enforcing guidance throughout the sampling process is often counterproductive due to the model-fitting issue, where samples are 'tuned' to match the classifier's parameters rather than generalizing the expected condition. This…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Anh-Dung Dinh , Daochang Liu , Chang Xu

In recent times, large datasets hinder efficient model training while also containing redundant concepts. Dataset distillation aims to synthesize compact datasets that preserve the knowledge of large-scale training sets while drastically…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Ayush Roy , Wei-Yang Alex Lee , Rudrasis Chakraborty , Vishnu Suresh Lokhande

Masked generative models (MGMs) have shown impressive generative ability while providing an order of magnitude efficient sampling steps compared to continuous diffusion models. However, MGMs still underperform in image synthesis compared to…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Jiwan Hur , Dong-Jae Lee , Gyojin Han , Jaehyun Choi , Yunho Jeon , Junmo Kim