中文
相关论文

相关论文: Classifier-Free Diffusion Guidance

200 篇论文

We introduce Policy Gradient Guidance (PGG), a simple extension of classifier-free guidance from diffusion models to classical policy gradient methods. PGG augments the policy gradient with an unconditional branch and interpolates…

机器学习 · 计算机科学 2025-10-03 Jianing Qi , Hao Tang , Zhigang Zhu

Classifier free guidance has shown strong potential in diffusion-based reinforcement learning. However, existing methods rely on joint training of the guidance module and the diffusion model, which can be suboptimal during the early stages…

机器学习 · 计算机科学 2025-06-05 Zhaoyang Chen , Cody Fleming

Diffusion models have shown tremendous results in image generation. However, due to the iterative nature of the diffusion process and its reliance on classifier-free guidance, inference times are slow. In this paper, we propose a new…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Yi-Ting Hsiao , Siavash Khodadadeh , Kevin Duarte , Wei-An Lin , Hui Qu , Mingi Kwon , Ratheesh Kalarot

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Given an unconditional generative model and a predictor for a target property (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. As a highly…

机器学习 · 计算机科学 2025-03-19 Haowei Lin , Shanda Li , Haotian Ye , Yiming Yang , Stefano Ermon , Yitao Liang , Jianzhu Ma

Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Nithin Gopalakrishnan Nair , Vishal M Patel

Recent progress in generative modeling has enabled high-quality visual synthesis with diffusion-based frameworks, supporting controllable sampling and large-scale training. Inference-time guidance methods such as classifier-free and…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Wenqiang Zu , Shenghao Xie , Bo Lei , Lei Ma

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

图形学 · 计算机科学 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

Classifier-free guidance (CFG) succeeds in condition diffusion models that use a guidance scale to balance the influence of conditional and unconditional terms. A high guidance scale is used to enhance the performance of the conditional…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Kaiyu Song , Hanjiang Lai

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Diffusion models have seen immense success in modelling continuous data across a range of domains such as vision and audio. Despite the challenges of adapting diffusion models to discrete data, recent work explores their application to text…

计算与语言 · 计算机科学 2025-03-17 Zak Buzzard

Diffusion models have demonstrated superior performance across various generative tasks including images, videos, and audio. However, they encounter difficulties in directly generating high-resolution samples. Previously proposed solutions…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Juno Hwang , Yong-Hyun Park , Junghyo Jo

Classifier free guidance is a standard method for conditional sampling in diffusion models, but its sampling rule is not aligned with the objective used in training. This mismatch induces a structural sampling error through the interaction…

机器学习 · 计算机科学 2026-05-27 Nakgyu Yang , Yechan Lee , SooJean Han

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

机器学习 · 计算机科学 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Classifier-free Guidance (CFG) is a widely used technique in modern diffusion models for enhancing sample quality and prompt adherence. However, through an empirical analysis on Gaussian mixture modeling with a closed-form solution, we…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Chubin Chen , Jiashu Zhu , Xiaokun Feng , Nisha Huang , Chen Zhu , Meiqi Wu , Fangyuan Mao , Jiahong Wu , Xiangxiang Chu , Xiu Li

Creating large-scale datasets for training high-performance generative models is often prohibitively expensive, especially when associated attributes or annotations must be provided. As a result, merging existing datasets has become a…

机器学习 · 统计学 2026-03-31 Yanfeng Yang , Kenji Fukumizu

We introduce meta-learning algorithms that perform zero-shot weight-space adaptation of neural network models to unseen tasks. Our methods repurpose the popular generative image synthesis techniques of natural language guidance and…

机器学习 · 计算机科学 2023-02-01 Elvis Nava , Seijin Kobayashi , Yifei Yin , Robert K. Katzschmann , Benjamin F. Grewe

Customizing diffusion models to generate identity-preserving images from user-provided reference images is an intriguing new problem. The prevalent approaches typically require training on extensive domain-specific images to achieve…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Zhicheng Sun , Zhenhao Yang , Yang Jin , Haozhe Chi , Kun Xu , Kun Xu , Liwei Chen , Hao Jiang , Yang Song , Kun Gai , Yadong Mu

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

Recent advances in diffusion models have shown remarkable potential in the conditional generation of novel molecules. These models can be guided in two ways: (i) explicitly, through additional features representing the condition, or (ii)…

机器学习 · 计算机科学 2025-03-12 Yuchen Shen , Chenhao Zhang , Sijie Fu , Chenghui Zhou , Newell Washburn , Barnabás Póczos