中文
相关论文

相关论文: Rectified Diffusion Guidance for Conditional Gener…

200 篇论文

We study masked discrete diffusion models with classifier-free guidance (CFG). Assuming no score error nor discretization error, we derive an explicit solution to the guided reverse dynamics, so that how guidance influences the sampling…

机器学习 · 统计学 2025-06-13 He Ye , Rojas Kevin , Tao Molei

Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Seyed Alireza Javid , Amirhossein Bagheri , Nuria González-Prelcic

The primary axes of interest in image-generating diffusion models are image quality, the amount of variation in the results, and how well the results align with a given condition, e.g., a class label or a text prompt. The popular…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Tero Karras , Miika Aittala , Tuomas Kynkäänniemi , Jaakko Lehtinen , Timo Aila , Samuli Laine

Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG).…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Donghoon Ahn , Hyoungwon Cho , Jaewon Min , Wooseok Jang , Jungwoo Kim , SeonHwa Kim , Hyun Hee Park , Kyong Hwan Jin , Seungryong Kim

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

机器学习 · 计算机科学 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

Since their introduction, diffusion models have quickly become the prevailing approach to generative modeling in many domains. They can be interpreted as learning the gradients of a time-varying sequence of log-probability density…

With the rapid development of text-to-vision generation diffusion models, classifier-free guidance has emerged as the most prevalent method for conditioning. However, this approach inherently requires twice as many steps for model…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes,…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Bing Cao , Xingxin Xu , Pengfei Zhu , Qilong Wang , Qinghua Hu

The generation of high-quality, diverse, and prompt-aligned images is a central goal in image-generating diffusion models. The popular classifier-free guidance (CFG) approach improves quality and alignment at the cost of reduced variation,…

机器学习 · 计算机科学 2025-10-21 Enhao Gu , Haolin Hou

Diffusion probabilistic models have achieved enormous success in the field of image generation and manipulation. In this paper, we explore a novel paradigm of using the diffusion model and classifier guidance in the latent semantic space…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Changhao Shi , Haomiao Ni , Kai Li , Shaobo Han , Mingfu Liang , Martin Renqiang Min

Discrete diffusion models are a powerful, emerging paradigm for code generation. They construct programs through iterative refinement of partially corrupted token sequences and enable parallel token refinement. Importantly, this paradigm…

计算与语言 · 计算机科学 2026-05-19 Lize Shao , Michael Cardei , Zichen Xie , Ferdinando Fioretto , Wenxi Wang

Autoregressive (AR) models have emerged as powerful tools for image generation by modeling images as sequences of discrete tokens. While Classifier-Free Guidance (CFG) has been adopted to improve conditional generation, its application in…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Dongli Xu , Aleksei Tiulpin , Matthew B. Blaschko

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

机器学习 · 计算机科学 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou

Popular guidance for denoising diffusion probabilistic model (DDPM) linearly combines distinct conditional models together to provide enhanced control over samples. However, this approach overlooks nonlinear effects that become significant…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Candi Zheng , Yuan Lan

Recent progress in image generation has sparked research into controlling these models through condition signals, with various methods addressing specific challenges in conditional generation. Instead of proposing another specialized…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xirui Li , Charles Herrmann , Kelvin C. K. Chan , Yinxiao Li , Deqing Sun , Chao Ma , Ming-Hsuan Yang

Recent advances in text-to-image synthesis largely benefit from sophisticated sampling strategies and classifier-free guidance (CFG) to ensure high-quality generation. However, CFG's reliance on two forward passes, especially when combined…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Minghao Fu , Guo-Hua Wang , Xiaohao Chen , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application scope compared to traditional fixed-category segmentation tasks. Recent studies have…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Zishen Qu , Xuesong Li , Haijian Gu , Hongwei Kang , Quan Meng , Tianrui Niu , Xin Yang , Ruidong Pan

Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Dar-Yen Chen , Hmrishav Bandyopadhyay , Kai Zou , Yi-Zhe Song

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

Safety mechanisms for diffusion and flow models have recently been developed along two distinct paths. In robot planning, control barrier functions are employed to guide generative trajectories away from obstacles at every denoising step by…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Mingyu Kim , Young-Heon Kim , Mijung Park