中文
相关论文

相关论文: Guidance Matters: Rethinking the Evaluation Pitfal…

200 篇论文

Generative diffusion models show promise for data augmentation. However, applying them to fine-grained tasks presents a significant challenge: ensuring synthetic images accurately capture the subtle, category-defining features critical for…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Zhiguang Lu , Qianqian Xu , Peisong Wen , Siran Dai , Qingming Huang

Diffusion models and flow matching have demonstrated remarkable success in text-to-image generation. While many existing alignment methods primarily focus on fine-tuning pre-trained generative models to maximize a given reward function,…

机器学习 · 统计学 2026-02-03 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Classifier-free guidance (CFG) is the primary control over how strongly text semantics move a flow-based sampler, yet standard practice holds its scale fixed across the entire ODE trajectory. This is a fundamental mismatch: early steps are…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Yan Luo , Ahmadou Aidara , Jingyi Lu , Jeremy Moebel , Kai Han , Mengyu Wang

Diffusion models have demonstrated superior performance across various generative tasks including images, videos, and audio. However, they encounter difficulties in directly generating high-resolution samples. Previously proposed solutions…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Juno Hwang , Yong-Hyun Park , Junghyo Jo

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

机器学习 · 计算机科学 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Popular guidance for denoising diffusion probabilistic model (DDPM) linearly combines distinct conditional models together to provide enhanced control over samples. However, this approach overlooks nonlinear effects that become significant…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Candi Zheng , Yuan Lan

Recent advances in text-to-image synthesis largely benefit from sophisticated sampling strategies and classifier-free guidance (CFG) to ensure high-quality generation. However, CFG's reliance on two forward passes, especially when combined…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Minghao Fu , Guo-Hua Wang , Xiaohao Chen , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

机器学习 · 统计学 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Alon Wolf , Chen Katzir , Kfir Aberman , Or Patashnik

Diffusion models have achieved remarkable success as generative models. However, even a well-trained model can accumulate errors throughout the generation process. These errors become particularly problematic when arbitrary guidance is…

机器学习 · 计算机科学 2025-10-14 Youngrok Park , Hojung Jung , Sangmin Bae , Se-Young Yun

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images through modifications…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Eleftherios Tsonis , Paraskevi Tzouveli , Athanasios Voulodimos

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

机器学习 · 计算机科学 2026-05-19 Kwanyoung Kim

Diffusion models achieve strong performance in generative modeling, but their success often relies heavily on classifier-free guidance (CFG), an inference-time heuristic that modifies the sampling trajectory. In theory, diffusion models…

机器学习 · 计算机科学 2026-05-14 Xiang Li , Yixuan Jia , Xiao Li , Jeffrey A. Fessler , Rongrong Wang , Qing Qu

We introduce a novel, training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs). Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shulei Wang , Wang Lin , Hai Huang , Hanting Wang , Sihang Cai , WenKang Han , Tao Jin , Jingyuan Chen , Jiacheng Sun , Jieming Zhu , Zhou Zhao

Classifier-Free Guidance (CFG) is essential for high-fidelity conditional generation in flow matching, yet it imposes significant computational overhead by requiring dual forward passes at each sampling step. In this work, we address this…

人工智能 · 计算机科学 2026-05-08 Xin Peng , Ang Gao

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

机器学习 · 计算机科学 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

Diffusion models (DMs) have demonstrated exceptional performance in text-to-image tasks, leading to their widespread use. With the introduction of classifier-free guidance (CFG), the quality of images generated by DMs is significantly…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Jiadong Pan , Liang Li , Hongcheng Gao , Zheng-Jun Zha , Qingming Huang , Jiebo Luo

Given an unconditional generative model and a predictor for a target property (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. As a highly…

机器学习 · 计算机科学 2025-03-19 Haowei Lin , Shanda Li , Haotian Ye , Yiming Yang , Stefano Ermon , Yitao Liang , Jianzhu Ma

Diffusion models deliver high quality in image synthesis but remain expensive during training and inference. Recent works have leveraged the inherent redundancy in visual content to make training more affordable by training only on a subset…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Felix Krause , Stefan Andreas Baumann , Johannes Schusterbauer , Olga Grebenkova , Ming Gui , Vincent Tao Hu , Björn Ommer

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

音频与语音处理 · 电气工程与系统科学 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen