中文
相关论文

相关论文: TCFG: Tangential Damping Classifier-free Guidance

200 篇论文

Diffusion models generate synthetic images through an iterative refinement process. However, the misalignment between the simulation-free objective and the iterative process often causes accumulated gradient error along the sampling…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Liangyu Yuan , Yufei Huang , Mingkun Lei , Tong Zhao , Ruoyu Wang , Changxi Chi , Yiwei Wang , Chi Zhang

While classifier-free guidance (CFG) is essential for conditional diffusion models, it doubles the number of neural function evaluations (NFEs) per inference step. To mitigate this inefficiency, we introduce adapter guidance distillation…

机器学习 · 计算机科学 2025-03-11 Cristian Perez Jensen , Seyedmorteza Sadat

Classifier-Free Guidance (CFG) is essential for high-fidelity conditional generation in flow matching, yet it imposes significant computational overhead by requiring dual forward passes at each sampling step. In this work, we address this…

人工智能 · 计算机科学 2026-05-08 Xin Peng , Ang Gao

Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen.…

计算机视觉与模式识别 · 计算机科学 2023-04-14 Chenlin Meng , Robin Rombach , Ruiqi Gao , Diederik P. Kingma , Stefano Ermon , Jonathan Ho , Tim Salimans

Guidance in conditional diffusion generation is of great importance for sample quality and controllability. However, existing guidance schemes are to be desired. On one hand, mainstream methods such as classifier guidance and…

机器学习 · 计算机科学 2023-10-18 Jiajun Ma , Tianyang Hu , Wenjia Wang , Jiacheng Sun

Generative diffusion models show promise for data augmentation. However, applying them to fine-grained tasks presents a significant challenge: ensuring synthetic images accurately capture the subtle, category-defining features critical for…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Zhiguang Lu , Qianqian Xu , Peisong Wen , Siran Dai , Qingming Huang

We consider the problem of conditional text-to-image synthesis with diffusion models. Most recent works need to either finetune specific parts of the base diffusion model or introduce new trainable parameters, leading to deployment…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Tripti Shukla , Srikrishna Karanam , Balaji Vasan Srinivasan

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

机器学习 · 计算机科学 2021-06-02 Prafulla Dhariwal , Alex Nichol

Diffusion models have achieved remarkable progress in image and audio generation, largely due to Classifier-Free Guidance. However, the choice of guidance scale remains underexplored: a fixed scale often fails to generalize across prompts…

声音 · 计算机科学 2025-10-07 Xuanhao Zhang , Chang Li

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Guiding unconditional diffusion models typically requires either retraining with conditional inputs or per-step gradient computations (e.g., classifier-based guidance), both of which incur substantial computational overhead. We present a…

机器学习 · 计算机科学 2026-02-13 Qingsong Wang , Mikhail Belkin , Yusu Wang

Recent progress in image generation has sparked research into controlling these models through condition signals, with various methods addressing specific challenges in conditional generation. Instead of proposing another specialized…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xirui Li , Charles Herrmann , Kelvin C. K. Chan , Yinxiao Li , Deqing Sun , Chao Ma , Ming-Hsuan Yang

Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Alon Wolf , Chen Katzir , Kfir Aberman , Or Patashnik

Human Activity Recognition using wearable inertial sensors is foundational to healthcare monitoring, fitness analytics, and context-aware computing, yet its deployment is hindered by cross-user variability arising from heterogeneous…

机器学习 · 计算机科学 2026-03-18 Xiaozhou Ye , Feng Jiang , Zihan Wang , Xiulai Wang , Yutao Zhang , Kevin I-Kai Wang

Diffusion models have recently been shown to generate high-quality synthetic images, especially when paired with a guidance technique to trade off diversity for fidelity. We explore diffusion models for the problem of text-conditional image…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Alex Nichol , Prafulla Dhariwal , Aditya Ramesh , Pranav Shyam , Pamela Mishkin , Bob McGrew , Ilya Sutskever , Mark Chen

Classifier-free Guidance (CFG) lets practitioners trade-off fidelity against diversity in Diffusion Models (DMs). The practicality of CFG is however hindered by DMs sampling cost. On the other hand, Consistency Models (CMs) generate images…

机器学习 · 计算机科学 2026-04-13 Chia-Hong Hsu , Randall Balestriero

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

机器学习 · 计算机科学 2026-05-19 Kwanyoung Kim

Scene graphs (SGs) represent objects and their relationships as structured graphs, enabling applications in image generation, robotics, and 3D understanding. Recent work suggests that conditioning image generation on scene graphs improves…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Rajalaxmi Rajagopalan , Romit Roy Choudhury

Diffusion models (DMs) have demonstrated an unparalleled ability to create diverse and high-fidelity images from text prompts. However, they are also well-known to vary substantially regarding both prompt adherence and quality. Negative…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Alakh Desai , Nuno Vasconcelos

We introduce segmentation-free guidance, a novel method designed for text-to-image diffusion models like Stable Diffusion. Our method does not require retraining of the diffusion model. At no additional compute cost, it uses the diffusion…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Kambiz Azarian , Debasmit Das , Qiqi Hou , Fatih Porikli