中文
相关论文

相关论文: Composite Classifier-Free Guidance for Multi-Modal…

200 篇论文

Classifier-Free Guidance (CFG) has been widely used in text-to-image diffusion models, where the CFG scale is introduced to control the strength of text guidance on the whole image space. However, we argue that a global CFG scale results in…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Dazhong Shen , Guanglu Song , Zeyue Xue , Fu-Yun Wang , Yu Liu

Classifier-free guidance (CFG) has become a widely adopted and practical approach for enhancing generation quality and improving condition alignment. Recent studies have explored guidance mechanisms for unconditional generation, yet these…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Chaoyang Wang , Tianmeng Yang , Jingdong Wang , Yunhai Tong

We introduce Compartmentalized Diffusion Models (CDM), a method to train different diffusion models (or prompts) on distinct data sources and arbitrarily compose them at inference time. The individual models can be trained in isolation, at…

机器学习 · 计算机科学 2024-10-15 Aditya Golatkar , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Diffusion models have emerged as a pivotal advancement in generative models, setting new standards to the quality of the generated instances. In the current paper we aim to underscore a discrepancy between conventional training methods and…

机器学习 · 计算机科学 2023-11-03 Niket Patel , Luis Salamanca , Luis Barba

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

机器学习 · 计算机科学 2021-06-02 Prafulla Dhariwal , Alex Nichol

Diffusion models (DMs) have demonstrated an unparalleled ability to create diverse and high-fidelity images from text prompts. However, they are also well-known to vary substantially regarding both prompt adherence and quality. Negative…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Alakh Desai , Nuno Vasconcelos

Diffusion models (DMs) have demonstrated exceptional generative capabilities across various domains, including image, video, and so on. A key factor contributing to their effectiveness is the high quantity and quality of data used during…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Qianlong Xiang , Miao Zhang , Yuzhang Shang , Jianlong Wu , Yan Yan , Liqiang Nie

This report presents the comprehensive implementation, evaluation, and optimization of Denoising Diffusion Probabilistic Models (DDPMs) and Denoising Diffusion Implicit Models (DDIMs), which are state-of-the-art generative models. During…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Jaineet Shah , Michael Gromis , Rickston Pinto

Urban wind flow reconstruction is essential for assessing air quality, heat dispersion, and pedestrian comfort, yet remains challenging when only sparse sensor data are available. We propose GenDA, a generative data assimilation framework…

机器学习 · 计算机科学 2026-02-18 Francisco Giral , Álvaro Manzano , Ignacio Gómez , Ricardo Vinuesa , Soledad Le Clainche

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

图形学 · 计算机科学 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

As Classifier-Free Guidance (CFG) has proven effective in conditional diffusion model sampling for improved condition alignment, many applications use a negated CFG term to filter out unwanted features from samples. However, simply negating…

机器学习 · 计算机科学 2024-11-27 Jinho Chang , Hyungjin Chung , Jong Chul Ye

The primary axes of interest in image-generating diffusion models are image quality, the amount of variation in the results, and how well the results align with a given condition, e.g., a class label or a text prompt. The popular…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Tero Karras , Miika Aittala , Tuomas Kynkäänniemi , Jaakko Lehtinen , Timo Aila , Samuli Laine

The generation of high-quality, diverse, and prompt-aligned images is a central goal in image-generating diffusion models. The popular classifier-free guidance (CFG) approach improves quality and alignment at the cost of reduced variation,…

机器学习 · 计算机科学 2025-10-21 Enhao Gu , Haolin Hou

The class-conditional image generation based on diffusion models is renowned for generating high-quality and diverse images. However, most prior efforts focus on generating images for general categories, e.g., 1000 classes in ImageNet-1k. A…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ziying Pan , Kun Wang , Gang Li , Feihong He , Yongxuan Lai

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes,…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Bing Cao , Xingxin Xu , Pengfei Zhu , Qilong Wang , Qinghua Hu

Weakly supervised semantic segmentation (WSSS) methods using class labels often rely on class activation maps (CAMs) to localize objects. However, traditional CAM-based methods struggle with partial activations and imprecise object…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Dewen Zeng , Xinrong Hu , Yu-Jen Chen , Yawen Wu , Xiaowei Xu , Yiyu Shi

Classifier-free guidance has become a staple for conditional generation with denoising diffusion models. However, a comprehensive understanding of classifier-free guidance is still missing. In this work, we carry out an empirical study to…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Xiaoming Zhao , Alexander G. Schwing

Classifier-Free Guidance (CFG) is a widely used mechanism for controlling diffusion-based generative models, yet its guidance scale is typically treated as a fixed hyperparameter throughout generation. This static design yields a suboptimal…

计算与语言 · 计算机科学 2026-05-11 Fan Zhou , Tim Van de Cruys