English
Related papers

Related papers: Improving Sample Quality of Diffusion Models Using…

200 papers

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos

Diffusion models exhibit excellent sample quality, but existing guidance methods often require additional model training or are limited to specific tasks. We revisit guidance in diffusion models from the perspective of variational inference…

Machine Learning · Computer Science 2025-05-27 Kushagra Pandey , Farrin Marouf Sofian , Felix Draxler , Theofanis Karaletsos , Stephan Mandt

Exploiting pre-trained diffusion models for restoration has recently become a favored alternative to the traditional task-specific training approach. Previous works have achieved noteworthy success by limiting the solution space using…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Peiqing Yang , Shangchen Zhou , Qingyi Tao , Chen Change Loy

Diffusion models have gained significant popularity in the field of image-to-image translation. Previous efforts applying diffusion models to image super-resolution (SR) have demonstrated that iteratively refining pure Gaussian noise using…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Axi Niu , Pham Xuan Trung , Kang Zhang , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

Machine Learning · Computer Science 2026-05-19 Kwanyoung Kim

Aligning diffusion models with user preferences has been a key challenge. Existing methods for aligning diffusion models either require retraining or are limited to differentiable reward functions. To address these limitations, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Po-Hung Yeh , Kuang-Huei Lee , Jun-Cheng Chen

Pre-trained diffusion models have emerged as powerful generative priors for both unconditional and conditional sample generation, yet their outputs often deviate from the characteristics of user-specific target data. Such mismatches are…

Machine Learning · Computer Science 2026-01-14 Matina Mahdizadeh Sani , Nima Jamali , Mohammad Jalali , Farzan Farnia

Diffusion models have made substantial advances in image generation, yet models trained on large, unfiltered datasets often yield outputs misaligned with human preferences. Numerous methods have been proposed to fine-tune pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Fu-Yun Wang , Yunhao Shui , Jingtan Piao , Keqiang Sun , Hongsheng Li

Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Fuat Arslan , Bilal Kabas , Onat Dalmaz , Muzaffer Ozbey , Tolga Çukur

Real-world datasets collected from sensors or human inputs are prone to noise and errors, posing significant challenges for applying offline reinforcement learning (RL). While existing methods have made progress in addressing corrupted…

Machine Learning · Computer Science 2025-06-06 Zeyuan Liu , Zhihe Yang , Jiawei Xu , Rui Yang , Jiafei Lyu , Baoxiang Wang , Yunjian Xu , Xiu Li

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Recent work on text diffusion models offers a promising alternative to autoregressive generation, but controlling their safety remains underexplored. Existing safety approaches are geared toward autoregressive models and typically rely on…

Machine Learning · Computer Science 2026-05-12 Amman Yusuf , Zhejun Jiang , Mijung Park

Negative Prompting (NP) is widely utilized in diffusion models, particularly in text-to-image applications, to prevent the generation of undesired features. In this paper, we show that conventional NP is limited by the assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Felix Koulischer , Johannes Deleu , Gabriel Raya , Thomas Demeester , Luca Ambrogioni

While synthetic tabular data generation using Deep Generative Models (DGMs) offers a compelling solution to data scarcity and privacy concerns, their effectiveness relies on the availability of substantial training data, often lacking in…

Machine Learning · Computer Science 2025-08-01 Patricia A. Apellániz , Ana Jiménez , Borja Arroyo Galende , Juan Parras , Santiago Zazo

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Text-to-image diffusion models have achieved state-of-the-art results in synthesis tasks; however, there is a growing concern about their potential misuse in creating harmful content. To mitigate these risks, post-hoc model intervention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Feifei Li , Mi Zhang , Yiming Sun , Min Yang

The ubiquity of missing data has sparked considerable attention and focus on tabular data imputation methods. Diffusion models, recognized as the cutting-edge technique for data generation, demonstrate significant potential in tabular data…

Machine Learning · Computer Science 2024-07-26 Yixin Liu , Thalaiyasingam Ajanthan , Hisham Husain , Vu Nguyen

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Diffusion models are emerging as powerful solutions for generating high-fidelity and diverse images, often surpassing GANs under many circumstances. However, their slow inference speed hinders their potential for real-time applications. To…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Luan Thanh Trinh , Tomoki Hamagami