English
Related papers

Related papers: Control Variate Score Matching for Diffusion Model…

200 papers

This paper investigates the score-based diffusion models for density estimation when the target density admits a factorizable low-dimensional nonparametric structure. To be specific, we show that when the log density admits a $d^*$-way…

Statistics Theory · Mathematics 2025-10-07 Jianqing Fan , Yihong Gu , Ximing Li

Diffusion models generate samples by estimating the score function of the target distribution at various noise levels. The model is trained using samples drawn from the target distribution by progressively adding noise. Previous sample…

Machine Learning · Computer Science 2025-10-28 Syamantak Kumar , Dheeraj Nagaraj , Purnamrita Sarkar

Denoising score matching (DSM) provides a way to learn data distributions by training a neural network to recover the score function, defined as the gradient of the log density, from noise-corrupted samples. Once trained, the score…

Machine Learning · Computer Science 2026-05-11 Victor Livernoche , Jie Zan , Reihaneh Rabbany

Hyperspectral image change detection (HSI-CD) has emerged as a crucial research area in remote sensing due to its ability to detect subtle changes on the earth's surface. Recently, diffusional denoising probabilistic models (DDPM) have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiangrong Zhang , Shunli Tian , Guanchun Wang , Huiyu Zhou , Licheng Jiao

Denoising diffusion models have become ubiquitous for generative modeling. The core idea is to transport the data distribution to a Gaussian by using a diffusion. Approximate samples from the data distribution are then obtained by…

We study the problem of training diffusion and flow generative models to sample from target distributions defined by an exponential tilting of a base density; a formulation that subsumes both sampling from unnormalized densities and reward…

Machine Learning · Statistics 2026-05-04 Carles Domingo-Enrich , Yuanqi Du , Michael S. Albergo

Diffusion models achieve state-of-the-art image synthesis, with their generative trajectories fundamentally exhibiting a spectral bias, resolving low-frequency global structures early and high-frequency fine details later. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hadar Davidson , Noam Issachar , Sagie Benaim

Recently, Zhang et al. have proposed the Diffusion Exponential Integrator Sampler (DEIS) for fast generation of samples from Diffusion Models. It leverages the semi-linear nature of the probability flow ordinary differential equation (ODE)…

Machine Learning · Computer Science 2023-11-13 Guoxuan Xia , Duolikun Danier , Ayan Das , Stathi Fotiadis , Farhang Nabiei , Ushnish Sengupta , Alberto Bernacchia

Sequential change-point detection plays a critical role in numerous real-world applications, where timely identification of distributional shifts can greatly mitigate adverse outcomes. Classical methods commonly rely on parametric density…

Machine Learning · Statistics 2025-01-23 Wenbin Zhou , Liyan Xie , Zhigang Peng , Shixiang Zhu

Diffusion models exhibit excellent sample quality, but existing guidance methods often require additional model training or are limited to specific tasks. We revisit guidance in diffusion models from the perspective of variational inference…

Machine Learning · Computer Science 2025-05-27 Kushagra Pandey , Farrin Marouf Sofian , Felix Draxler , Theofanis Karaletsos , Stephan Mandt

Reducing acquisition time is a crucial challenge for many imaging techniques. Compressed Sensing (CS) theory offers an appealing framework to address this issue since it provides theoretical guarantees on the reconstruction of sparse…

Applications · Statistics 2014-07-17 Nicolas Chauffert , Philippe Ciuciu , Jonas Kahn , Pierre Weiss

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

Background noise considerably reduces the accuracy and reliability of speaker verification (SV) systems. These challenges can be addressed using a speech enhancement system as a front-end module. Recently, diffusion probabilistic models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-20 Ju-ho Kim , Jungwoo Heo , Hyun-seo Shin , Chan-yeong Lim , Ha-Jin Yu

Denoising diffusion models have recently shown impressive results in generative tasks. By learning powerful priors from huge collections of training images, such models are able to gradually modify complete noise to a clean natural image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Naama Pearl , Yaron Brodsky , Dana Berman , Assaf Zomet , Alex Rav Acha , Daniel Cohen-Or , Dani Lischinski

Most existing theoretical investigations of the accuracy of diffusion models, albeit significant, assume the score function has been approximated to a certain accuracy, and then use this a priori bound to control the error of generation.…

Machine Learning · Computer Science 2024-10-29 Yuqing Wang , Ye He , Molei Tao

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world…

Methodology · Statistics 2024-11-26 Promit Chakroborty , Somayajulu L. N. Dhulipala , Michael D. Shields

Diffusion models often exhibit inconsistent sample quality due to stochastic variations inherent in their sampling trajectories. Although training-based fine-tuning (e.g. DDPO [1]) and inference-time alignment techniques[2] aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sixian Wang , Zhiwei Tang , Tsung-Hui Chang

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang

Most of the existing diffusion models use Gaussian noise for training and sampling across all time steps, which may not optimally account for the frequency contents reconstructed by the denoising network. Despite the diverse applications of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Xingchang Huang , Corentin Salaün , Cristina Vasconcelos , Christian Theobalt , Cengiz Öztireli , Gurprit Singh