English
Related papers

Related papers: An Unconditional Representation of the Conditional…

200 papers

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zahra Kadkhodaie , Stéphane Mallat , Eero P. Simoncelli

This paper introduces UnDiff, a diffusion probabilistic model capable of solving various speech inverse tasks. Being once trained for speech waveform generation in an unconditional manner, it can be adapted to different tasks including…

Sampling based on score diffusions has led to striking empirical results, and has attracted considerable attention from various research communities. It depends on availability of (approximate) Stein score functions for various levels of…

Statistics Theory · Mathematics 2026-01-01 M. J. Wainwright

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

Numerical Analysis · Mathematics 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

Accurate Speed-of-Sound (SoS) reconstruction from acoustic waveforms is a cornerstone of ultrasound computed tomography (USCT), enabling quantitative velocity mapping that reveals subtle anatomical details and pathological variations often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yujia Wu , Shuoqi Chen , Shiru Wang , Yucheng Tang , Petr Bruza , Geoffrey P. Luke

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear processes with a…

Machine Learning · Computer Science 2024-07-12 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We present the marginal unbiased score expansion (MUSE) method, an algorithm for generic high-dimensional hierarchical Bayesian inference. MUSE performs approximate marginalization over arbitrary non-Gaussian latent parameter spaces,…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-01 Marius Millea , Uros Seljak

Recently, conditional score-based diffusion models have gained significant attention in the field of supervised speech enhancement, yielding state-of-the-art performance. However, these methods may face challenges when generalising to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Berné Nortier , Mostafa Sadeghi , Romain Serizel

Score-based diffusion modeling is a generative machine learning algorithm that can be used to sample from complex distributions. They achieve this by learning a score function, i.e., the gradient of the log-probability density of the data,…

Machine Learning · Computer Science 2025-12-17 Dibyajyoti Chakraborty , Haiwen Guan , Jason Stock , Troy Arcomano , Guido Cervone , Romit Maulik

The proposed BSDE-based diffusion model represents a novel approach to diffusion modeling, which extends the application of stochastic differential equations (SDEs) in machine learning. Unlike traditional SDE-based diffusion models, our…

Machine Learning · Computer Science 2023-04-27 Zihao Wang

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

Diffusion models have recently shown considerable potential in solving Bayesian inverse problems when used as priors. However, sampling from the resulting denoising posterior distributions remains a challenge as it involves intractable…

Machine Learning · Statistics 2024-12-25 Badr Moufad , Yazid Janati , Lisa Bedin , Alain Durmus , Randal Douc , Eric Moulines , Jimmy Olsson

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Conventional score-based diffusion models (DMs) may struggle with anisotropic Gaussian diffusion processes due to the required inversion of covariance matrices in the denoising score matching training objective…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Jeffrey Alido , Tongyu Li , Yu Sun , Lei Tian

We consider the problem of statistical inference for a class of partially-observed diffusion processes, with discretely-observed data and finite-dimensional parameters. We construct unbiased estimators of the score function, i.e. the…

Methodology · Statistics 2021-05-12 Jeremy Heng , Jeremie Houssineau , Ajay Jasra

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion models into…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Berthy T. Feng , Jamie Smith , Michael Rubinstein , Huiwen Chang , Katherine L. Bouman , William T. Freeman