English
Related papers

Related papers: Unsupervised Detection of Distribution Shift in In…

200 papers

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

Machine Learning · Computer Science 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

Solving ill-posed inverse problems requires careful formulation of prior beliefs over the signals of interest and an accurate description of their manifestation into noisy measurements. Handcrafted signal priors based on e.g. sparsity are…

Machine Learning · Computer Science 2025-08-14 Tristan S. W. Stevens , Hans van Gorp , Faik C. Meral , Junseob Shin , Jason Yu , Jean-Luc Robert , Ruud J. G. van Sloun

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models; however, such large datasets are not always accessible in medical imaging due to cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yousef Yeganeh , Azade Farshad , Ioannis Charisiadis , Marta Hasny , Martin Hartenberger , Björn Ommer , Nassir Navab , Ehsan Adeli

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

We provide a framework for solving inverse problems with diffusion models learned from linearly corrupted data. Firstly, we extend the Ambient Diffusion framework to enable training directly from measurements corrupted in the Fourier…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Asad Aali , Giannis Daras , Brett Levac , Sidharth Kumar , Alexandros G. Dimakis , Jonathan I. Tamir

We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining…

Machine Learning · Computer Science 2026-05-08 Ahmad Aghapour , Erhan Bayraktar , Asaf Cohen

Generative models have shown strong potential as data-driven priors for solving inverse problems such as reconstructing medical images from undersampled measurements. While these priors improve reconstruction quality with fewer…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Namhoon Kim , Sara Fridovich-Keil

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Yang Song , Liyue Shen , Lei Xing , Stefano Ermon

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then…

Statistics Theory · Mathematics 2024-09-13 Giovanni Conforti , Alain Durmus , Marta Gentiloni Silveri

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

Diffusion probabilistic models (DPMs) represent a class of powerful generative models. Despite their success, the inference of DPMs is expensive since it generally needs to iterate over thousands of timesteps. A key problem in the inference…

Machine Learning · Computer Science 2022-05-04 Fan Bao , Chongxuan Li , Jun Zhu , Bo Zhang

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Score-based methods have recently seen increasing popularity in modeling and generation. Methods have been constructed to perform hypothesis testing and change-point detection with score functions, but these methods are in general not as…

Machine Learning · Statistics 2025-06-23 Sean Moushegian , Taposh Banerjee , Vahid Tarokh

Diffusion models have recently been shown to excel in many image reconstruction tasks that involve inverse problems based on a forward measurement operator. A common framework uses task-agnostic unconditional models that are later…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Alper Güngör , Bahri Batuhan Bilecen , Tolga Çukur

Diffusion models have become increasingly popular for generative modeling due to their ability to generate high-quality samples. This has unlocked exciting new possibilities for solving inverse problems, especially in image restoration and…

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

This paper explores the use of score-based diffusion models for Bayesian image reconstruction. Diffusion models are an efficient tool for generative modeling. Diffusion models can also be used for solving image reconstruction problems. We…

Image and Video Processing · Electrical Eng. & Systems 2025-10-06 Michael T. McCann , Hyungjin Chung , Jong Chul Ye , Marc L. Klasky