English
Related papers

Related papers: Dual Ascent Diffusion for Inverse Problems

200 papers

In recent years, the ascendance of diffusion modeling as a state-of-the-art generative modeling approach has spurred significant interest in their use as priors in Bayesian inverse problems. However, it is unclear how to optimally integrate…

Optimization and Control · Mathematics 2025-08-28 Evan Scope Crafts , Umberto Villa

We introduce multi-scale energy models to learn the prior distribution of images, which can be used in inverse problems to derive the Maximum A Posteriori (MAP) estimate and to sample from the posterior distribution. Compared to the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Jyothi Rikhab Chand , Mathews Jacob

Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing solutions incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Linjie Lyu , Ayush Tewari , Marc Habermann , Shunsuke Saito , Michael Zollhöfer , Thomas Leimkühler , Christian Theobalt

We provide a framework for solving inverse problems with diffusion models learned from linearly corrupted data. Firstly, we extend the Ambient Diffusion framework to enable training directly from measurements corrupted in the Fourier…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Asad Aali , Giannis Daras , Brett Levac , Sidharth Kumar , Alexandros G. Dimakis , Jonathan I. Tamir

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

Diffusion model-based inverse problem solvers have demonstrated state-of-the-art performance in cases where the forward operator is known (i.e. non-blind). However, the applicability of the method to blind inverse problems has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Hyungjin Chung , Jeongsol Kim , Sehui Kim , Jong Chul Ye

This work addresses image restoration tasks through the lens of inverse problems using unpaired datasets. In contrast to traditional approaches -- which typically assume full knowledge of the forward model or access to paired degraded and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Giacomo Meanti , Thomas Ryckeboer , Michael Arbel , Julien Mairal

Accelerating magnetic resonance imaging (MRI) remains challenging, particularly under realistic acquisition noise. While diffusion models have recently shown promise for reconstructing undersampled MRI data, many approaches lack an explicit…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang , Li Feng

While diffusion priors generate high-quality posterior samples across many inverse problems, they are often trained on limited training sets or purely simulated data, thus inheriting the errors and biases of these underlying sources.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Frederic Wang , Katherine L. Bouman

We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise models with…

Machine Learning · Computer Science 2021-07-02 Jay Whang , Qi Lei , Alexandros G. Dimakis

Diffusion models have recently been shown to excel in many image reconstruction tasks that involve inverse problems based on a forward measurement operator. A common framework uses task-agnostic unconditional models that are later…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Alper Güngör , Bahri Batuhan Bilecen , Tolga Çukur

Diffusion models have become increasingly popular for generative modeling due to their ability to generate high-quality samples. This has unlocked exciting new possibilities for solving inverse problems, especially in image restoration and…

Diffusion Posterior Sampling (DPS) provides a principled Bayesian approach to inverse problems by sampling from $p(x_0 \mid y)$. While posterior sampling is valuable for capturing uncertainty and multi-modality, many classical and practical…

Graphics · Computer Science 2026-05-26 Shaorong Zhang , Rob Brekelmans , Greg Ver Steeg

This paper addresses the issue of inversion in cases where (1) the observation system is modeled by a linear transformation and additive noise, (2) the problem is ill-posed and regularization is introduced in a Bayesian framework by an a…

Machine Learning · Statistics 2026-02-12 Jean-François Giovannelli

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear…

Machine Learning · Statistics 2025-10-06 Hyungjin Chung , Jeongsol Kim , Michael T. Mccann , Marc L. Klasky , Jong Chul Ye

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

Recent advancements in diffusion models have been leveraged to address inverse problems without additional training, and Diffusion Posterior Sampling (DPS) (Chung et al., 2022a) is among the most popular approaches. Previous analyses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Tongda Xu , Xiyan Cai , Xinjie Zhang , Xingtong Ge , Dailan He , Ming Sun , Jingjing Liu , Ya-Qin Zhang , Jian Li , Yan Wang

Reconstructing high-fidelity magnetic resonance (MR) images from under-sampled k-space is a commonly used strategy to reduce scan time. The posterior sampling of diffusion models based on the real measurement data holds significant promise…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Jiayue Chu , Chenhe Du , Xiyue Lin , Yuyao Zhang , Hongjiang Wei

Diffusion models can generate a variety of high-quality images by modeling complex data distributions. Trained diffusion models can also be very effective image priors for solving inverse problems. Most of the existing diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-01 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif