English
Related papers

Related papers: Mining the manifolds of deep generative models for…

200 papers

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear…

Machine Learning · Statistics 2025-10-06 Hyungjin Chung , Jeongsol Kim , Michael T. Mccann , Marc L. Klasky , Jong Chul Ye

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

A broad class of problems at the core of computational imaging, sensing, and low-level computer vision reduces to the inverse problem of extracting latent images that follow a prior distribution, from measurements taken under a known…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Steven Diamond , Vincent Sitzmann , Felix Heide , Gordon Wetzstein

Posterior sampling in high-dimensional spaces using generative models holds significant promise for various applications, including but not limited to inverse problems and guided generation tasks. Despite many recent developments,…

Machine Learning · Statistics 2024-10-04 Vishal Purohit , Matthew Repasky , Jianfeng Lu , Qiang Qiu , Yao Xie , Xiuyuan Cheng

Electrical Impedance Tomography (EIT) is a powerful imaging technique with diverse applications, e.g., medical diagnosis, industrial monitoring, and environmental studies. The EIT inverse problem is about inferring the internal conductivity…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Andreas Hauptmann , Bangti Jin , Peter Maass

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Tomographic image reconstruction is relevant for many medical imaging modalities including X-ray, ultrasound (US) computed tomography (CT) and photoacoustics, for which the access to full angular range tomographic projections might be not…

Image and Video Processing · Electrical Eng. & Systems 2019-06-14 Valery Vishnevskiy , Richard Rau , Orcun Goksel

Diffusion models provide a powerful way to incorporate complex prior information for solving inverse problems. However, existing methods struggle to correctly incorporate guidance from conflicting signals in the prior and measurement, and…

Machine Learning · Computer Science 2025-10-07 Shaorong Zhang , Rob Brekelmans , Yunshu Wu , Greg Ver Steeg

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Coloma Ballester , Aurelie Bugeau , Samuel Hurault , Simone Parisotto , Patricia Vitoria

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

Image and Video Processing · Electrical Eng. & Systems 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

Compressive sensing (CS) reconstructs images from sub-Nyquist measurements by solving a sparsity-regularized inverse problem. Traditional CS solvers use iterative optimizers with hand crafted sparsifiers, while early data-driven methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pamuditha Somarathne , Tharindu Wickremasinghe , Amashi Niwarthana , A. Thieshanthan , Chamira U. S. Edussooriya , Dushan N. Wadduwage

Blind inverse problems in imaging arise from uncertainties in the system used to collect (noisy) measurements of images. Recovering clean images from these measurements typically requires identifying the imaging system, either implicitly or…

Image and Video Processing · Electrical Eng. & Systems 2025-03-28 Brett Levac , Ajil Jalal , Kannan Ramchandran , Jonathan I. Tamir

In recent years, Generative Adversarial Networks (GANs) have shown substantial progress in modeling complex distributions of data. These networks have received tremendous attention since they can generate implicit probabilistic models that…

Signal Processing · Electrical Eng. & Systems 2018-10-25 Mehdi Ahmadi , Timothy Nest , Mostafa Abdelnaim , Thanh-Dung Le

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by deep generative networks). In this work, we study the…

Machine Learning · Computer Science 2021-05-14 Viraj Shah , Rakib Hyder , M. Salman Asif , Chinmay Hegde

Positron emission tomography (PET) is an important functional medical imaging technique often used in the evaluation of certain brain disorders, whose reconstruction problem is ill-posed. The vast majority of reconstruction methods in PET…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Tin Vlašić , Tomislav Matulić , Damir Seršić

In the recent years, there has been a significant improvement in the quality of samples produced by (deep) generative models such as variational auto-encoders and generative adversarial networks. However, the representation capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Shady Abu Hussein , Tom Tirer , Raja Giryes

Recently, deep generative models have been used for posterior inference in inverse problems, including high-stakes applications in medical imaging and scientific discovery, where the uncertainty of a prediction can matter as much as the…

Machine Learning · Computer Science 2026-05-15 Yuxin Guo , Dongrui Deng , Pulkit Grover