English
Related papers

Related papers: Double Blind Imaging with Generative Modeling

200 papers

Blind image deblurring (BID) is an ill-posed inverse problem, usually addressed by imposing prior knowledge on the (unknown) image and on the blurring filter. Most of the work on BID has focused on natural images, using image priors based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Marina Ljubenović , Mário A. T. Figueiredo

Over the last years, deep learning methods have become an increasingly popular choice to solve tasks from the field of inverse problems. Many of these new data-driven methods have produced impressive results, although most only give point…

Image and Video Processing · Electrical Eng. & Systems 2021-10-28 Alexander Denker , Maximilian Schmidt , Johannes Leuschner , Peter Maass

Medical image reconstruction is typically an ill-posed inverse problem. In order to address such ill-posed problems, the prior distribution of the sought after object property is usually incorporated by means of some sparsity-promoting…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Sayantan Bhadra , Weimin Zhou , Mark A. Anastasio

In recent years, denoising problems have become intertwined with the development of deep generative models. In particular, diffusion models are trained like denoisers, and the distribution they model coincide with denoising priors in the…

Inverse problems consist in reconstructing signals from incomplete sets of measurements and their performance is highly dependent on the quality of the prior knowledge encoded via regularization. While traditional approaches focus on…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Antonio Montanaro , Diego Valsesia , Enrico Magli

Generative models have gained popularity for their potential applications in imaging science, such as image reconstruction, posterior sampling and data sharing. Flow-based generative models are particularly attractive due to their ability…

Machine Learning · Computer Science 2023-12-14 Varun A. Kelkar , Rucha Deshpande , Arindam Banerjee , Mark A. Anastasio

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Solving image inverse problems (e.g., super-resolution and inpainting) requires generating a high fidelity image that matches the given input (the low-resolution image or the masked image). By using the input image as guidance, we can…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Haoyue Tang , Tian Xie , Aosong Feng , Hanyu Wang , Chenyang Zhang , Yang Bai

Deep generative models have been studied and developed primarily in the context of natural images and computer vision. This has spurred the development of (Bayesian) methods that use these generative models for inverse problems in image…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Tristan S. W. Stevens , Jeroen Overdevest , Oisín Nolan , Wessel L. van Nierop , Ruud J. G. van Sloun , Yonina C. Eldar

This paper proposes using a Gaussian mixture model as a prior, for solving two image inverse problems, namely image deblurring and compressive imaging. We capitalize on the fact that variable splitting algorithms, like ADMM, are able to…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Afonso M. Teodoro , José M. Bioucas-Dias , Mário A. T. Figueiredo

Existing image restoration methods mostly leverage the posterior distribution of natural images. However, they often assume known degradation and also require supervised training, which restricts their adaptation to complex real…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ben Fei , Zhaoyang Lyu , Liang Pan , Junzhe Zhang , Weidong Yang , Tianyue Luo , Bo Zhang , Bo Dai

We tackle a challenging blind image denoising problem, in which only single distinct noisy images are available for training a denoiser, and no information about noise is known, except for it being zero-mean, additive, and independent of…

Image and Video Processing · Electrical Eng. & Systems 2021-07-06 Sungmin Cha , Taeeon Park , Byeongjoon Kim , Jongduk Baek , Taesup Moon

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

We introduce Blind Plug-and-Play Diffusion Models (Blind-PnPDM) as a novel framework for solving blind inverse problems where both the target image and the measurement operator are unknown. Unlike conventional methods that rely on explicit…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Anqi Li , Weijie Gan , Ulugbek S. Kamilov

We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based…

Machine Learning · Computer Science 2025-04-23 Asad Aali , Marius Arvinte , Sidharth Kumar , Jonathan I. Tamir

This paper aims to recover object materials from posed images captured under an unknown static lighting condition. Recent methods solve this task by optimizing material parameters through differentiable physically based rendering. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Xi Chen , Sida Peng , Dongchen Yang , Yuan Liu , Bowen Pan , Chengfei Lv , Xiaowei Zhou

Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing solutions incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Linjie Lyu , Ayush Tewari , Marc Habermann , Shunsuke Saito , Michael Zollhöfer , Thomas Leimkühler , Christian Theobalt

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

Diffusion models have recently emerged as powerful generative models in medical imaging. However, it remains a major challenge to combine these data-driven models with domain knowledge to guide brain imaging problems. In neuroimaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ana Lawry Aguila , Dina Zemlyanker , You Cheng , Sudeshna Das , Daniel C. Alexander , Oula Puonti , Annabel Sorby-Adams , W. Taylor Kimberly , Juan Eugenio Iglesias

Ill-posed imaging inverse problems remain challenging due to the ambiguity in mapping degraded observations to clean images. Diffusion-based generative priors have recently shown promise, but typically rely on computationally intensive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-13 Ayush Varshney , Katherine L. Bouman , Berthy T. Feng