English
Related papers

Related papers: Inverse problem regularization with hierarchical v…

200 papers

Plug-and-play priors (PnP) is a broadly applicable methodology for solving inverse problems by exploiting statistical priors specified as denoisers. Recent work has reported the state-of-the-art performance of PnP algorithms using…

Machine Learning · Computer Science 2021-01-25 Yu Sun , Zihui Wu , Xiaojian Xu , Brendt Wohlberg , Ulugbek S. Kamilov

The Plug-and-Play (PnP) algorithm is popular for inverse image problem-solving. However, this algorithm lacks theoretical analysis of its convergence with more advanced plug-in denoisers. We demonstrate that discrete PnP iteration can be…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhongqi Wang , Bingnan Wang , Maosheng Xiang

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Regularized inversion methods for image reconstruction are used widely due to their tractability and ability to combine complex physical sensor models with useful regularity criteria. Such methods motivated the recently developed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Gregery T. Buzzard , Stanley H. Chan , Suhas Sreehari , Charles A. Bouman

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

We propose a general deep plug-and-play (PnP) algorithm with a theoretical convergence guarantee. PnP strategies have demonstrated outstanding performance in various image restoration tasks by exploiting the powerful priors underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Yodai Suzuki , Ryosuke Isono , Shunsuke Ono

In plug-and-play (PnP) regularization, the knowledge of the forward model is combined with a powerful denoiser to obtain state-of-the-art image reconstructions. This is typically done by taking a proximal algorithm such as FISTA or ADMM,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-12 Ruturaj G. Gavaskar , Chirayu D. Athalye , Kunal N. Chaudhury

One key ingredient of image restoration is to define a realistic prior on clean images to complete the missing information in the observation. State-of-the-art restoration methods rely on a neural network to encode this prior. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Marien Renaud , Arthur Leclaire , Nicolas Papadakis

This paper introduces an optimal control framework to address the inverse problem using a learned regularizer, with applications in image reconstruction. We build upon the concept of Learnable Optimization Algorithms (LOA), which combine…

Optimization and Control · Mathematics 2024-09-04 Wanyu Bian

In this paper we propose the Iterative Amortized Hierarchical Variational Autoencoder (IA-HVAE), which expands on amortized inference with a hybrid scheme containing an initial amortized guess and iterative refinement with decoder…

Machine Learning · Computer Science 2026-01-23 Simon W. Penninga , Ruud J. G. van Sloun

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

Inverse problems in image processing are typically cast as optimization tasks, consisting of data-fidelity and stabilizing regularization terms. A recent regularization strategy of great interest utilizes the power of denoising engines. Two…

Image and Video Processing · Electrical Eng. & Systems 2020-10-30 Regev Cohen , Michael Elad , Peyman Milanfar

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

In this paper we address the problem of solving ill-posed inverse problems in imaging where the prior is a neural generative model. Specifically we consider the decoupled case where the prior is trained once and can be reused for many…

Machine Learning · Statistics 2019-11-18 Mario González , Andrés Almansa , Mauricio Delbracio , Pablo Musé , Pauline Tan

Plug-and-play (PnP) is a non-convex framework that combines ADMM or other proximal algorithms with advanced denoiser priors. Recently, PnP has achieved great empirical success, especially with the integration of deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-11-19 Kaixuan Wei , Angelica Aviles-Rivero , Jingwei Liang , Ying Fu , Carola-Bibiane Schönlieb , Hua Huang

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Full characterization of the spectral behavior of generative models based on neural networks remains an open issue. Recent research has focused heavily on generative adversarial networks and the high-frequency discrepancies between real and…

Machine Learning · Computer Science 2022-01-20 Sara Björk , Jonas Nordhaug Myhre , Thomas Haugland Johansen

It's well-known that inverse problems are ill-posed and to solve them meaningfully, one has to employ regularization methods. Traditionally, popular regularization methods are the penalized Variational approaches. In recent years, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Abinash Nayak

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Event cameras are novel bio-inspired sensors that measure per-pixel brightness differences asynchronously. Recovering brightness from events is appealing since the reconstructed images inherit the high dynamic range (HDR) and high-speed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zelin Zhang , Anthony Yezzi , Guillermo Gallego