English
Related papers

Related papers: Online Deep Equilibrium Learning for Regularizatio…

200 papers

Deep neural networks trained as image denoisers are widely used as priors for solving imaging inverse problems. While Gaussian denoising is thought sufficient for learning image priors, we show that priors from deep models pre-trained as…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Yuyang Hu , Albert Peng , Weijie Gan , Peyman Milanfar , Mauricio Delbracio , Ulugbek S. Kamilov

The widely used RED (Regularization-by-Denoising) framework uses pretrained denoisers as implicit regularizers for model-based reconstruction. Although RED generally yields high-fidelity reconstructions, the use of black-box denoisers can…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Shraddha Chavan , Kunal N. Chaudhury

This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-16 Antoine Monod , Julie Delon , Matias Tassano , Andrés Almansa

There has been tremendous research on the design of image regularizers over the years, from simple Tikhonov and Laplacian to sophisticated sparsity and CNN-based regularizers. Coupled with a model-based loss function, these are typically…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Pravin Nair , Kunal N. Chaudhury

Many tasks in deep learning involve optimizing over the \emph{inputs} to a network to minimize or maximize some objective; examples include optimization over latent spaces in a generative model to match a target image, or adversarially…

Machine Learning · Computer Science 2021-11-29 Swaminathan Gurumurthy , Shaojie Bai , Zachary Manchester , J. Zico Kolter

We present a new approach to modeling sequential data: the deep equilibrium model (DEQ). Motivated by an observation that the hidden layers of many existing deep sequence models converge towards some fixed point, we propose the DEQ approach…

Machine Learning · Computer Science 2019-10-30 Shaojie Bai , J. Zico Kolter , Vladlen Koltun

The Plug-and-Play (PnP) framework was recently introduced for low-dose CT reconstruction to leverage the interpretability and the flexibility of model-based methods to incorporate various plugins, such as trained deep learning (DL) neural…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Qifan Xu , Qihui Lyu , Dan Ruan , Ke Sheng

Deep equilibrium models (DEQs) have proven to be very powerful for learning data representations. The idea is to replace traditional (explicit) feedforward neural networks with an implicit fixed-point equation, which allows to decouple the…

Machine Learning · Computer Science 2023-04-25 Bac Nguyen , Lukas Mauch

Due to the development of deep learning-based denoisers, the plug-and-play strategy has achieved great success in image restoration problems. However, existing plug-and-play image restoration methods are designed for non-blind Gaussian…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Yutong Li , Yuping Duan

Diffusion models have found extensive use in solving inverse problems, by sampling from an approximate posterior distribution of data given the measurements. Recently, consistency models (CMs) have been proposed to directly predict the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Merve Gülle , Junno Yun , Yaşar Utku Alçalar , Mehmet Akçakaya

In recent years, deep learning methods have been extensively developed for inverse imaging problems (IIPs), encompassing supervised, self-supervised, and generative approaches. Most of these methods require large amounts of labeled or…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Ismail Alkhouri , Evan Bell , Avrajit Ghosh , Shijun Liang , Rongrong Wang , Saiprasad Ravishankar

Positron emission tomography (PET) reconstruction has become an ill-posed inverse problem due to low-count projection data, and a robust algorithm is urgently required to improve imaging quality. Recently, the deep image prior (DIP) has…

Image and Video Processing · Electrical Eng. & Systems 2021-11-01 Chenyu Shen , Wenjun Xia , Hongwei Ye , Mingzheng Hou , Hu Chen , Yan Liu , Jiliu Zhou , Yi Zhang

Segmentation of microscopy images constitutes an ill-posed inverse problem due to measurement noise, weak object boundaries, and limited labeled data. Although deep neural networks provide flexible nonparametric estimators, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Seema K. Poudel , Sunny K. Khadka

The Retinex model is one of the most representative and effective methods for low-light image enhancement. However, the Retinex model does not explicitly tackle the noise problem, and shows unsatisfactory enhancing results. In recent years,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-20 Tingting Wu , Wenna Wu , Ying Yang , Feng-Lei Fan , Tieyong Zeng

The plug-and-play priors (PnP) framework has been recently shown to achieve state-of-the-art results in regularized image reconstruction by leveraging a sophisticated denoiser within an iterative algorithm. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yu Sun , Shiqi Xu , Yunzhe Li , Lei Tian , Brendt Wohlberg , Ulugbek S. Kamilov

Recent work has shown that the structure of convolutional neural networks (CNNs) induces a strong prior that favors natural images. This prior, known as a deep image prior (DIP), is an effective regularizer in inverse problems such as image…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Pallabi Ghosh , Vibhav Vineet , Larry S. Davis , Abhinav Shrivastava , Sudipta Sinha , Neel Joshi

Plug-and-Play (PnP) methods have become standard tools for solving imaging inverse problems by replacing the intractable maximum a posteriori (MAP) denoiser with the MMSE one. While this mismatch has been widely treated as unavoidable,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kenta Vert , Giacomo Meanti , Scott Pesme , Michael Arbel , Julien Mairal

Bilevel optimization offers a methodology to learn hyperparameters in imaging inverse problems, yet its integration with automatic differentiation techniques remains challenging. On the one hand, inverse problems are typically solved by…

Optimization and Control · Mathematics 2025-06-17 Leo Davy , Luis M. Briceno-Arias , N. Pustelnik

Fast convergence and high-quality image recovery are two essential features of algorithms for solving ill-posed imaging inverse problems. Existing methods, such as regularization by denoising (RED), often focus on designing sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Marien Renaud , Julien Hermant , Deliang Wei , Yu Sun

Plug-and-play (PnP) methods with deep denoisers have shown impressive results in imaging problems. They typically require strong convexity or smoothness of the fidelity term and a (residual) non-expansive denoiser for convergence. These…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Deliang Wei , Peng Chen , Haobo Xu , Jiale Yao , Fang Li , Tieyong Zeng