English
Related papers

Related papers: Convergence Analysis of a Proximal Stochastic Deno…

200 papers

The effectiveness of denoising-driven regularization for image reconstruction has been widely recognized. Two prominent algorithms in this area are Plug-and-Play ($\texttt{PnP}$) and Regularization-by-Denoising ($\texttt{RED}$). We consider…

Optimization and Control · Mathematics 2024-11-19 Arghya Sinha , Kunal N. Chaudhury

Due to the development of deep learning-based denoisers, the plug-and-play strategy has achieved great success in image restoration problems. However, existing plug-and-play image restoration methods are designed for non-blind Gaussian…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Yutong Li , Yuping Duan

Plug & Play methods combine proximal algorithms with denoiser priors to solve inverse problems. These methods rely on the computability of the proximal operator of the data fidelity term. In this paper, we propose a Plug & Play framework…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Charles Laroche , Andrés Almansa , Eva Coupeté , Matias Tassano

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

In nonsmooth optimization, a negative subgradient is not necessarily a descent direction, making the design of convergent descent methods based on zeroth-order and first-order information a challenging task. The well-studied bundle methods…

Optimization and Control · Mathematics 2025-05-13 Hanyang Li , Ying Cui

In this work, we provide a new convergence theory for plug-and-play proximal gradient descent (PnP-PGD) under prior mismatch where the denoiser is trained on a different data distribution to the inference task at hand. To the best of our…

Machine Learning · Computer Science 2026-01-29 Guixian Xu , Jinglai Li , Junqi Tang

Recent works on plug-and-play image restoration have shown that a denoiser can implicitly serve as the image prior for model-based methods to solve many inverse problems. Such a property induces considerable advantages for plug-and-play…

Image and Video Processing · Electrical Eng. & Systems 2021-07-14 Kai Zhang , Yawei Li , Wangmeng Zuo , Lei Zhang , Luc Van Gool , Radu Timofte

Solving inverse problems \(Ax = y\) is central to a variety of practically important fields such as medical imaging, remote sensing, and non-destructive testing. The most successful and theoretically best-understood method is convex…

Numerical Analysis · Mathematics 2025-09-23 Daniel Obmann , Gyeongha Hwang , Markus Haltmeier

Regularization by denoising (RED) is a recently developed framework for solving inverse problems by integrating advanced denoisers as image priors. Recent work has shown its state-of-the-art performance when combined with pre-trained deep…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Yu Sun , Jiaming Liu , Yiran Sun , Brendt Wohlberg , Ulugbek S. Kamilov

This work addresses the recovery and demixing problem of signals that are sparse in some general dictionary. Involved applications include source separation, image inpainting, super-resolution, and restoration of signals corrupted by…

Information Theory · Computer Science 2017-03-24 Fei Wen , Lasith Adhikari , Ling Pei , Roummel F. Marcia , Peilin Liu , Robert C. Qiu

Image restoration schemes based on the pre-trained deep models have received great attention due to their unique flexibility for solving various inverse problems. In particular, the Plug-and-Play (PnP) framework is a popular and powerful…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Chong Wang , Rongkai Zhang , Saiprasad Ravishankar , Bihan Wen

Plug-and-play priors (PnP) is an image reconstruction framework that uses an image denoiser as an imaging prior. Unlike traditional regularized inversion, PnP does not require the prior to be expressible in the form of a regularization…

Image and Video Processing · Electrical Eng. & Systems 2020-02-27 Xiaojian Xu , Jiaming Liu , Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, the most popular regularization approaches are Variational-type approaches, i.e.,…

Optimization and Control · Mathematics 2021-06-30 Abinash Nayak

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

Plug-and-Play optimization recently emerged as a powerful technique for solving inverse problems by plugging a denoiser into a classical optimization algorithm. The denoiser accounts for the regularization and therefore implicitly…

Image and Video Processing · Electrical Eng. & Systems 2021-10-04 Mikael Le Pendu , Christine Guillemot

Total Variation regularization (TV) is a seminal approach for image recovery. TV involves the norm of the image's gradient, aggregated over all pixel locations. Therefore, TV leads to piece-wise constant solutions, resulting in what is…

Optimization and Control · Mathematics 2023-09-12 Manu Ghulyani , Muthuvel Arigovindan

In this paper, we carry out numerical analysis to prove convergence of a novel sample-wise back-propagation method for training a class of stochastic neural networks (SNNs). The structure of the SNN is formulated as discretization of a…

Numerical Analysis · Mathematics 2022-12-20 Richard Archibald , Feng Bao , Yanzhao Cao , Hui Sun

We analyze stochastic gradient algorithms for optimizing nonconvex, nonsmooth finite-sum problems. In particular, the objective function is given by the summation of a differentiable (possibly nonconvex) component, together with a possibly…

Optimization and Control · Mathematics 2018-12-04 Zhize Li , Jian Li

In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xuan Cheng , Tianshu Xie , Xiaomin Wang , Qifeng Weng , Minghui Liu , Jiali Deng , Ming Liu

In this paper, we introduce a stochastic projected subgradient method for weakly convex (i.e., uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which includes the additive and convex composite classes. At a…

Optimization and Control · Mathematics 2018-09-19 Damek Davis , Benjamin Grimmer