English
Related papers

Related papers: MAP Estimation with Denoisers: Convergence Rates a…

200 papers

First-order optimization algorithms are widely used today. Two standard building blocks in these algorithms are proximal operators (proximals) and gradients. Although gradients can be computed for a wide array of functions, explicit…

Optimization and Control · Mathematics 2023-05-30 Stanley Osher , Howard Heaton , Samy Wu Fung

For image recovery problems, plug-and-play (PnP) methods have been developed that replace the proximal step in an optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network.…

Information Theory · Computer Science 2022-02-14 Saurav K Shastri , Rizwan Ahmad , Christopher A Metzler , Philip Schniter

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

Image restoration has seen great progress in the last years thanks to the advances in deep neural networks. Most of these existing techniques are trained using full supervision with suitable image pairs to tackle a specific degradation.…

Image and Video Processing · Electrical Eng. & Systems 2020-09-11 Leonhard Helminger , Michael Bernasconi , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

In this work, we present new proofs of convergence for Plug-and-Play (PnP) algorithms. PnP methods are efficient iterative algorithms for solving image inverse problems where regularization is performed by plugging a pre-trained denoiser in…

Optimization and Control · Mathematics 2023-11-03 Samuel Hurault , Antonin Chambolle , Arthur Leclaire , Nicolas Papadakis

Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yasi Zhang , Peiyu Yu , Yaxuan Zhu , Yingshan Chang , Feng Gao , Ying Nian Wu , Oscar Leong

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

Underpinning the success of deep learning is effective regularizations that allow a variety of priors in data to be modeled. For example, robustness to adversarial perturbations, and correlations between multiple modalities. However, most…

Machine Learning · Computer Science 2020-06-16 Mao Li , Yingyi Ma , Xinhua Zhang

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

Maximum a Posteriori assignment (MAP) is the problem of finding the most probable instantiation of a set of variables given the partial evidence on the other variables in a Bayesian network. MAP has been shown to be a NP-hard problem [22],…

Artificial Intelligence · Computer Science 2012-07-19 Changhe Yuan , Tsai-Ching Lu , Marek J. Druzdzel

In plug-and-play (PnP) regularization, the proximal operator in algorithms such as ISTA and ADMM is replaced by a powerful denoiser. This formal substitution works surprisingly well in practice. In fact, PnP has been shown to give…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Chirayu D. Athalye , Kunal N. Chaudhury , Bhartendu Kumar

The use of denoisers for image reconstruction has shown significant potential, especially for the Plug-and-Play (PnP) framework. In PnP, a powerful denoiser is used as an implicit regularizer in proximal algorithms such as ISTA and ADMM.…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Arghya Sinha , Bhartendu Kumar , Chirayu D. Athalye , Kunal N. Chaudhury

In this paper we address the problem of solving ill-posed inverse problems in imaging where the prior is a neural generative model. Specifically we consider the decoupled case where the prior is trained once and can be reused for many…

Machine Learning · Statistics 2019-11-18 Mario González , Andrés Almansa , Mauricio Delbracio , Pablo Musé , Pauline Tan

Deep denoisers have shown excellent performance in solving inverse problems in signal and image processing. In order to guarantee the convergence, the denoiser needs to satisfy some Lipschitz conditions like non-expansiveness. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Deliang Wei , Peng Chen , Fang Li

Recent hardware advancements in AI Accelerators and GPUs allow to efficiently compute sparse matrix multiplications, especially when 2 out of 4 consecutive weights are set to zero. However, this so-called 2:4 sparsity usually comes at a…

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

Machine Learning · Computer Science 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

Score-based diffusion models have significantly advanced high-dimensional data generation across various domains, by learning a denoising oracle (or score) from datasets. From a Bayesian perspective, they offer a realistic modeling of data…

Machine Learning · Computer Science 2024-07-02 Joan Bruna , Jiequn Han

The utilisation of Plug-and-Play (PnP) priors in inverse problems has become increasingly prominent in recent years. This preference is based on the mathematical equivalence between the general proximal operator and the regularised…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yanqi Cheng , Lipei Zhang , Zhenda Shen , Shujun Wang , Lequan Yu , Raymond H. Chan , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson