English
Related papers

Related papers: Stochastic Generative Plug-and-Play Priors

200 papers

Plug-and-play Image Restoration (IR) has been widely recognized as a flexible and interpretable method for solving various inverse problems by utilizing any off-the-shelf denoiser as the implicit image prior. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuanzhi Zhu , Kai Zhang , Jingyun Liang , Jiezhang Cao , Bihan Wen , Radu Timofte , Luc Van Gool

Existing plug-and-play image restoration methods typically employ off-the-shelf Gaussian denoisers as proximal operators within classical optimization frameworks based on variable splitting. Recently, denoisers induced by generative priors…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ji Li , Chao Wang

We introduce a novel energy formulation for Plug- and-Play (PnP) image recovery. Traditional PnP methods that use a convolutional neural network (CNN) do not have an energy based formulation. The primary focus of this work is to introduce…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Jyothi Rikabh Chand , Mathews Jacob

The incorporation of generative models as regularisers within variational formulations for inverse problems has proven effective across numerous image reconstruction tasks. However, the resulting optimisation problem is often non-convex and…

Machine Learning · Computer Science 2024-08-14 Pascal Fernsel , Željko Kereta , Alexander Denker

Spectral unmixing is a widely used technique in hyperspectral image processing and analysis. It aims to separate mixed pixels into the component materials and their corresponding abundances. Early solutions to spectral unmixing are…

Signal Processing · Electrical Eng. & Systems 2021-04-27 Min zhao , Xiuheng Wang , Jie Chen , Wei Chen

This paper presents a novel deformable registration framework, leveraging an image prior specified through a denoising function, for severely noise-corrupted placental images. Recent work on plug-and-play (PnP) priors has shown the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Jiarui Xing , Ulugbek Kamilov , Wenjie Wu , Yong Wang , Miaomiao Zhang

Achieving high-quality Magnetic Resonance Imaging (MRI) reconstruction at accelerated acquisition rates remains challenging due to the inherent ill-posed nature of the inverse problem. Traditional Compressed Sensing (CS) methods, while…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Pierre-Antoine Comby , Benjamin Lapostolle , Matthieu Terris , Philippe Ciuciu

Poisson-Gaussian noise describes the noise of various imaging systems thus the need of efficient algorithms for Poisson-Gaussian image restoration. Deep learning methods offer state-of-the-art performance but often require sensor-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

In recent years Plug-and-Play (PnP) methods have achieved state-of-the-art performance in inverse imaging problems by replacing proximal operators with denoisers. Based on the proximal gradient method, some theoretical results of PnP have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Shuchang Zhang , Hongxia Wang

Solving ill-posed inverse problems requires careful formulation of prior beliefs over the signals of interest and an accurate description of their manifestation into noisy measurements. Handcrafted signal priors based on e.g. sparsity are…

Machine Learning · Computer Science 2025-08-14 Tristan S. W. Stevens , Hans van Gorp , Faik C. Meral , Junseob Shin , Jason Yu , Jean-Luc Robert , Ruud J. G. van Sloun

Recent methods have shown that pre-trained diffusion models can be fine-tuned to enable generative inverse rendering by learning image-conditioned noise-to-intrinsic mapping. Despite their remarkable progress, they struggle to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Rongjia Zheng , Qing Zhang , Chengjiang Long , Wei-Shi Zheng

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

The plug-and-play (PnP) method uses a deep denoiser within a proximal algorithm for model-based image reconstruction (IR). Unlike end-to-end IR, PnP allows the same pretrained denoiser to be used across different imaging tasks, without the…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Arghya Sinha , Trishit Mukherjee , Kunal N. Chaudhury

Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Zihui Wu , Yu Sun , Yifan Chen , Bingliang Zhang , Yisong Yue , Katherine L. Bouman

Recovering signals from low-order moments is a fundamental yet notoriously difficult task in inverse problems. This recovery process often reduces to solving ill-conditioned systems of polynomial equations. In this work, we propose a new…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Rafi Beinhorn , Shay Kreymer , Amnon Balanov , Michael Cohen , Alon Zabatani , Tamir Bendory

It's well-known that inverse problems are ill-posed and to solve them meaningfully, one has to employ regularization methods. Traditionally, popular regularization methods are the penalized Variational approaches. In recent years, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Abinash Nayak

Flow matching-based generative models have been integrated into the plug-and-play image restoration framework, and the resulting plug-and-play flow matching (PnP-Flow) model has achieved some remarkable empirical success for image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Fan Jia , Yuhao Huang , Shih-Hsin Wang , Cristina Garcia-Cardona , Andrea L. Bertozzi , Bao Wang

State-space models (SSM) are common in signal processing, where Kalman smoothing (KS) methods are state-of-the-art. However, traditional KS techniques lack expressivity as they do not incorporate spatial prior information. Recently, [1]…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Benjamin Hawkes , Mike Davies , Victor Elvira , Audrey Repetti

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah