English
Related papers

Related papers: InverseBench: Benchmarking Plug-and-Play Diffusion…

200 papers

Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Zihui Wu , Yu Sun , Yifan Chen , Bingliang Zhang , Yisong Yue , Katherine L. Bouman

The recently proposed plug-and-play (PnP) framework allows leveraging recent developments in image denoising to tackle other, more involved, imaging inverse problems. In a PnP method, a black-box denoiser is plugged into an iterative…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Afonso M. Teodoro , José M. Bioucas-Dias , Mário A. T. Figueiredo

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Plug-and-Play Priors (PnP) is a popular framework for solving imaging inverse problems by integrating learned priors in the form of denoisers trained to remove Gaussian noise from images. In standard PnP methods, the denoiser is applied…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Edward P. Chandler , Shirin Shoushtari , Brendt Wohlberg , Ulugbek S. Kamilov

Plug-and-play (PnP) prior is a well-known class of methods for solving imaging inverse problems by computing fixed-points of operators combining physical measurement models and learned image denoisers. While PnP methods have been…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Weijie Gan , Shirin Shoushtari , Yuyang Hu , Jiaming Liu , Hongyu An , Ulugbek S. Kamilov

Diffusion models have become a successful approach for solving various image inverse problems by providing a powerful diffusion prior. Many studies tried to combine the measurement into diffusion by score function replacement, matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Hanyu Chen , Zhixiu Hao , Liying Xiao

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

Plug-and-play Image Restoration (IR) has been widely recognized as a flexible and interpretable method for solving various inverse problems by utilizing any off-the-shelf denoiser as the implicit image prior. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuanzhi Zhu , Kai Zhang , Jingyun Liang , Jiezhang Cao , Bihan Wen , Radu Timofte , Luc Van Gool

Diffusion model-based inverse problem solvers have demonstrated state-of-the-art performance in cases where the forward operator is known (i.e. non-blind). However, the applicability of the method to blind inverse problems has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Hyungjin Chung , Jeongsol Kim , Sehui Kim , Jong Chul Ye

We propose an OCT super-resolution framework based on a plug-and-play diffusion model (PnP-DM) to reconstruct high-quality images from sparse measurements (OCT B-mode corneal images). Our method formulates reconstruction as an inverse…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yaning Wang , Jinglun Yu , Wenhan Guo , Yu Sun , Jin U. Kang

We propose a general deep plug-and-play (PnP) algorithm with a theoretical convergence guarantee. PnP strategies have demonstrated outstanding performance in various image restoration tasks by exploiting the powerful priors underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Yodai Suzuki , Ryosuke Isono , Shunsuke Ono

Inverse problems are fundamental to science and engineering, where the goal is to infer an underlying signal or state from incomplete or noisy measurements. Recent approaches employ diffusion models as powerful implicit priors for such…

Machine Learning · Computer Science 2025-11-27 Bilal Ahmed , Joseph G. Makin

Inverse problems appear in many applications, such as image deblurring and inpainting. The common approach to address them is to design a specific algorithm for each problem. The Plug-and-Play (P&P) framework, which has been recently…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Tom Tirer , Raja Giryes

Understanding and modeling lighting effects are fundamental tasks in computer vision and graphics. Classic physically-based rendering (PBR) accurately simulates the light transport, but relies on precise scene representations--explicit 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruofan Liang , Zan Gojcic , Huan Ling , Jacob Munkberg , Jon Hasselgren , Zhi-Hao Lin , Jun Gao , Alexander Keller , Nandita Vijaykumar , Sanja Fidler , Zian Wang

We propose to solve inverse problems involving the temporal evolution of physics systems by leveraging recent advances from diffusion models. Our method moves the system's current state backward in time step by step by combining an…

Machine Learning · Computer Science 2023-12-06 Benjamin J. Holzschuh , Simona Vegetti , Nils Thuerey

There is a growing interest in deep model-based architectures (DMBAs) for solving imaging inverse problems by combining physical measurement models and learned image priors specified using convolutional neural nets (CNNs). For example,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Shirin Shoushtari , Jiaming Liu , Yuyang Hu , Ulugbek S. Kamilov

In an inverse problem, the goal is to recover an unknown parameter (e.g., an image) that has typically undergone some lossy or noisy transformation during measurement. Recently, deep generative models, particularly diffusion models, have…

Machine Learning · Computer Science 2025-07-30 Amartya Banerjee , Xingyu Xu , Caroline Moosmüller , Harlin Lee

Plug-and-play priors (PnP) is a powerful framework for regularizing imaging inverse problems by using advanced denoisers within an iterative algorithm. Recent experimental evidence suggests that PnP algorithms achieve state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

We consider the problem of inferring high-dimensional data $\mathbf{x}$ in a model that consists of a prior $p(\mathbf{x})$ and an auxiliary differentiable constraint $c(\mathbf{x},\mathbf{y})$ on $x$ given some additional information…

Machine Learning · Computer Science 2023-01-10 Alexandros Graikos , Nikolay Malkin , Nebojsa Jojic , Dimitris Samaras