English
Related papers

Related papers: PnP-CM: Consistency Models as Plug-and-Play Priors…

200 papers

We propose a general deep plug-and-play (PnP) algorithm with a theoretical convergence guarantee. PnP strategies have demonstrated outstanding performance in various image restoration tasks by exploiting the powerful priors underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Yodai Suzuki , Ryosuke Isono , Shunsuke Ono

Electromagnetic (EM) imaging is an important tool for non-invasive sensing with low-cost and portable devices. One emerging application is EM stroke imaging, which enables early diagnosis and continuous monitoring of brain strokes.…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Rui Guo , Yi Zhang , Yhonatan Kvich , Tianyao Huang , Maokun Li , Yonina C. Eldar

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ernest K. Ryu , Jialin Liu , Sicheng Wang , Xiaohan Chen , Zhangyang Wang , Wotao Yin

In this work, we present new proofs of convergence for Plug-and-Play (PnP) algorithms. PnP methods are efficient iterative algorithms for solving image inverse problems where regularization is performed by plugging a pre-trained denoiser in…

Optimization and Control · Mathematics 2023-11-03 Samuel Hurault , Antonin Chambolle , Arthur Leclaire , Nicolas Papadakis

State-space models (SSM) are common in signal processing, where Kalman smoothing (KS) methods are state-of-the-art. However, traditional KS techniques lack expressivity as they do not incorporate spatial prior information. Recently, [1]…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Benjamin Hawkes , Mike Davies , Victor Elvira , Audrey Repetti

Diffusion models have emerged as a powerful foundation model for visual generations. With an appropriate sampling process, it can effectively serve as a generative prior for solving general inverse problems. Current posterior sampling-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shijie Zhou , Huaisheng Zhu , Rohan Sharma , Jiayi Chen , Ruiyi Zhang , Kaiyi Ji , Changyou Chen

Existing score-based methods for inverse problems often resort to approximate minimization of the KL divergence between the inversion distribution and the Bayesian posterior. Such an approximation leads to severe mode collapse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weimin Bai , Yuxuan Gu , Yifei Wang , Weijian Luo , He Sun

Plug-and-Play Priors (PnP) is a well-known class of methods for solving inverse problems in computational imaging. PnP methods combine physical forward models with learned prior models specified as image denoisers. A common issue with the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Edward P. Chandler , Shirin Shoushtari , Jiaming Liu , M. Salman Asif , Ulugbek S. Kamilov

Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior…

Machine Learning · Computer Science 2025-06-06 Haoxuan Chen , Yinuo Ren , Martin Renqiang Min , Lexing Ying , Zachary Izzo

Diffusion models have been demonstrated as strong priors for solving general inverse problems. Most existing Diffusion model-based Inverse Problem Solvers (DIS) employ a plug-and-play approach to guide the sampling trajectory with either…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiankun Zhao , Bowen Song , Liyue Shen

Plug & Play methods combine proximal algorithms with denoiser priors to solve inverse problems. These methods rely on the computability of the proximal operator of the data fidelity term. In this paper, we propose a Plug & Play framework…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Charles Laroche , Andrés Almansa , Eva Coupeté , Matias Tassano

Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Consistency Trajectory…

Training-free diffusion priors enable inverse-problem solvers without retraining, but for nonlinear forward operators data consistency often relies on repeated derivatives or inner optimization/MCMC loops with conservative step sizes,…

Machine Learning · Computer Science 2026-04-15 Minwoo Kim , Seunghyeok Shin , Hongki Lim

Recent studies demonstrate that diffusion models can serve as a strong prior for solving inverse problems. A prominent example is Diffusion Posterior Sampling (DPS), which approximates the posterior distribution of data given the measure…

Machine Learning · Statistics 2024-09-16 Yaxuan Zhu , Zehao Dou , Haoxin Zheng , Yasi Zhang , Ying Nian Wu , Ruiqi Gao

We consider the problem of inferring high-dimensional data $\mathbf{x}$ in a model that consists of a prior $p(\mathbf{x})$ and an auxiliary differentiable constraint $c(\mathbf{x},\mathbf{y})$ on $x$ given some additional information…

Machine Learning · Computer Science 2023-01-10 Alexandros Graikos , Nikolay Malkin , Nebojsa Jojic , Dimitris Samaras

Plug-and-Play (PnP) methods are a class of efficient iterative methods that aim to combine data fidelity terms and deep denoisers using classical optimization algorithms, such as ISTA or ADMM, with applications in inverse problems and…

Optimization and Control · Mathematics 2023-11-14 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

The plug-and-play priors (PnP) and regularization by denoising (RED) methods have become widely used for solving inverse problems by leveraging pre-trained deep denoisers as image priors. While the empirical imaging performance and the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jiaming Liu , M. Salman Asif , Brendt Wohlberg , Ulugbek S. Kamilov

Diffusion models excel at creating visually-convincing images, but they often struggle to meet subtle constraints inherent in the training data. Such constraints could be physics-based (e.g., satisfying a PDE), geometric (e.g., respecting…

Machine Learning · Computer Science 2025-04-11 Berthy T. Feng , Ricardo Baptista , Katherine L. Bouman

Pretrained diffusion models (DMs) have recently been popularly used in solving inverse problems (IPs). The existing methods mostly interleave iterative steps in the reverse diffusion process and iterative steps to bring the iterates closer…

Machine Learning · Computer Science 2024-11-07 Hengkang Wang , Xu Zhang , Taihui Li , Yuxiang Wan , Tiancong Chen , Ju Sun