English
Related papers

Related papers: InverseBench: Benchmarking Plug-and-Play Diffusion…

200 papers

Plug-and-Play (PnP) algorithms are a class of iterative algorithms that address image inverse problems by combining a physical model and a deep neural network for regularization. Even if they produce impressive image restoration results,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Marien Renaud , Jean Prost , Arthur Leclaire , Nicolas Papadakis

Enforcing alignment between the internal representations of diffusion or flow-based generative models and those of pretrained self-supervised encoders has recently been shown to provide a powerful inductive bias, improving both convergence…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Loukas Sfountouris , Giannis Daras , Paris Giampouras

Plug-and-Play (PnP) is a non-convex optimization framework that combines proximal algorithms, for example, the alternating direction method of multipliers (ADMM), with advanced denoising priors. Over the past few years, great empirical…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Kaixuan Wei , Angelica Aviles-Rivero , Jingwei Liang , Ying Fu , Hua Huang , Carola-Bibiane Schönlieb

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

We propose a new method for solving imaging inverse problems using text-to-image latent diffusion models as general priors. Existing methods using latent diffusion models for inverse problems typically rely on simple null text prompts,…

Machine Learning · Computer Science 2023-10-03 Hyungjin Chung , Jong Chul Ye , Peyman Milanfar , Mauricio Delbracio

Diffusion models have emerged as powerful tools for solving inverse problems due to their exceptional ability to model complex prior distributions. However, existing methods predominantly assume known forward operators (i.e., non-blind),…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weimin Bai , Siyi Chen , Wenzheng Chen , He Sun

Electromagnetic (EM) imaging is an important tool for non-invasive sensing with low-cost and portable devices. One emerging application is EM stroke imaging, which enables early diagnosis and continuous monitoring of brain strokes.…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Rui Guo , Yi Zhang , Yhonatan Kvich , Tianyao Huang , Maokun Li , Yonina C. Eldar

We introduce a novel energy formulation for Plug- and-Play (PnP) image recovery. Traditional PnP methods that use a convolutional neural network (CNN) do not have an energy based formulation. The primary focus of this work is to introduce…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Jyothi Rikabh Chand , Mathews Jacob

Inverse problems in partial differential equations (PDEs) involve estimating the physical parameters of a system from observed spatiotemporal solution fields. Neural networks are well-suited for PDE parameter estimation due to their…

Machine Learning · Computer Science 2026-05-27 Divyam Goel , Nithin Chalapathi , Sanjeev Raja , Aditi S. Krishnapriyan

Plug-and-play (PnP) denoising is a popular iterative framework for solving imaging inverse problems using off-the-shelf image denoisers. Their empirical success has motivated a line of research that seeks to understand the convergence of…

Numerical Analysis · Mathematics 2023-07-19 Andreas Hauptmann , Subhadip Mukherjee , Carola-Bibiane Schönlieb , Ferdia Sherry

We consider the task of solving generic inverse problems, where one wishes to determine the hidden parameters of a natural system that will give rise to a particular set of measurements. Recently many new approaches based upon deep learning…

Machine Learning · Computer Science 2021-10-13 Simiao Ren , Willie Padilla , Jordan Malof

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Charles Laroche , Andrés Almansa , Eva Coupete

Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such as super-resolution, inpainting, or deblurring, still require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Kushagra Pandey , Ruihan Yang , Stephan Mandt

Solving inverse partial differential equation (PDE) problems is a fundamental topic in scientific research due to its broad significance across a wide range of real-world applications. Inverse PDE problems arise across medical imaging,…

Artificial Intelligence · Computer Science 2026-05-19 Zhentao Tan , Yuze Hao , Boyi Zou , Mingsheng Long , Yi Yang , Gang Bao

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

This paper is devoted to the investigation of inverse problems related to stationary drift-diffusion equations modeling semiconductor devices. In this context we analyze several identification problems corresponding to different types of…

Analysis of PDEs · Mathematics 2020-11-24 M. Burger , H. W. Engl , A. Leitão , P. A. Markowich

The plug-and-play priors (PnP) and regularization by denoising (RED) methods have become widely used for solving inverse problems by leveraging pre-trained deep denoisers as image priors. While the empirical imaging performance and the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jiaming Liu , M. Salman Asif , Brendt Wohlberg , Ulugbek S. Kamilov

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Diffusion models have been used as priors for solving inverse problems. However, existing approaches typically overlook side information that could significantly improve reconstruction quality, especially in severely ill-posed settings. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mahdi Farahbakhsh , Vishnu Teja Kunde , Dileep Kalathil , Krishna Narayanan , Jean-Francois Chamberland