English
Related papers

Related papers: Weak Diffusion Priors Can Still Achieve Strong Inv…

200 papers

Diffusion generative models unlock new possibilities for inverse problems as they allow for the incorporation of strong empirical priors in scientific inference. Recently, diffusion models are repurposed for solving inverse problems using…

Diffusion models have been firmly established as principled zero-shot solvers for linear and nonlinear inverse problems, owing to their powerful image prior and iterative sampling algorithm. These approaches often rely on Tweedie's formula,…

Machine Learning · Computer Science 2026-04-29 Jonathan Patsenker , Henry Li , Myeongseob Ko , Ruoxi Jia , Yuval Kluger

Although diffusion models are rising as a powerful solution for blind face restoration, they are criticized for two problems: 1) slow training and inference speed, and 2) failure in preserving identity and recovering fine-grained facial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yunqi Miao , Jiankang Deng , Jungong Han

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

Diffusion models can generate a variety of high-quality images by modeling complex data distributions. Trained diffusion models can also be very effective image priors for solving inverse problems. Most of the existing diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-01 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

Plug-and-play approaches to solving inverse problems such as restoration and super-resolution have recently benefited from Diffusion-based generative priors for natural as well as medical images. However, solutions often use the standard…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Saikat Roy , Mahmoud Mostapha , Radu Miron , Matt Holbrook , Mariappan Nadar

Diffusion models have demonstrated their powerful image generation capabilities, effectively fitting highly complex image distributions. These models can serve as strong priors for image restoration. Existing methods often utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hanbang Liang , Zhen Wang , Weihui Deng

This work targets to construct a robust human pose prior. However, it remains a persistent challenge due to biomechanical constraints and diverse human movements. Traditional priors like VAEs and NDFs often exhibit shortcomings in realism…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Junzhe Lu , Jing Lin , Hongkun Dou , Ailing Zeng , Yue Deng , Yulun Zhang , Haoqian Wang

Diffusion models have found phenomenal success as expressive priors for solving inverse problems, but their extension beyond natural images to more structured scientific domains remains limited. Motivated by applications in materials…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Timofey Efimov , Harry Dong , Megna Shah , Jeff Simmons , Sean Donegan , Yuejie Chi

Used as priors for Bayesian inverse problems, diffusion models have recently attracted considerable attention in the literature. Their flexibility and high variance enable them to generate multiple solutions for a given task, such as…

Machine Learning · Computer Science 2025-07-10 Emile Pierret , Bruno Galerne

In recent years, the ascendance of diffusion modeling as a state-of-the-art generative modeling approach has spurred significant interest in their use as priors in Bayesian inverse problems. However, it is unclear how to optimally integrate…

Optimization and Control · Mathematics 2025-08-28 Evan Scope Crafts , Umberto Villa

Deep neural networks as image priors have been recently introduced for problems such as denoising, super-resolution and inpainting with promising performance gains over hand-crafted image priors such as sparsity and low-rank. Unlike learned…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Gauri Jagatap , Chinmay Hegde

We present Wideband Back-Projection Diffusion, an end-to-end probabilistic framework for approximating the posterior distribution induced by the inverse scattering map from wideband scattering data. This framework produces highly accurate…

Machine Learning · Computer Science 2025-05-20 Borong Zhang , Martín Guerra , Qin Li , Leonardo Zepeda-Núñez

Diffusion models (DMs) are advanced deep learning models that achieved state-of-the-art capability on a wide range of generative tasks. However, recent studies have shown their vulnerability regarding backdoor attacks, in which backdoored…

Artificial Intelligence · Computer Science 2024-09-24 Vu Tuan Truong , Long Bao Le

Ill-posed inverse problems are fundamental in many domains, ranging from astrophysics to medical imaging. Emerging diffusion models provide a powerful prior for solving these problems. Existing maximum-a-posteriori (MAP) or posterior…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Minseo Kim , Axel Levy , Gordon Wetzstein

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

We propose a new method for solving imaging inverse problems using text-to-image latent diffusion models as general priors. Existing methods using latent diffusion models for inverse problems typically rely on simple null text prompts,…

Machine Learning · Computer Science 2023-10-03 Hyungjin Chung , Jong Chul Ye , Peyman Milanfar , Mauricio Delbracio

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

We consider solving ill-posed imaging inverse problems without access to an explicit image prior or ground-truth examples. An overarching challenge in inverse problems is that there are many undesired images that fit to the observed…

Image and Video Processing · Electrical Eng. & Systems 2023-03-23 Angela F. Gao , Oscar Leong , He Sun , Katherine L. Bouman

Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at a single scale,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Darshan Thaker , Mahmoud Mostapha , Radu Miron , Shihan Qiu , Mariappan Nadar