English
Related papers

Related papers: Weak Diffusion Priors Can Still Achieve Strong Inv…

200 papers

How do diffusion generative models convert pure noise into meaningful images? In a variety of pretrained diffusion models (including conditional latent space models like Stable Diffusion), we observe that the reverse diffusion process that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Binxu Wang , John J. Vastola

Diffusion-based image generators are promising priors for ill-posed inverse problems like sparse-view X-ray Computed Tomography (CT). As most studies consider synthetic data, it is not clear whether training data mismatch (``domain shift'')…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nelas J. Thomsen , Xinyuan Wang , Felix Lucka , Ezgi Demircan-Tureyen

Thanks to their remarkable denoising capabilities, diffusion models are increasingly being employed as defensive tools to reinforce the security of other models, notably in purifying adversarial examples and certifying adversarial…

Cryptography and Security · Computer Science 2024-06-17 Changjiang Li , Ren Pang , Bochuan Cao , Jinghui Chen , Fenglong Ma , Shouling Ji , Ting Wang

The presence of adversarial examples poses a significant threat to deep learning models and their applications. Existing defense methods provide certain resilience against adversarial examples, but often suffer from decreased accuracy and…

Cryptography and Security · Computer Science 2023-11-27 Jiahao Chen , Diqun Yan , Li Dong

Vision foundation models are widely used as frozen backbones across many downstream tasks, making them a single point of failure under adversarial attack. We study multi-level Floyd-Steinberg error-diffusion dithering as a lightweight,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

In the Bayesian approach, the a priori knowledge about the input of a mathematical model is described via a probability measure. The joint distribution of the unknown input and the data is then conditioned, using Bayes' formula, giving rise…

Statistics Theory · Mathematics 2015-06-15 Sebastian J. Vollmer

The pretrained diffusion model as a strong prior has been leveraged to address inverse problems in a zero-shot manner without task-specific retraining. Different from the unconditional generation, the measurement-guided generation requires…

Optimization and Control · Mathematics 2025-03-14 Ji Li , Chao Wang

Diffusion models exhibit impressive generative capabilities but are significantly impacted by exposure bias. In this paper, we make a key observation: the energy of predicted noisy samples in the reverse process continuously declines…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Meng Yu , Kun Zhan

We leverage diffusion models to study the robustness-performance tradeoff of robust classifiers. Our approach introduces a simple, pretrained diffusion method to generate low-norm counterfactual examples (CEs): semantically altered data…

Machine Learning · Computer Science 2024-04-18 Eric Yeats , Cameron Darwin , Eduardo Ortega , Frank Liu , Hai Li

Recovering a signal from its degraded measurements is a long standing challenge in science and engineering. Recently, zero-shot diffusion based methods have been proposed for such inverse problems, offering a posterior sampling based…

Machine Learning · Computer Science 2026-05-19 Roi Benita , Michael Elad , Joseph Keshet

Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Matt C. Bendel , Saurav K. Shastri , Rizwan Ahmad , Philip Schniter

Methods based on diffusion models (DMs) for solving inverse problems (IPs) have recently achieved remarkable performance. However, DM-based methods typically struggle against outliers, which are common in real-world measurements. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yang Zheng , Jiahua Liu , Tongyao Pang , Wen Li , Zhaoqiang Liu

This article addresses the issue of estimating observation parameters (response and error parameters) in inverse problems. The focus is on cases where regularization is introduced in a Bayesian framework and the prior is modeled by a…

Machine Learning · Statistics 2026-02-13 Jean-François Giovannelli

Diffusion models are a class of generative models that learn to synthesize samples by inverting a diffusion process that gradually maps data into noise. While these models have enjoyed great success recently, a full theoretical…

Machine Learning · Computer Science 2023-09-22 Raja Marjieh , Ilia Sucholutsky , Thomas A. Langlois , Nori Jacoby , Thomas L. Griffiths

While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice. To address this issue, transfer learning has emerged as an…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Tianyu Xie , Shiyue Zhang , Cheng Zhang

Diffusion models have recently shown promise as powerful generative priors for inverse problems. However, conventional applications require solving the full reverse diffusion process and operating on noisy intermediate states, which poses…

Geophysics · Physics 2025-06-13 Yuke Xie , Hervé Chauris , Nicolas Desassis

Diffusion models have been demonstrated as strong priors for solving general inverse problems. Most existing Diffusion model-based Inverse Problem Solvers (DIS) employ a plug-and-play approach to guide the sampling trajectory with either…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiankun Zhao , Bowen Song , Liyue Shen

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

Benchmark datasets used for image classification tend to have very low levels of label noise. When Bayesian neural networks are trained on these datasets, they often underfit, misrepresenting the aleatoric uncertainty of the data. A common…

Machine Learning · Computer Science 2024-03-05 Martin Marek , Brooks Paige , Pavel Izmailov