English
Related papers

Related papers: Posterior Sampling by Combining Diffusion Models w…

200 papers

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

Bayesian methods of sampling from a posterior distribution are becoming increasingly popular due to their ability to precisely display the uncertainty of a model fit. Classical methods based on iterative random sampling and posterior…

Machine Learning · Statistics 2022-11-04 Jacopo Guidolin , Vyacheslav Kungurtsev , Ondřej Kuželka

In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Xingyu Xu , Yuejie Chi

Compositional score-based approaches to simulation-based inference (SBI) approximate the posterior over a shared parameter given $n$ independent observations by aggregating individually learned posterior scores: currently, there are two…

Machine Learning · Statistics 2026-05-21 Camille Touron , Gabriel V. Cardoso , Julyan Arbel , Pedro L. C. Rodrigues

Diffusion-based posterior sampling (PS) is a leading framework for imaging inverse problems, combining learned priors with measurement constraints. Yet, its standard formulations rely on instantaneous data-consistent estimates, which induce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Davide Evangelista , Elena Morotti , Francesco Pivi , Maurizio Gabbrielli

While continuous diffusion models have achieved remarkable success, discrete diffusion offers a unified framework for jointly modeling text and images. Beyond unification, discrete diffusion provides faster inference, finer control, and…

Diffusion models have recently achieved success in solving Bayesian inverse problems with learned data priors. Current methods build on top of the diffusion sampling process, where each denoising step makes small modifications to samples…

Machine Learning · Computer Science 2025-08-19 Bingliang Zhang , Wenda Chu , Julius Berner , Chenlin Meng , Anima Anandkumar , Yang Song

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

Diffusion posterior sampling conditions diffusion priors on measurements, but data-consistency updates are typically scaled by hand-tuned guidance weights and can destabilize sampling under stiff, operator-dependent curvature. We replace…

Machine Learning · Computer Science 2026-05-28 Seunghyeok Shin , Minwoo Kim , Dabin Kim , Hongki Lim

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

Zero-shot diffusion posterior sampling offers a flexible framework for inverse problems by accommodating arbitrary degradation operators at test time, but incurs high computational cost due to repeated likelihood-guided updates. In…

Machine Learning · Statistics 2026-02-10 Léon Zheng , Thomas Hirtz , Yazid Janati , Eric Moulines

This paper introduces an alternative approach to sampling from autoregressive models. Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model. Instead, we propose a sampling…

Machine Learning · Computer Science 2021-12-20 Vivek Jayaram , John Thickstun

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

From a Bayesian perspective, score-based diffusion solves inverse problems through joint inference, embedding the likelihood with the prior to guide the sampling process. However, this formulation fails to explain its practical behavior:…

Artificial Intelligence · Computer Science 2026-05-13 Hao Chen , Renzheng Zhang , Scott S. Howard

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

Methodology · Statistics 2024-07-01 Andrea Montanari , Yuchen Wu

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion models into…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Berthy T. Feng , Jamie Smith , Michael Rubinstein , Huiwen Chang , Katherine L. Bouman , William T. Freeman

We propose Amortized Posterior Sampling (APS), a novel variational inference approach for efficient posterior sampling in inverse problems. Our method trains a conditional flow model to minimize the divergence between the variational…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Abbas Mammadov , Hyungjin Chung , Jong Chul Ye

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

Identifying the parameters of a non-linear model that best explain observed data is a core task across scientific fields. When such models rely on complex simulators, evaluating the likelihood is typically intractable, making traditional…