English
Related papers

Related papers: Discrete Langevin-Inspired Posterior Sampling

200 papers

Diffusion models form an important class of generative models today, accounting for much of the state of the art in cutting edge AI research. While numerous extensions beyond image and video generation exist, few of such approaches address…

Machine Learning · Computer Science 2025-04-30 Hao Luan , See-Kiong Ng , Chun Kai Ling

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

Diffusion models have emerged as powerful tools for solving inverse problems due to their exceptional ability to model complex prior distributions. However, existing methods predominantly assume known forward operators (i.e., non-blind),…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weimin Bai , Siyi Chen , Wenzheng Chen , He Sun

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Zihui Wu , Yu Sun , Yifan Chen , Bingliang Zhang , Yisong Yue , Katherine L. Bouman

We introduce Generalized Discrete Diffusion from Snapshots (GDDS), a unified framework for discrete diffusion modeling that supports arbitrary noising processes over large discrete state spaces. Our formulation encompasses all existing…

Machine Learning · Statistics 2026-03-24 Oussama Zekri , Théo Uscidda , Nicolas Boullé , Anna Korba

We present a latent diffusion-based differentiable inversion method (LD-DIM) for PDE-constrained inverse problems involving high-dimensional spatially distributed coefficients. LD-DIM couples a pretrained latent diffusion prior with an…

Numerical Analysis · Mathematics 2025-12-30 Zihan Lin , QiZhi He

We consider a class of inverse problems characterized by forward operators that are partially specified, non-smooth, and non-differentiable. Although generative inverse solvers have made significant progress, we find that these forward…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Sattwik Basu , Chaitanya Amballa , Zhongweiyang Xu , Jorge Vančo Sampedro , Srihari Nelakuditi , Romit Roy Choudhury

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms,…

Machine Learning · Computer Science 2026-05-29 Arran Carter , Sanghyeok Choi , Kirill Tamogashev , Víctor Elvira , Esmeralda S. Whitammer

Solving image inverse problems (e.g., super-resolution and inpainting) requires generating a high fidelity image that matches the given input (the low-resolution image or the masked image). By using the input image as guidance, we can…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Haoyue Tang , Tian Xie , Aosong Feng , Hanyu Wang , Chenyang Zhang , Yang Bai

Diffusion-based posterior samplers use pretrained diffusion priors to sample from measurement- or reward-conditioned posteriors, and are widely used for inverse problems. Yet their theoretical behavior remains poorly understood: even with…

Machine Learning · Computer Science 2026-05-08 Matias G. Delgadino , Sebastien Motsch , Advait Parulekar , William Porteous , Sanjay Shakkottai

Solving ill-posed inverse problems requires powerful and flexible priors. We propose leveraging pretrained latent diffusion models for this task through a new training-free approach, termed Diffusion-regularized Wasserstein Gradient Flow…

Machine Learning · Statistics 2025-09-24 Tim Y. J. Wang , O. Deniz Akyildiz

From a Bayesian perspective, score-based diffusion solves inverse problems through joint inference, embedding the likelihood with the prior to guide the sampling process. However, this formulation fails to explain its practical behavior:…

Artificial Intelligence · Computer Science 2026-05-13 Hao Chen , Renzheng Zhang , Scott S. Howard

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Reconstructing high-fidelity magnetic resonance (MR) images from under-sampled k-space is a commonly used strategy to reduce scan time. The posterior sampling of diffusion models based on the real measurement data holds significant promise…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Jiayue Chu , Chenhe Du , Xiyue Lin , Yuyao Zhang , Hongjiang Wei

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Diffusion models have emerged as powerful learned priors for Bayesian inverse problems (BIPs). Diffusion-based solvers rely on a presumed likelihood for the observations in BIPs to guide the generation process. Likelihood misspecification…

Machine Learning · Computer Science 2026-05-12 Yiming Yang , Xiaoyuan Cheng , Yi He , Kaiyu Li , Wenxuan Yuan , Zhuo Sun

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

Diffusion models have emerged as powerful generative techniques for solving inverse problems. Despite their success in a variety of inverse problems in imaging, these models require many steps to converge, leading to slow inference time.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Yaşar Utku Alçalar , Mehmet Akçakaya