English
Related papers

Related papers: Preconditioned Langevin Dynamics with Score-Based …

200 papers

We describe a stochastic, dynamical system capable of inference and learning in a probabilistic latent variable model. The most challenging problem in such models - sampling the posterior distribution over latent variables - is proposed to…

Machine Learning · Statistics 2022-07-26 Michael Y. -S. Fang , Mayur Mudigonda , Ryan Zarcone , Amir Khosrowshahi , Bruno A. Olshausen

We propose to solve inverse problems involving the temporal evolution of physics systems by leveraging recent advances from diffusion models. Our method moves the system's current state backward in time step by step by combining an…

Machine Learning · Computer Science 2023-12-06 Benjamin J. Holzschuh , Simona Vegetti , Nils Thuerey

In this article, we provide a modified argument for proving conditional stability for inverse problems of determining spatially varying functions in evolution equations by Carleman estimates. Our method needs not any cut-off procedures and…

Analysis of PDEs · Mathematics 2020-12-30 X. Huang , O. Yu. Imanuvilov , M. Yamamoto

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

Stochastic gradient descent (SGD) is a promising method for solving large-scale inverse problems, due to its excellent scalability with respect to data size. In this work, we analyze a new data-driven regularized stochastic gradient descent…

Numerical Analysis · Mathematics 2024-09-30 Zehui Zhou

Solving ill-posed inverse problems by Bayesian inference has recently attracted considerable attention. Compared to deterministic approaches, the probabilistic representation of the solution by the posterior distribution can be exploited to…

Numerical Analysis · Mathematics 2016-11-03 Felix Lucka

Inference for spatial generalized linear mixed models (SGLMMs) for high-dimensional non-Gaussian spatial data is computationally intensive. The computational challenge is due to the high-dimensional random effects and because Markov chain…

Computation · Statistics 2018-10-09 Yawen Guan , Murali Haran

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

Machine Learning · Statistics 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

Bayesian inference plays a central role in scientific and engineering applications by enabling principled reasoning under uncertainty. However, sampling from generic probability distributions remains a computationally demanding task. This…

Applications · Statistics 2025-09-03 Alex Leviyev , Francesco Iacovelli , Aaron Zimmerman

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

Inverse problems in scientific computing often require optimization over infinite-dimensional Hilbert spaces. A commonly used solver in such settings is stochastic gradient descent (SGD), where gradients are approximated using randomly…

Optimization and Control · Mathematics 2026-04-14 Sandra Cerrai , Qin Li , Anjali Nair , Jaeyoung Yoon

Empirical Bayes provides a powerful approach to learning and adapting to latent structure in data. Theory and algorithms for empirical Bayes have a rich literature for sequence models, but are less understood in settings where latent…

Statistics Theory · Mathematics 2023-12-21 Zhou Fan , Leying Guan , Yandi Shen , Yihong Wu

Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into optimization algorithms. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance through…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Chicago Y. Park , Edward P. Chandler , Yuyang Hu , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological…

Geophysics · Physics 2021-04-28 Jorge Lopez-Alvis , Eric Laloy , Frédéric Nguyen , Thomas Hermans

We propose a scalable inference algorithm for Bayes posteriors defined on a reproducing kernel Hilbert space (RKHS). Given a likelihood function and a Gaussian random element representing the prior, the corresponding Bayes posterior measure…

Machine Learning · Statistics 2025-02-26 Veit Wild , James Wu , Dino Sejdinovic , Jeremias Knoblauch

We develop a computational framework for D-optimal experimental design for PDE-based Bayesian linear inverse problems with infinite-dimensional parameters. We follow a formulation of the experimental design problem that remains valid in the…

Numerical Analysis · Mathematics 2017-11-17 Alen Alexanderian , Arvind K. Saibaba

Diffusion models have had a profound impact on many application areas, including those where data are intrinsically infinite-dimensional, such as images or time series. The standard approach is first to discretize and then to apply…

Machine Learning · Statistics 2025-06-09 Jakiw Pidstrigach , Youssef Marzouk , Sebastian Reich , Sven Wang

Score-based Generative Models (SGMs) is one leading method in generative modeling, renowned for their ability to generate high-quality samples from complex, high-dimensional data distributions. The method enjoys empirical success and is…

Machine Learning · Computer Science 2024-01-30 Sixu Li , Shi Chen , Qin Li

Generative diffusions are a powerful class of Monte Carlo samplers that leverage bridging Markov processes to approximate complex, high-dimensional distributions, such as those found in image processing and language models. Despite their…

Machine Learning · Statistics 2025-02-20 Zheng Zhao , Ziwei Luo , Jens Sjölund , Thomas B. Schön

Score-based generative modeling (SBGM) has achieved state-of-the-art performance in image generation, with the quality of generated images being highly dependent on the design of the forward (diffusion) process. Among these, models based on…

Computational Engineering, Finance, and Science · Computer Science 2026-05-12 Sascha Holl , Jente Vandersanden , Gurprit Singh , Hans-Peter Seidel