English
Related papers

Related papers: Propagating Surrogate Uncertainty in Bayesian Inve…

200 papers

While Bayesian inference is the gold standard for uncertainty quantification and propagation, its use within physical chemistry encounters formidable computational barriers. These bottlenecks are magnified for modeling data with many…

Chemical Physics · Physics 2024-12-24 B. L. Shanks , H. W. Sullivan , A. R. Shazed , M. P. Hoepfner

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Popular deterministic approximations of posterior distributions from, e.g. the Laplace method, variational Bayes and expectation-propagation, generally rely on symmetric approximating families, often taken to be Gaussian. This choice…

Methodology · Statistics 2026-01-19 Francesco Pozza , Daniele Durante , Botond Szabo

Solving inverse problems in cardiovascular modeling is particularly challenging due to the high computational cost of running high-fidelity simulations. In this work, we focus on Bayesian parameter estimation and explore different methods…

Machine Learning · Statistics 2025-12-22 Chloe H. Choi , Andrea Zanoni , Daniele E. Schiavazzi , Alison L. Marsden

In a Bayesian setting, inverse problems and uncertainty quantification (UQ) - the propagation of uncertainty through a computational (forward) model - are strongly connected. In the form of conditional expectation the Bayesian update…

Numerical Analysis · Mathematics 2014-04-09 Alexander Litvinenko , Hermann G. Matthies

We propose a novel approach for nonlinear regression using a two-layer neural network (NN) model structure with sparsity-favoring hierarchical priors on the network weights. We present an expectation propagation (EP) approach for…

Machine Learning · Statistics 2015-01-23 Pasi Jylänki , Aapo Nummenmaa , Aki Vehtari

We present a fast surrogate for the Equivalent Photon Approximation (EPA) flux in ultraperipheral collisions (UPCs), based on a Bayesian neural network (BNN) trained over analytical flux integrals with an iterative procedure focused on…

High Energy Physics - Phenomenology · Physics 2026-02-12 Simone Ragoni , Janet Seger

A novel method to propagate uncertainty through the soft-thresholding nonlinearity is proposed in this paper. At every layer the current distribution of the target vector is represented as a spike and slab distribution, which represents the…

Machine Learning · Statistics 2018-12-03 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Spatio-temporal hidden Markov models are extremely difficult to estimate because their latent joint distributions are available only in trivial cases. In the estimation phase, these latent distributions are usually substituted with…

Methodology · Statistics 2025-09-19 Daniele Tancini , Riccardo Rastelli , Francesco Bartolucci

We propose a novel algorithm to solve the expectation propagation relaxation of Bayesian inference for continuous-variable graphical models. In contrast to most previous algorithms, our method is provably convergent. By marrying convergent…

Machine Learning · Statistics 2010-12-17 Matthias W. Seeger , Hannes Nickisch

While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly understood. We study the quality of common variational…

Machine Learning · Statistics 2020-10-26 Andrew Y. K. Foong , David R. Burt , Yingzhen Li , Richard E. Turner

This work proposes an adaptive sequential Monte Carlo sampling algorithm to solve Bayesian inverse problems in scenarios where likelihood evaluations are costly but can be approximated using a surrogate model built from previous evaluations…

Computation · Statistics 2025-08-26 Frederic Cerou , Patrick Heas , Mathias Rousset

Uncertainty estimation is essential for robust decision-making in the presence of ambiguous or out-of-distribution inputs. Gaussian Processes (GPs) are classical kernel-based models that offer principled uncertainty quantification and…

Machine Learning · Statistics 2026-04-30 Albert Saiapin , Kim Batselier

In recent years, surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Bayesian Optimization…

Machine Learning · Computer Science 2021-10-06 Alexander Aushev , Henri Pesonen , Markus Heinonen , Jukka Corander , Samuel Kaski

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

We propose an efficient surrogate modeling technique for uncertainty quantification. The method is based on a well-known dimension-adaptive collocation scheme. We improve the scheme by enhancing sparse polynomial surrogates with conformal…

Computational Engineering, Finance, and Science · Computer Science 2020-05-20 Niklas Georg , Dimitrios Loukrezis , Ulrich Römer , Sebastian Schöps

Machine learning models play a vital role in time series forecasting. These models, however, often overlook an important element: point uncertainty estimates. Incorporating these estimates is crucial for effective risk management, informed…

Machine Learning · Computer Science 2024-09-11 Leonid Erlygin , Vladimir Zholobov , Valeriia Baklanova , Evgeny Sokolovskiy , Alexey Zaytsev

In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Dominik Narnhofer , Andreas Habring , Martin Holler , Thomas Pock

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt