English
Related papers

Related papers: Nested importance sampling for Bayesian inference:…

200 papers

Due to the importance of uncertainty quantification (UQ), Bayesian approach to inverse problems has recently gained popularity in applied mathematics, physics, and engineering. However, traditional Bayesian inference methods based on Markov…

Computation · Statistics 2022-04-26 Shiwei Lan , Shuyi Li , Babak Shahbaba

This paper presents a new Bayesian framework for quantifying discretization errors in numerical solutions of ordinary differential equations. By modelling the errors as random variables, we impose a monotonicity constraint on the variances,…

Numerical Analysis · Mathematics 2024-11-14 Yuto Miyatake , Kaoru Irie , Takeru Matsuda

The Integrated Nested Laplace Approximation (INLA) is a deterministic approach to Bayesian inference on latent Gaussian models (LGMs) and focuses on fast and accurate approximation of posterior marginals for the parameters in the models.…

Computation · Statistics 2021-03-05 Martin Outzen Berild , Sara Martino , Virgilio Gómez-Rubio , Håvard Rue

Nested sampling (NS) is a stochastic method for computing the log-evidence of a Bayesian problem. It relies on stochastic estimates of prior volumes enclosed by likelihood contours, which limits the accuracy of the log-evidence calculation.…

Computational Physics · Physics 2024-11-27 Margret Westerkamp , Jakob Roth , Philipp Frank , Will Handley , Torsten Enßlin

In the paper, we develop an ensemble-based implicit sampling method for Bayesian inverse problems. For Bayesian inference, the iterative ensemble smoother (IES) and implicit sampling are integrated to obtain importance ensemble samples,…

Numerical Analysis · Mathematics 2018-12-04 Yuming Ba , Lijian Jiang

Bayesian networks are one of the most widely used classes of probabilistic models for risk management and decision support because of their interpretability and flexibility in including heterogeneous pieces of information. In any applied…

Methodology · Statistics 2024-07-08 Manuele Leonelli , Jim Q. Smith , Sophia K. Wright

An informative sampling design leads to unit inclusion probabilities that are correlated with the response variable of interest. However, multistage sampling designs may also induce higher order dependencies, which are typically ignored in…

Methodology · Statistics 2019-01-23 Matthew R. Williams , Terrance D. Savitsky

Bayesian inference with nested sampling requires a likelihood-restricted prior sampling method, which draws samples from the prior distribution that exceed a likelihood threshold. For high-dimensional problems, Markov Chain Monte Carlo…

Computation · Statistics 2023-02-13 Johannes Buchner

We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on $\mathbb{R}^d$ for large $d$. It is well known that using a single importance sampling step one produces…

Computation · Statistics 2012-04-19 Alexandros Beskos , Dan Crisan , Ajay Jasra

Towards understanding the fundamental limits of estimation from data of varied quality, we study the problem of estimating a mean parameter from heteroskedastic Gaussian observations where the variances are unknown and may vary arbitrarily…

Statistics Theory · Mathematics 2026-03-17 Yanjun Han , Abhishek Shetty , Jacob Shkrob

We seek to conduct statistical inference for a large collection of primary parameters, each with its own nuisance parameters. Our approach is partially Bayesian, in that we treat the primary parameters as fixed while we model the nuisance…

Methodology · Statistics 2025-12-10 Nikolaos Ignatiadis , Li Ma

A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space. Our work shows that successful SBI is possible by embracing the characteristic relationship between…

Machine Learning · Computer Science 2024-05-29 Emanuel Sommer , Lisa Wimmer , Theodore Papamarkou , Ludwig Bothmann , Bernd Bischl , David Rügamer

The inferential models (IM) framework provides prior-free, frequency-calibrated, posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown…

Statistics Theory · Mathematics 2016-01-26 Ryan Martin , Chuanhai Liu

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

Neural density estimators have proven remarkably powerful in performing efficient simulation-based Bayesian inference in various research domains. In particular, the BayesFlow framework uses a two-step approach to enable amortized parameter…

Methodology · Statistics 2022-11-10 Marvin Schmitt , Paul-Christian Bürkner , Ullrich Köthe , Stefan T. Radev

In this paper, I proof that Importance Sampling estimates based on dependent sample sets are consistent under certain conditions. This can be used to reduce variance in Bayesian Models with factorizing likelihoods, using sample sets that…

Methodology · Statistics 2015-03-03 Ingmar Schuster

Importance sampling (IS) is a Monte Carlo methodology that allows for approximation of a target distribution using weighted samples generated from another proposal distribution. Adaptive importance sampling (AIS) implements an iterative…

Computation · Statistics 2018-06-04 Yousef El-Laham , Victor Elvira , Monica F. Bugallo

Gradient-based dimension reduction decreases the cost of Bayesian inference and probabilistic modeling by identifying maximally informative (and informed) low-dimensional projections of the data and parameters, allowing high-dimensional…

Computation · Statistics 2025-06-02 Ricardo Baptista , Michael Brennan , Youssef Marzouk

The naive importance sampling estimator, based on samples from a single importance density, can be numerically unstable. Instead, we consider generalized importance sampling estimators where samples from more than one probability…

Statistics Theory · Mathematics 2016-08-12 Vivekananda Roy , Aixin Tan , James M. Flegal

Modern imaging techniques heavily rely on Bayesian statistical models to address difficult image reconstruction and restoration tasks. This paper addresses the objective evaluation of such models in settings where ground truth is…

Image and Video Processing · Electrical Eng. & Systems 2026-05-29 Tom Sprunck , Marcelo Pereyra , Tobias Liaudat