English
Related papers

Related papers: Posterior Refinement Improves Sample Efficiency in…

200 papers

Bayesian inference is useful to obtain a predictive distribution with a small generalization error. However, since posterior distributions are rarely evaluated analytically, we employ the variational Bayesian inference or sampling method to…

Machine Learning · Computer Science 2025-09-03 Yohei Saito , Shun Kimura , Koujin Takeda

When performing Bayesian data analysis using a general linear mixed model, the resulting posterior density is almost always analytically intractable. However, if proper conditionally conjugate priors are used, there is a simple two-block…

Statistics Theory · Mathematics 2017-11-21 Tavis Abrahamsen , James P. Hobert

Markov chain Monte Carlo (MCMC) methods remain the mainstay of Bayesian estimation of structural equation models (SEM), though they often incur a high computational cost. We present a bespoke approximate Bayesian approach to SEM, drawing on…

Methodology · Statistics 2026-05-20 Haziq Jamil , Håvard Rue

Most of Markov Chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) algorithms in existing probabilistic programming systems suboptimally use only model priors as proposal distributions. In this work, we describe an approach for…

Artificial Intelligence · Computer Science 2016-05-17 Yura N Perov , Tuan Anh Le , Frank Wood

Although theoretically compelling, Bayesian learning with modern machine learning models is computationally challenging since it requires approximating a high dimensional posterior distribution. In this work, we (i) introduce posteriors, an…

Machine Learning · Computer Science 2025-04-15 Samuel Duffield , Kaelan Donatella , Johnathan Chiu , Phoebe Klett , Daniel Simpson

Bayesian inference for Markov processes has become increasingly relevant in recent years. Problems of this type often have intractable likelihoods and prior knowledge about model rate parameters is often poor. Markov Chain Monte Carlo…

Computation · Statistics 2014-10-23 Jamie Owen , Darren J. Wilkinson , Colin S. Gillespie

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

Deep learning (DL)-based methods have achieved state-of-the-art performance for many medical image segmentation tasks. Nevertheless, recent studies show that deep neural networks (DNNs) can be miscalibrated and overconfident, leading to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yidong Zhao , Joao Tourais , Iain Pierce , Christian Nitsche , Thomas A. Treibel , Sebastian Weingärtner , Artur M. Schweidtmann , Qian Tao

If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this…

Methodology · Statistics 2024-11-12 Tin D. Nguyen , Ryan Giordano , Rachael Meager , Tamara Broderick

Approximate Bayesian Computation (ABC) is a popular inference method when likelihoods are hard to come by. Practical bottlenecks of ABC applications include selecting statistics that summarize the data without losing too much information or…

Computation · Statistics 2026-05-15 Khanh N. Dinh , Cécile Liu , Zijin Xiang , Zhihan Liu , Simon Tavaré

In Bayesian statistics, the choice of the prior can have an important influence on the posterior and the parameter estimation, especially when few data samples are available. To limit the added subjectivity from a priori information, one…

Methodology · Statistics 2025-12-05 Nils Baillie , Antoine Van Biesbroeck , Clément Gauchy

A Bayesian coreset is a small, weighted subset of data that replaces the full dataset during inference in order to reduce computational cost. However, state of the art methods for tuning coreset weights are expensive, require nontrivial…

Computation · Statistics 2024-03-12 Naitong Chen , Trevor Campbell

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

Stochastic approximation Monte Carlo (SAMC) has recently been proposed by Liang, Liu and Carroll [J. Amer. Statist. Assoc. 102 (2007) 305--320] as a general simulation and optimization algorithm. In this paper, we propose to improve its…

Statistics Theory · Mathematics 2009-08-26 Faming Liang

Most applications of Bayesian Inference for parameter estimation and model selection in astrophysics involve the use of Monte Carlo techniques such as Markov Chain Monte Carlo (MCMC) and nested sampling. However, these techniques are time…

Instrumentation and Methods for Astrophysics · Physics 2022-01-26 Geetakrishnasai Gunapati , Anirudh Jain , P. K. Srijith , Shantanu Desai

Inferential models (IMs) offer prior-free, Bayesian-like posterior degrees of belief designed for statistical inference, which feature a frequentist-like calibration property that ensures reliability of said inferences. The catch is that…

Computation · Statistics 2025-07-09 Ryan Martin

Exponential random graph models are extremely difficult models to handle from a statistical viewpoint, since their normalising constant, which depends on model parameters, is available only in very trivial cases. We show how inference can…

Applications · Statistics 2010-09-30 Alberto Caimo , Nial Friel

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

In this paper, we address the challenge of Markov Chain Monte Carlo (MCMC) algorithms within the approximate Bayesian Computation (ABC) framework, which often get trapped in local optima due to their inherent local exploration mechanism. We…

Computation · Statistics 2025-12-16 Xuefei Cao , Shijia Wang , Yongdao Zhou