English
Related papers

Related papers: Loss-calibrated expectation propagation for approx…

200 papers

Approximate inference techniques are the cornerstone of probabilistic methods based on Gaussian process priors. Despite this, most work approximately optimizes standard divergence measures such as the Kullback-Leibler (KL) divergence, which…

Machine Learning · Computer Science 2020-11-06 Rui Zhang , Christian J. Walder , Edwin V. Bonilla , Marian-Andrei Rizoiu , Lexing Xie

In modular Bayesian analyses, complex models are composed of distinct modules, each representing different aspects of the data or prior information. In this context, fully Bayesian approaches can sometimes lead to undesirable feedback…

Methodology · Statistics 2024-10-28 Grant Hutchings , Kellin Rumsey , Derek Bingham , Gabriel Huerta

A new recalibration post-processing method is presented to improve the quality of the posterior approximation when using Approximate Bayesian Computation (ABC) algorithms. Recalibration may be used in conjunction with existing…

Computation · Statistics 2017-04-24 G. S. Rodrigues , D. Prangle , S. A. Sisson

The construction of decision-theoretic Bayesian designs for realistically-complex nonlinear models is computationally challenging, as it requires the optimization of analytically intractable expected utility functions over high-dimensional…

Methodology · Statistics 2016-07-01 Antony Overstall , David Woods

Expectation propagation (EP) is a family of algorithms for performing approximate inference in probabilistic models. The updates of EP involve the evaluation of moments -- expectations of certain functions -- which can be estimated from…

Machine Learning · Statistics 2024-10-30 Jonathan So , Richard E. Turner

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Estimated uncertainty by approximate posteriors in Bayesian neural networks are prone to miscalibration, which leads to overconfident predictions in critical tasks that have a clear asymmetric cost or significant losses. Here, we extend the…

Machine Learning · Computer Science 2022-06-17 Biraja Ghoshal , Allan Tucker

In this paper we revisit the weighted likelihood bootstrap, a method that generates samples from an approximate Bayesian posterior of a parametric model. We show that the same method can be derived, without approximation, under a Bayesian…

Methodology · Statistics 2018-05-23 Simon Lyddon , Chris Holmes , Stephen Walker

We present an error-diagnostic validation method for posterior distributions in Bayesian signal inference, an advancement of a previous work. It transfers deviations from the correct posterior into characteristic deviations from a uniform…

Instrumentation and Methods for Astrophysics · Physics 2013-11-05 Sebastian Dorn , Niels Oppermann , Torsten A. Enßlin

Approximate Bayesian Computation (ABC) is a statistical learning technique to calibrate and select models by comparing observed data to simulated data. This technique bypasses the use of the likelihood and requires only the ability to…

Computation · Statistics 2021-05-04 Pierre-Olivier Goffard , Patrick J. Laub

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

Bayesian analysis is increasingly popular for use in social science and other application areas where the data are observations from an informative sample. An informative sampling design leads to inclusion probabilities that are correlated…

Statistics Theory · Mathematics 2016-06-07 Terrance D. Savitsky , Daniell Toth

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

This paper presents a new Expectation Propagation (EP) framework for image restoration using patch-based prior distributions. While Monte Carlo techniques are classically used to sample from intractable posterior distributions, they can…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Dan Yao , Stephen McLaughlin , Yoann Altmann

We propose a novel approach to approximate Bayesian computation (ABC) that seeks to cater for possible misspecification of the assumed model. This new approach can be equally applied to rejection-based ABC and to popular regression…

Methodology · Statistics 2020-08-11 David T. Frazier , Christopher Drovandi , Ruben Loaiza-Maya

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková