English
Related papers

Related papers: Computational methods for fast Bayesian model asse…

200 papers

Approximate Bayesian Computation (ABC) methods are increasingly used for inference in situations in which the likelihood function is either computationally costly or intractable to evaluate. Extensions of the basic ABC rejection algorithm…

Computation · Statistics 2020-05-01 Umberto Simola , Jessica Cisewski-Kehe , Michael U. Gutmann , Jukka Corander

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

In the following article we consider approximate Bayesian parameter inference for observation driven time series models. Such statistical models appear in a wide variety of applications, including econometrics and applied mathematics. This…

Computation · Statistics 2013-04-01 Ajay Jasra , Nikolas Kantas , Elena Ehrlich

Bayesian feature allocation models are a popular tool for modelling data with a combinatorial latent structure. Exact inference in these models is generally intractable and so practitioners typically apply Markov Chain Monte Carlo (MCMC)…

Computation · Statistics 2020-01-28 Alexandre Bouchard-Côté , Andrew Roth

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

Computation · Statistics 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

This paper introduces a framework for speeding up Bayesian inference conducted in presence of large datasets. We design a Markov chain whose transition kernel uses an (unknown) fraction of (fixed size) of the available data that is randomly…

Methodology · Statistics 2018-06-01 Florian Maire , Nial Friel , Pierre Alquier

We consider posterior sampling in the very common Bayesian hierarchical model in which observed data depends on high-dimensional latent variables that, in turn, depend on relatively few hyperparameters. When the full conditional over the…

Computation · Statistics 2016-10-24 Richard A. Norton , J. Andres Christen , Colin Fox

Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain Monte-Carlo (MCMC) sampling methods are used to…

Machine Learning · Statistics 2024-08-27 Rohitash Chandra , Joshua Simmons

Employing Bayesian inference to calibrate constitutive model parameters has grown substantially in recent years. Among the available techniques, Markov Chain Monte Carlo (MCMC) sampling remains one of the most widely used approaches for…

Computational Engineering, Finance, and Science · Computer Science 2026-04-02 Aricia Rinkens , Rodrigo L. S. Silva , Erik Quaeghebeur , Nick Jaensson , Clemens Verhoosel

In Bayesian inference, predictive distributions are typically in the form of samples generated via Markov chain Monte Carlo (MCMC) or related algorithms. In this paper, we conduct a systematic analysis of how to make and evaluate…

Methodology · Statistics 2020-06-25 Fabian Krüger , Sebastian Lerch , Thordis L. Thorarinsdottir , Tilmann Gneiting

If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this…

Methodology · Statistics 2024-11-12 Tin D. Nguyen , Ryan Giordano , Rachael Meager , Tamara Broderick

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

Machine Learning · Computer Science 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman

Approximate Bayesian computation (ABC) methods can be used to sample from posterior distributions when the likelihood function is unavailable or intractable, as is often the case in biological systems. ABC methods suffer from inefficient…

Machine Learning · Statistics 2019-12-03 Charlie Rogers-Smith , Henri Pesonen , Samuel Kaski

This paper surveys some well-established approaches on the approximation of Bayes factors used in Bayesian model choice, mostly as covered in Chen et al. (2000). Our focus here is on methods that are based on importance sampling strategies…

Computation · Statistics 2009-10-14 Jean-Michel Marin , Christian P. Robert

We present Causal Posterior Estimation (CPE), a novel method for Bayesian inference in simulator models, i.e., models where the evaluation of the likelihood function is intractable or too computationally expensive, but where one can…

Machine Learning · Computer Science 2025-05-28 Simon Dirmeier , Antonietta Mira

For large model spaces, the potential entrapment of Markov chain Monte Carlo (MCMC) based methods with spike-and-slab priors poses significant challenges in posterior computation in regression models. On the other hand, maximum a posteriori…

Methodology · Statistics 2026-02-25 Shamriddha De , Joyee Ghosh

Bayesian variable selection is a powerful tool for data analysis, as it offers a principled method for variable selection that accounts for prior information and uncertainty. However, wider adoption of Bayesian variable selection has been…

Methodology · Statistics 2022-09-13 Martin Jankowiak

With larger data at their disposal, scientists are emboldened to tackle complex questions that require sophisticated statistical models. It is not unusual for the latter to have likelihood functions that elude analytical formulations. Even…

Computation · Statistics 2019-05-17 Evgeny Levi , Radu V. Craiu

Conformal Predictors (CP) are wrappers around ML models, providing error guarantees under weak assumptions on the data distribution. They are suitable for a wide range of problems, from classification and regression to anomaly detection.…

Machine Learning · Computer Science 2021-10-06 Giovanni Cherubin , Konstantinos Chatzikokolakis , Martin Jaggi