English
Related papers

Related papers: Bayesian model averaging: A systematic review and …

200 papers

Applying a machine learning model for decision-making in the real world requires to distinguish what the model knows from what it does not. A critical factor in assessing the knowledge of a model is to quantify its predictive uncertainty.…

Machine Learning · Computer Science 2023-11-15 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

This chapter provides a overview of Bayesian inference, mostly emphasising that it is a universal method for summarising uncertainty and making estimates and predictions using probability statements conditional on observed data and an…

Methodology · Statistics 2010-02-11 Christian P. Robert , Jean-Michel Marin , Judith Rousseau

Bayesian model averaging has become a widely used approach to accounting for uncertainty about the structural form of the model generating the data. When data arrive sequentially and the generating model can change over time, Dynamic Model…

Computation · Statistics 2014-10-30 Luca Onorante , Adrian E. Raftery

The widely recommended procedure of Bayesian model averaging is flawed in the M-open setting in which the true data-generating process is not one of the candidate models being fit. We take the idea of stacking from the point estimation…

Methodology · Statistics 2018-10-15 Yuling Yao , Aki Vehtari , Daniel Simpson , Andrew Gelman

Bayesian model averaging (BMA) is a statistical method for post-processing forecast ensembles of atmospheric variables, obtained from multiple runs of numerical weather prediction models, in order to create calibrated predictive probability…

Methodology · Statistics 2014-04-09 Sándor Baran

Bayesian neural networks (BNNs) estimate the posterior distribution of model parameters and utilize posterior samples for Bayesian Model Averaging (BMA) in prediction. However, despite the crucial role of flatness in the loss landscape in…

Machine Learning · Statistics 2025-06-18 Sungjun Lim , Jeyoon Yeom , Sooyon Kim , Hoyoon Byun , Jinho Kang , Yohan Jung , Jiyoung Jung , Kyungwoo Song

Background: We proposed approximate Bayesian computation with single distribution selection (ABC-SD) for estimating mean and standard deviation from other reported summary statistics. The ABC-SD generates pseudo data from a single…

Methodology · Statistics 2016-07-12 Deukwoo Kwon , Isildinha M. Reis

Predicting the evolution of mortality rates plays a central role for life insurance and pension funds.Various stochastic frameworks have been developed to model mortality patterns taking into account the main stylized facts driving these…

Applications · Statistics 2021-11-17 Karim Barigou , Pierre-Olivier Goffard , Stéphane Loisel , Yahia Salhi

Consider the setting where there are B>1 candidate statistical models, and one is interested in model selection. Two common approaches to solve this problem are to select a single model or to combine the candidate models through model…

Methodology · Statistics 2021-04-22 Qingying Zong , Jonathan R. Bradley

With this technical report, we provide mathematical and implementational details of cross-validated Bayesian model selection (cvBMS) and averaging (cvBMA) that could not be communicated in the corresponding peer-reviewed journal articles.…

Methodology · Statistics 2018-07-05 Joram Soch

Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become…

Methodology · Statistics 2023-06-01 Viet Hung Dao , David Gunawan , Robert Kohn , Minh-Ngoc Tran , Guy E. Hawkins , Scott D. Brown

In modern computer experiment applications, one often encounters the situation where various models of a physical system are considered, each implemented as a simulator on a computer. An important question in such a setting is determining…

Methodology · Statistics 2023-05-08 John C. Yannotty , Thomas J. Santner , Richard J. Furnstahl , Matthew T. Pratola

We establish concentration rates for estimation of treatment effects in experiments that incorporate prior sources of information -- such as past pilots, related studies, or expert assessments -- whose external validity is uncertain. Each…

Econometrics · Economics 2026-03-24 Frederico Finan , Demian Pouzo

We revisit the classical problem of Bayesian ensembles and address the challenge of learning optimal combinations of Bayesian models in an online, continual learning setting. To this end, we reinterpret existing approaches such as Bayesian…

Machine Learning · Computer Science 2026-01-26 Daniel Waxman , Fernando Llorente , Petar M. Djurić

Ideally, a meta-analysis will summarize data from several unbiased studies. Here we consider the less than ideal situation in which contributing studies may be compromised by measurement error. Measurement error affects every study design,…

Statistical modeling is a key component in the extraction of physical results from lattice field theory calculations. Although the general models used are often strongly motivated by physics, many model variations can frequently be…

Methodology · Statistics 2021-06-10 William I. Jay , Ethan T. Neil

Model uncertainty is a central challenge in statistical models for binary outcomes such as logistic regression, arising when it is unclear which predictors should be included in the model. Many methods have been proposed to address this…

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

In this paper we briefly review the main methodological aspects concerned with the application of the Bayesian approach to model choice and model averaging in the context of variable selection in regression models. This includes prior…

Computation · Statistics 2016-12-08 Anabel Forte , Gonzalo Garcia-Donato , Mark Steel

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth