English
Related papers

Related papers: Model combinations through revised base-rates

200 papers

Boosting algorithms to simultaneously estimate and select predictor effects in statistical models have gained substantial interest during the last decade. This review article aims to highlight recent methodological developments regarding…

Methodology · Statistics 2014-11-19 Andreas Mayr , Harald Binder , Olaf Gefeller , Matthias Schmid

Conventional likelihood-based information criteria for model selection rely on the distribution assumption of data. However, for complex data that are increasingly available in many scientific fields, the specification of their underlying…

Methodology · Statistics 2020-06-25 Chixiang Chen , Ming Wang , Rongling Wu , Runze Li

Combining predictions from different models is a central problem in Bayesian inference and machine learning more broadly. Currently, these predictive distributions are almost exclusively combined using linear mixtures such as Bayesian model…

Machine Learning · Statistics 2023-05-15 Yuling Yao , Luiz Max Carvalho , Diego Mesquita , Yann McLatchie

The issue of model selection in applied research is of vital importance. Since the true model in such research is not known, which model should be used from among various potential ones is an empirical question. There might exist several…

Econometrics · Economics 2018-05-24 R. Scott Hacker , Abdulnasser Hatemi-J

Variable selection, or more generally, model reduction is an important aspect of the statistical workflow aiming to provide insights from data. In this paper, we discuss and demonstrate the benefits of using a reference model in variable…

Methodology · Statistics 2020-04-29 Federico Pavone , Juho Piironen , Paul-Christian Bürkner , Aki Vehtari

Hierarchical forecasting methods have been widely used to support aligned decision-making by providing coherent forecasts at different aggregation levels. Traditional hierarchical forecasting approaches, such as the bottom-up and top-down…

Machine Learning · Computer Science 2020-06-04 Evangelos Spiliotis , Mahdi Abolghasemi , Rob J Hyndman , Fotios Petropoulos , Vassilios Assimakopoulos

In this paper we briefly review the main methodological aspects concerned with the application of the Bayesian approach to model choice and model averaging in the context of variable selection in regression models. This includes prior…

Computation · Statistics 2016-12-08 Anabel Forte , Gonzalo Garcia-Donato , Mark Steel

We consider the bridge linear regression modeling, which can produce a sparse or non-sparse model. A crucial point in the model building process is the selection of adjusted parameters including a regularization parameter and a tuning…

Methodology · Statistics 2015-02-19 Shuichi Kawano

In this paper, a novel method to perform model-based clustering of time series is proposed. The procedure relies on two iterative steps: (i) K global forecasting models are fitted via pooling by considering the series pertaining to each…

Machine Learning · Statistics 2023-05-02 Ángel López Oriona , Pablo Montero Manso , José Antonio Vilar Fernández

This paper reviews background and examples of Bayesian predictive synthesis (BPS), and develops details in a subset of BPS mixture models. BPS expands on standard Bayesian model uncertainty analysis for model mixing to provide a broader…

Methodology · Statistics 2023-05-04 Matthew C. Johnson , Mike West

We want to select the best systems out of a given set of systems (or rank them) with respect to their expected performance. The systems allow random observations only and we assume that the joint observation of the systems has a…

Methodology · Statistics 2017-01-23 Björn Görder , Michael Kolonko

In real data analysis, the underlying model is usually unknown, modelling strategy plays a key role in the success of data analysis. Stimulated by the idea of model averaging, we propose a novel semiparametric modelling strategy for…

Methodology · Statistics 2022-03-21 Chaohui Guo , Wenyang Zhang

This paper presents a time series forecasting framework which combines standard forecasting methods and a machine learning model. The inputs to the machine learning model are not lagged values or regular time series features, but instead…

Machine Learning · Statistics 2020-01-15 Shi Zhao , Ying Feng

This paper proposes a new way of evaluating the accuracy and validity of probabilistic forecasts that change over time (such as an in-game win probability model, or an election forecast). Under this approach, each model to be evaluated is…

Methodology · Statistics 2026-02-11 Michael Beuoy

Predictor combination aims to improve a (target) predictor of a learning task based on the (reference) predictors of potentially relevant tasks, without having access to the internals of individual predictors. We present a new predictor…

Machine Learning · Computer Science 2020-07-17 Kwang In Kim , Christian Richardt , Hyung Jin Chang

Model averaging is a useful and robust method for dealing with model uncertainty in statistical analysis. Often, it is useful to consider data subset selection at the same time, in which model selection criteria are used to compare models…

Methodology · Statistics 2023-10-26 Ethan T. Neil , Jacob W. Sitison

In mixture model-based clustering applications, it is common to fit several models from a family and report clustering results from only the `best' one. In such circumstances, selection of this best model is achieved using a model selection…

Methodology · Statistics 2017-10-09 Yuhong Wei , Paul D. McNicholas

To improve the predictability of complex computational models in the experimentally-unknown domains, we propose a Bayesian statistical machine learning framework utilizing the Dirichlet distribution that combines results of several…

Methodology · Statistics 2023-11-06 Vojtech Kejzlar , Léo Neufcourt , Witold Nazarewicz

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

For a Bayesian, real-time forecasting with the posterior predictive distribution can be challenging for a variety of time series models. First, estimating the parameters of a time series model can be difficult with sample-based approaches…

Applications · Statistics 2022-08-08 Taylor R. Brown