English
Related papers

Related papers: Bootstrap Model Averaging

200 papers

Averaging predictions from multiple competing inferential models frequently outperforms predictions from any single model, providing that models are optimally weighted to maximize predictive performance. This is particularly the case in…

Methodology · Statistics 2024-05-02 Nathaniel Haines , Conor Goold

Researchers frequently test and improve model fit by holding a sample constant and varying the model. We propose methods to test and improve sample fit by holding a model constant and varying the sample. Much as the bootstrap is a…

Econometrics · Economics 2022-09-15 Gabriel Okasa , Kenneth A. Younge

The goal of this paper is to compare several widely used Bayesian model selection methods in practical model selection problems, highlight their differences and give recommendations about the preferred approaches. We focus on the variable…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

GARCH models are useful tools in the investigation of phenomena, where volatility changes are prominent features, like most financial data. The parameter estimation via quasi maximum likelihood (QMLE) and its properties are by now well…

Statistics Theory · Mathematics 2012-09-07 László Varga , András Zempléni

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase…

Statistics Theory · Mathematics 2018-10-12 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

The latent class model is a powerful unsupervised clustering algorithm for categorical data. Many statistics exist to test the fit of the latent class model. However, traditional methods to evaluate those fit statistics are not always…

Methodology · Statistics 2018-01-30 Geert H. van Kollenburg , Joris Mulder , Jeroen K. Vermunt

The maximum-likelihood estimator of nonlinear panel data models with fixed effects is consistent but asymptotically-biased under rectangular-array asymptotics. The literature has thus far concentrated its effort on devising methods to…

Econometrics · Economics 2022-01-28 Ayden Higgins , Koen Jochmans

Insurance products frequently cover significant claims arising from a variety of sources. To model losses from these products accurately, actuarial models must account for high-severity claims. A widely used strategy is to apply a mixture…

Methodology · Statistics 2025-04-30 Sébastien Jessup , Mélina Mailhot , Mathieu Pigeon

Accurate approximation of the sampling distribution of nonparametric kernel density estimators is crucial for many statistical inference problems. Since these estimators have complex asymptotic distributions, bootstrap methods are often…

Statistics Theory · Mathematics 2019-09-09 Todd A. Kuffner , Stephen M. -S. Lee , G. Alastair Young

This paper develops bootstrap methods for practical statistical inference in panel data quantile regression models with fixed effects. We consider random-weighted bootstrap resampling and formally establish its validity for asymptotic…

Econometrics · Economics 2021-11-08 Antonio F. Galvao , Thomas Parker , Zhijie Xiao

Reliable uncertainty quantification remains a central challenge in predictive modeling. While Bayesian methods are theoretically appealing, their predictive intervals can exhibit poor frequentist calibration, particularly with small sample…

Methodology · Statistics 2025-08-05 Graham Gibson

We consider the problem of constructing an adaptive bridge regression modeling, which is a penalized procedure by imposing different weights to different coefficients in the bridge penalty term. A crucial issue in the modeling process is…

Methodology · Statistics 2013-02-15 Shuichi Kawano

Existing weighting methods for treatment effect estimation are often built upon the idea of propensity scores or covariate balance. They usually impose strong assumptions on treatment assignment or outcome model to obtain unbiased…

Machine Learning · Computer Science 2023-05-09 Dongcheng Zhang , Kunpeng Zhang

Non-probability sampling, for example in the form of online panels, has become a fast and cheap method to collect data. While reliable inference tools are available for classical probability samples, non-probability samples can yield…

Methodology · Statistics 2022-04-05 Gerhard Tutz

Ensemble models often improve generalization performances in challenging tasks. Yet, traditional techniques based on prediction averaging incur three well-known disadvantages: the computational overhead of training multiple models,…

Machine Learning · Computer Science 2024-06-28 Caglar Demir , Arnab Sharma , Axel-Cyrille Ngonga Ngomo

Weighting methods in causal inference have been widely used to achieve a desirable level of covariate balancing. However, the existing weighting methods have desirable theoretical properties only when a certain model, either the propensity…

Machine Learning · Statistics 2023-05-24 Insung Kong , Yuha Park , Joonhyuk Jung , Kwonsang Lee , Yongdai Kim

Averaging checkpoints along the training trajectory is a simple yet powerful approach to improve the generalization performance of Machine Learning models and reduce training time. Motivated by these potential gains, and in an effort to…

Machine Learning · Computer Science 2025-11-25 Niccolò Ajroldi , Antonio Orvieto , Jonas Geiping

Driven by several successful applications such as in stochastic gradient descent or in Bayesian computation, control variates have become a major tool for Monte Carlo integration. However, standard methods do not allow the distribution of…

Machine Learning · Statistics 2022-10-06 Rémi Leluc , François Portier , Johan Segers , Aigerim Zhuman

Accurate uncertainty estimates can significantly improve the performance of iterative design of experiments, as in Sequential and Reinforcement learning. For many such problems in engineering and the physical sciences, the design task…

Machine Learning · Statistics 2022-05-20 Brendan Folie , Maxwell Hutchinson

Panel data of our interest consist of a moderate or relatively large number of panels, while the panels contain a small number of observations. This paper establishes testing procedures to detect a possible common change in means of the…

Statistics Theory · Mathematics 2016-08-07 Barbora Peštová , Michal Pešta