English
Related papers

Related papers: Bootstrap for neural model selection

200 papers

We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where $p<n$ but $p/n$ is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist…

Methodology · Statistics 2016-08-03 Noureddine El Karoui , Elizabeth Purdom

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

There are some papers which describe the use of bootstrap techniques in point process statistics. The aim of the present paper is to show that the form in which bootstrap is used there is dubious. In case of variance estimation of pair…

Statistics Theory · Mathematics 2008-11-26 Martin Snethlage

We present some new density estimation algorithms obtained by bootstrap aggregation like Bagging. Our algorithms are analyzed and empirically compared to other methods found in the statistical literature, like stacking and boosting for…

Methodology · Statistics 2012-07-23 Mathias Bourel , Badih Ghattas

We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that…

Neural and Evolutionary Computing · Computer Science 2016-06-09 Adam Trischler , Gabriele MT D'Eleuterio

We consider the problem of model building for rare events prediction in longitudinal follow-up studies. In this paper, we compare several resampling methods to improve standard regression models on a real life example. We evaluate the…

Methodology · Statistics 2023-06-21 Pierre Druilhet , Mathieu Berthe , Stéphanie Léger

The multivariate linear regression model is an important tool for investigating relationships between several response variables and several predictor variables. The primary interest is in inference about the unknown regression coefficient…

Statistics Theory · Mathematics 2017-09-13 Daniel J. Eck

Obtaining accurate estimates of machine learning model uncertainties on newly predicted data is essential for understanding the accuracy of the model and whether its predictions can be trusted. A common approach to such uncertainty…

Meta-analyses require an effect-size estimate and its corresponding sampling variance from primary studies. In some cases, estimators for the sampling variance of a given effect size statistic may not exist, necessitating the derivation of…

We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework.…

Machine Learning · Statistics 2018-09-14 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Guy Koren , Gal Novik

We develop and implement a novel fast bootstrap for dependent data. Our scheme is based on the i.i.d. resampling of the smoothed moment indicators. We characterize the class of parametric and semi-parametric estimation problems for which…

Methodology · Statistics 2022-01-19 Davide La Vecchia , Alban Moor , Olivier Scaillet

We consider bootstrap inference for estimators which are (asymptotically) biased. We show that, even when the bias term cannot be consistently estimated, valid inference can be obtained by proper implementations of the bootstrap.…

Quality by design in pharmaceutical manufacturing hinges on computational methods and tools that are capable of accurate quantitative prediction of the design space. This paper investigates Bayesian approaches to design space…

The bootstrap is a popular and powerful method for assessing precision of estimators and inferential methods. However, for massive datasets which are increasingly prevalent, the bootstrap becomes prohibitively costly in computation and its…

Methodology · Statistics 2015-08-06 Srijan Sengupta , Stanislav Volgushev , Xiaofeng Shao

This paper introduces a local optimization-based approach to test statistical hypotheses and to construct confidence intervals. This approach can be viewed as an extension of bootstrap, and yields asymptotically valid tests and confidence…

Methodology · Statistics 2015-04-21 Shifeng Xiong

We characterize the statistical bootstrap for the estimation of information-theoretic quantities from data, with particular reference to its use in the study of large-scale social phenomena. Our methods allow one to preserve, approximately,…

Information Theory · Computer Science 2013-06-06 Simon DeDeo , Robert X. D. Hawkins , Sara Klingenstein , Tim Hitchcock

Monitoring machine learning models once they are deployed is challenging. It is even more challenging to decide when to retrain models in real-case scenarios when labeled data is beyond reach, and monitoring performance metrics becomes…

Machine Learning · Computer Science 2022-11-23 Carlos Mougan , Dan Saattrup Nielsen

A multiplier bootstrap procedure for construction of likelihood-based confidence sets is considered for finite samples and a possible model misspecification. Theoretical results justify the bootstrap validity for a small or moderate sample…

Statistics Theory · Mathematics 2015-11-18 Vladimir Spokoiny , Mayya Zhilova

We study an AMOC time series model with an abrupt change in the mean and dependent errors that fulfill certain mixing conditions. We obtain confidence intervals for the unknown change-point via bootstrapping methods. Precisely we use a…

Statistics Theory · Mathematics 2008-10-30 Marie Huskova , Claudia Kirch

Residual-based analysis is generally considered a cornerstone of statistical methodology. For a special case of indirect regression, we investigate the residual-based empirical distribution function and provide a uniform expansion of this…

Methodology · Statistics 2018-03-01 Nicolai Bissantz , Justin Chown , Holger Dette