English
Related papers

Related papers: Quantifying Uncertainty: All We Need is the Bootst…

200 papers

Modern artificial intelligence is supported by machine learning models (e.g., foundation models) that are pretrained on a massive data corpus and then adapted to solve a variety of downstream tasks. To summarize performance across multiple…

Machine Learning · Statistics 2025-01-09 Rachel Longjohn , Giri Gopalan , Emily Casleton

Violation of the assumptions underlying classical (Gaussian) limit theory often yields unreliable statistical inference. This paper shows that the bootstrap can detect such violations by delivering simple and powerful diagnostic tests that…

Econometrics · Economics 2025-10-09 Giuseppe Cavaliere , Luca Fanelli , Iliyan Georgiev

We consider semiparametric transformation models, where after pre-estimation of a parametric transformation of the response the data are modeled by means of nonparametric regression. We suggest subsequent procedures for testing lack-of-fit…

Methodology · Statistics 2019-01-25 Nick Kloodt , Natalie Neumeyer

Bootstrap is a principled and powerful frequentist statistical tool for uncertainty quantification. Unfortunately, standard bootstrap methods are computationally intensive due to the need of drawing a large i.i.d. bootstrap sample to…

Machine Learning · Computer Science 2022-09-02 Mao Ye , Qiang Liu

We focus on the construction of confidence corridors for multivariate nonparametric generalized quantile regression functions. This construction is based on asymptotic results for the maximal deviation between a suitable nonparametric…

Statistics Theory · Mathematics 2015-02-03 Shih-Kang Chao , Katharina Proksch , Holger Dette , Wolfgang Härdle

Despite the popularity of Convolutional Neural Networks (CNN), the problem of uncertainty quantification (UQ) of CNN has been largely overlooked. Lack of efficient UQ tools severely limits the application of CNN in certain areas, such as…

Machine Learning · Computer Science 2026-04-15 Hongfei Du , Emre Barut , Fang Jin

Epistemic uncertainty quantification is a crucial part of drawing credible conclusions from predictive models, whether concerned about the prediction at a given point or any downstream evaluation that uses the model as input. When the…

Machine Learning · Statistics 2022-11-15 Nathan Kallus , James McInerney

Standard statistical methods that do not take proper account of the complexity of survey design can lead to erroneous inferences when applied to survey data due to unequal selection probabilities, clustering, and other design features. In…

Methodology · Statistics 2021-03-04 Jae-kwang Kim , J. N. K. Rao , Zhonglei Wang

Skill scores, which measure the relative improvement of a forecasting method over a benchmark via consistent scoring functions and proper scoring rules, are a standard tool in forecast evaluation, yet their sampling uncertainty is rarely…

Methodology · Statistics 2026-05-06 Marc-Oliver Pohle , Tanja Zahn , Sebastian Lerch

When we use simulation to assess the performance of stochastic systems, the input models used to drive simulation experiments are often estimated from finite real-world data. There exist both input model and simulation estimation…

Methodology · Statistics 2021-08-10 Wei Xie , Cheng Li , Yuefeng Wu , Pu Zhang

Bootstrap is a popular methodology for simulating input uncertainty. However, it can be computationally expensive when the number of samples is large. We propose a new approach called \textbf{Orthogonal Bootstrap} that reduces the number of…

Methodology · Statistics 2024-05-02 Kaizhao Liu , Jose Blanchet , Lexing Ying , Yiping Lu

Bootstrap inference is a powerful tool for obtaining robust inference for quantiles and difference-in-quantiles estimators. The computationally intensive nature of bootstrap inference has made it infeasible in large-scale experiments. In…

Methodology · Statistics 2022-03-10 Mårten Schultzberg , Sebastian Ankargren

The bootstrap, introduced by Efron (1982), has become a very popular method for estimating variances and constructing confidence intervals. A key insight is that one can approximate the properties of estimators by using the empirical…

Methodology · Statistics 2019-01-29 Guido Imbens , Konrad Menzel

Bayesian nonparametric models offer a flexible and powerful framework for statistical model selection, enabling the adaptation of model complexity to the intricacies of diverse datasets. This survey intends to delve into the significance of…

Machine Learning · Computer Science 2024-04-02 Bahman Moraffah

Bootstrap methods are increasingly accepted as one of the common approaches in constructing confidence intervals in bibliometric studies. Typical bootstrap methods assume that the statistical population is infinite. When the statistical…

Applications · Statistics 2018-04-17 Tina Nane , Kasper Kooijman

We investigate properties of a bootstrap-based methodology for testing hypotheses about equality of certain characteristics of the distributions between different populations in the context of functional data. The suggested testing…

Statistics Theory · Mathematics 2016-09-29 Efstathios Paparoditis , Theofanis Sapatinas

Background and Objective: Uncertainty in non-linear mixed effect models is often assessed using the Fisher information matrix to derive the standard errors of estimation. The bootstrap is an alternative to the asymptotic method, with…

Methodology · Statistics 2026-05-05 Sofia Kaisaridi , Moreno Ursino , Emmanuelle Comets

The bootstrap provides a simple and powerful means of assessing the quality of estimators. However, in settings involving large datasets, the computation of bootstrap-based quantities can be prohibitively demanding. As an alternative, we…

Machine Learning · Computer Science 2012-07-03 Ariel Kleiner , Ameet Talwalkar , Purnamrita Sarkar , Michael Jordan

This study focuses on finite-sample inference on the non-linear Bures-Wasserstein manifold and introduces a generalized bootstrap procedure for estimating Bures-Wasserstein barycenters. We provide non-asymptotic statistical guarantees for…

Statistics Theory · Mathematics 2024-11-26 Alexey Kroshnin , Vladimir Spokoiny , Alexandra Suvorikova

This article proposes an online bootstrap scheme for nonparametric level estimation in nonstationary time series. Our approach applies to a broad class of level estimators expressible as weighted sample averages over time windows, including…

Methodology · Statistics 2026-03-02 Thomas Nagler , Tobias Brock , Nicolai Palm