English
Related papers

Related papers: Confidence intervals of prediction accuracy measur…

200 papers

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by…

Machine Learning · Statistics 2024-06-05 Laurens Sluijterman , Eric Cator , Tom Heskes

In this paper, we propose to construct confidence bands by bootstrapping the debiased kernel density estimator (for density estimation) and the debiased local polynomial regression estimator (for regression analysis). The idea of using a…

Methodology · Statistics 2019-06-06 Gang Cheng , Yen-Chi Chen

This paper proposes a new non-parametric bootstrap method to quantify the uncertainty of average treatment effect estimate for the treated from matching estimators. More specifically, it seeks to quantify the uncertainty associated with the…

Methodology · Statistics 2024-08-21 Jing Li

We study the bootstrap for the maxima of the sums of independent random variables, a problem of high relevance to many applications in modern statistics. Since the consistency of bootstrap was justified by Gaussian approximation in…

Statistics Theory · Mathematics 2020-08-03 Hang Deng

In reinforcement learning, it is typical to use the empirically observed transitions and rewards to estimate the value of a policy via either model-based or Q-fitting approaches. Although straightforward, these techniques in general yield…

Machine Learning · Computer Science 2020-07-28 Ilya Kostrikov , Ofir Nachum

Publication bias is a major concern in conducting systematic reviews and meta-analyses. Various sensitivity analysis or bias-correction methods have been developed based on selection models and they have some advantages over the widely used…

Methodology · Statistics 2021-09-28 Ao Huang , Kosuke Morikawa , Tim Friede , Satoshi Hattori

Penalized spline regression is a popular method for scatterplot smoothing, but there has long been a debate on how to construct confidence intervals for penalized spline fits. Due to the penalty, the fitted smooth curve is a biased estimate…

Methodology · Statistics 2017-06-06 Ning Dai

The multivariate Fay-Herriot model is quite effective in combining information through correlations among small area survey estimates of related variables or historical survey estimates of the same variable or both. Though the literature on…

Methodology · Statistics 2020-06-29 Takumi Saegusa , Shonosuke Sugasawa , Partha Lahiri

I propose a new type of confidence interval for correct asymptotic inference after using data to select a model of interest without assuming any model is correctly specified. This hybrid confidence interval is constructed by combining…

Methodology · Statistics 2021-11-25 Adam McCloskey

Data-driven decision making frequently relies on predicting counterfactual outcomes. In practice, researchers commonly train counterfactual prediction models on a source dataset to inform decisions on a possibly separate target population.…

Machine Learning · Statistics 2026-04-07 Keith Barnatchez , Kevin P. Josey , Rachel C. Nethery , Giovanni Parmigiani

Robust optimization provides a principled framework for decision-making under uncertainty, with broad applications in finance, engineering, and operations research. In portfolio optimization, uncertainty in expected returns and covariances…

Statistical Finance · Quantitative Finance 2025-10-15 Daniel Cunha Oliveira , Grover Guzman , Nick Firoozye

This paper investigates bootstrap-based bias correction of semiparametric estimators of the long memory parameter, $d$, in fractionally integrated processes. The re-sampling method involves the application of the sieve bootstrap to data…

Methodology · Statistics 2016-03-08 Don S. Poskitt , Gael M. Martin , Simone D. Grose

A rich set of frequentist model averaging methods has been developed, but their applications have largely been limited to point prediction, as measuring prediction uncertainty in general settings remains an open problem. In this paper we…

Econometrics · Economics 2025-10-21 Zhongjun Qu , Wendun Wang , Xiaomeng Zhang

We propose a methodology for constructing confidence regions with partially identified models of general form. The region is obtained by inverting a test of internal consistency of the econometric structure. We develop a dilation bootstrap…

Econometrics · Economics 2021-02-10 Alfred Galichon , Marc Henry

We propose simple formulas of confidence intervals for the Wald statistic, likelihood ratio statistic, and score statistic for a network meta-analysis. In addition, we consider resolutions for concerns that network meta-analyses with a…

Methodology · Statistics 2022-01-12 Masahiro Kojima

This paper introduces a local optimization-based approach to test statistical hypotheses and to construct confidence intervals. This approach can be viewed as an extension of bootstrap, and yields asymptotically valid tests and confidence…

Methodology · Statistics 2015-04-21 Shifeng Xiong

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

Methodology · Statistics 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

This paper investigates the use of bootstrap-based bias correction of semi-parametric estimators of the long memory parameter in fractionally integrated processes. The re-sampling method involves the application of the sieve bootstrap to…

Methodology · Statistics 2014-02-28 D. S. Poskitt , Gael M. Martin , Simone D. Grose

Model misspecification is ubiquitous in data analysis because the data-generating process is often complex and mathematically intractable. Therefore, assessing estimation uncertainty and conducting statistical inference under a possibly…

Methodology · Statistics 2023-12-19 Rong Li , Yichen Qin , Yang Li

We consider the construction of confidence intervals for treatment effects estimated using panel models with interactive fixed effects. We first use the factor-based matrix completion technique proposed by Bai and Ng (2021) to estimate the…

Econometrics · Economics 2022-02-25 Xingyu Li , Yan Shen , Qiankun Zhou