English
Related papers

Related papers: Can we trust the bootstrap in high-dimension?

200 papers

We propose a new bootstrap-based online algorithm for stochastic linear bandit problems. The key idea is to adopt residual bootstrap exploration, in which the agent estimates the next step reward by re-sampling the residuals of mean reward…

Machine Learning · Statistics 2022-06-20 Shuang Wu , Chi-Hua Wang , Yuantong Li , Guang Cheng

We consider a heteroscedastic regression model in which some of the regression coefficients are zero but it is not known which ones. Penalized quantile regression is a useful approach for analyzing such data. By allowing different…

Methodology · Statistics 2018-07-23 Lan Wang , Ingrid Van Keilegrom , Adam Maidman

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

Model misspecification is ubiquitous in data analysis because the data-generating process is often complex and mathematically intractable. Therefore, assessing estimation uncertainty and conducting statistical inference under a possibly…

Methodology · Statistics 2023-12-19 Rong Li , Yichen Qin , Yang Li

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

We derive non-asymptotic confidence regions for the mean of a random vector whose coordinates have an unknown dependence structure. The random vector is supposed to be either Gaussian or to have a symmetric bounded distribution, and we…

Statistics Theory · Mathematics 2008-02-07 Sylvain Arlot , Gilles Blanchard , Etienne Roquain

Statistics derived from the eigenvalues of sample covariance matrices are called spectral statistics, and they play a central role in multivariate testing. Although bootstrap methods are an established approach to approximating the laws of…

Methodology · Statistics 2019-02-21 Miles Lopes , Andrew Blandino , Alexander Aue

Generalized extreme value (GEV) regression is often more adapted when we investigate a relationship between a binary response variable $Y$ which represents a rare event and potentiel predictors $\mathbf{X}$. In particular, we use the…

Methodology · Statistics 2021-05-04 Aba Diop , El Hadji Deme

The construction of confidence regions for parameter vectors is a difficult problem in the nonparametric setting, particularly when the sample size is not large. The bootstrap has shown promise in solving this problem, but empirical…

Methodology · Statistics 2013-11-01 Santu Ghosh , Alan M. Polansky

We propose a methodology for constructing confidence regions with partially identified models of general form. The region is obtained by inverting a test of internal consistency of the econometric structure. We develop a dilation bootstrap…

Econometrics · Economics 2021-02-10 Alfred Galichon , Marc Henry

Split-plot or repeated measures designs are frequently used for planning experiments in the life or social sciences. Typical examples include the comparison of different treatments over time, where both factors may possess an additional…

Statistics Theory · Mathematics 2017-10-13 Maria Umlauft , Marius Placzek , Frank Konietschke , Markus Pauly

We investigate asymptotic inference in a linear regression model where both response and regressors are functions, using an estimator based on functional principal components analysis. Although this approach is widely used in functional…

Methodology · Statistics 2026-03-16 Hyemin Yeon

The Bonferroni adjustment, or the union bound, is commonly used to study rate optimality properties of statistical methods in high-dimensional problems. However, in practice, the Bonferroni adjustment is overly conservative. The extreme…

Methodology · Statistics 2020-01-13 Hang Deng , Cun-Hui Zhang

In this paper we investigate how the bootstrap can be applied to time series regressions when the volatility of the innovations is random and non-stationary. The volatility of many economic and financial time series displays persistent…

Econometrics · Economics 2021-01-12 H. Peter Boswijk , Giuseppe Cavaliere , Anders Rahbek , Iliyan Georgiev

In this paper, we propose to construct confidence bands by bootstrapping the debiased kernel density estimator (for density estimation) and the debiased local polynomial regression estimator (for regression analysis). The idea of using a…

Methodology · Statistics 2019-06-06 Gang Cheng , Yen-Chi Chen

This paper is concerned with testing global null hypotheses about population mean vectors of high-dimensional data. Current tests require either strong mixing (independence) conditions on the individual components of the high-dimensional…

Statistics Theory · Mathematics 2023-09-06 Alexander Giessing , Jianqing Fan

The multivariate Fay-Herriot model is quite effective in combining information through correlations among small area survey estimates of related variables or historical survey estimates of the same variable or both. Though the literature on…

Methodology · Statistics 2020-06-29 Takumi Saegusa , Shonosuke Sugasawa , Partha Lahiri

We consider hypothesis testing for the null hypothesis being represented as an arbitrary-shaped region in the parameter space. We compute an approximate p-value by counting how many times the null hypothesis holds in bootstrap replicates.…

Statistics Theory · Mathematics 2014-05-21 Hidetoshi Shimodaira

We propose a new approach to the problem of high-dimensional multivariate ANOVA via bootstrapping max statistics that involve the differences of sample mean vectors. The proposed method proceeds via the construction of simultaneous…

Methodology · Statistics 2021-04-20 Zhenhua Lin , Miles E. Lopes , Hans-Georg Müller

Most of the modern literature on robust mean estimation focuses on designing estimators which obtain optimal sub-Gaussian concentration bounds under minimal moment assumptions and sometimes also assuming contamination. This work looks at…

Statistics Theory · Mathematics 2024-10-30 Lucas Resende