English
Related papers

Related papers: Gaussian and bootstrap approximations for high-dim…

200 papers

Bootstrapping can produce confidence levels for hypotheses about quadratic regression models - such as whether the U-shape is inverted, and the location of optima. The method has several advantages over conventional methods: it provides…

Methodology · Statistics 2012-07-09 Michael Wood

We construct examples of degree-two U- and V-statistics of $n$ i.i.d.~heavy-tailed random vectors in $\mathbb{R}^{d(n)}$, whose $\nu$-th moments exist for ${\nu > 2}$, and provide tight bounds on the error of approximating both statistics…

Statistics Theory · Mathematics 2024-06-19 Kevin Han Huang , Peter Orbanz

Subspace learning and matrix factorization problems have great many applications in science and engineering, and efficient algorithms are critical as dataset sizes continue to grow. Many relevant problem formulations are non-convex, and in…

Numerical Analysis · Computer Science 2022-02-22 Dejiao Zhang , Laura Balzano

We prove the large-dimensional Gaussian approximation of a sum of $n$ independent random vectors in $\mathbb{R}^d$ together with fourth-moment error bounds on convex sets and Euclidean balls. We show that compared with classical…

Probability · Mathematics 2021-03-03 Xiao Fang , Yuta Koike

We introduce a high-dimensional multiplier bootstrap for time series data based on capturing dependence through a sparsely estimated vector autoregressive model. We prove its consistency for inference on high-dimensional means under two…

Econometrics · Economics 2025-05-14 Robert Adamek , Stephan Smeekes , Ines Wilms

We study generalized bootstrap confidence regions for the mean of a random vector whose coordinates have an unknown dependency structure. The random vector is supposed to be either Gaussian or to have a symmetric and bounded distribution.…

Statistics Theory · Mathematics 2010-07-02 Sylvain Arlot , Gilles Blanchard , Etienne Roquain

The problem of constructing a simultaneous confidence surface for the 2-dimensional mean function of a non-stationary functional time series is challenging as these bands can not be built on classical limit theory for the maximum absolute…

Statistics Theory · Mathematics 2024-11-27 Holger Dette , Weichi Wu

Subsampled Newton methods approximate Hessian matrices through subsampling techniques, alleviating the cost of forming Hessian matrices but using sufficient curvature information. However, previous results require $\Omega (d)$ samples to…

Machine Learning · Statistics 2019-05-07 Xiang Li , Shusen Wang , Zhihua Zhang

Bootstrap is a principled and powerful frequentist statistical tool for uncertainty quantification. Unfortunately, standard bootstrap methods are computationally intensive due to the need of drawing a large i.i.d. bootstrap sample to…

Machine Learning · Computer Science 2022-09-02 Mao Ye , Qiang Liu

Violation of the assumptions underlying classical (Gaussian) limit theory often yields unreliable statistical inference. This paper shows that the bootstrap can detect such violations by delivering simple and powerful diagnostic tests that…

Econometrics · Economics 2025-10-09 Giuseppe Cavaliere , Luca Fanelli , Iliyan Georgiev

Statisticians increasingly face the problem to reconsider the adaptability of classical inference techniques. In particular, divers types of high-dimensional data structures are observed in various research areas; disclosing the boundaries…

Statistics Theory · Mathematics 2017-06-09 Paavo Sattler , Markus Pauly

We consider the first serial correlation coefficient under an AR(1) model where errors are not assumed to be Gaussian. In this case it is necessary to consider bootstrap approximations for tests based on the statistic since the distribution…

Statistics Theory · Mathematics 2013-06-07 Chris Field , John Robinson

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

Statistics derived from the eigenvalues of sample covariance matrices are called spectral statistics, and they play a central role in multivariate testing. Although bootstrap methods are an established approach to approximating the laws of…

Methodology · Statistics 2019-02-21 Miles Lopes , Andrew Blandino , Alexander Aue

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

Methodology · Statistics 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

This paper investigates the approximation of Gaussian random variables in Banach spaces, focusing on the high-probability bounds for the approximation of Gaussian random variables using finitely many observations. We derive non-asymptotic…

Statistics Theory · Mathematics 2025-08-28 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

We propose a bootstrap-based test to detect a mean shift in a sequence of high-dimensional observations with unknown time-varying heteroscedasticity. The proposed test builds on the U-statistic based approach in Wang et al. (2022), targets…

Methodology · Statistics 2023-11-17 Teng Wu , Stanislav Volgushev , Xiaofeng Shao

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric…

Statistics Theory · Mathematics 2025-02-04 Ismaël Castillo , Thibault Randrianarisoa

Several new methods have been proposed for performing valid inference after model selection. An older method is sampling splitting: use part of the data for model selection and part for inference. In this paper we revisit sample splitting…

Statistics Theory · Mathematics 2018-04-04 Alessandro Rinaldo , Larry Wasserman , Max G'Sell , Jing Lei

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach