English
Related papers

Related papers: Wald Statistics in high-dimensional PCA

200 papers

Let $X$ be a $d$-dimensional random vector and $X_\theta$ its projection onto the span of a set of orthonormal vectors $\{\theta_1,...,\theta_k\}$. Conditions on the distribution of $X$ are given such that if $\theta$ is chosen according to…

Probability · Mathematics 2011-02-16 Elizabeth Meckes

Given a random $n \times n$ symmetric matrix $\boldsymbol W$ drawn from the Gaussian orthogonal ensemble (GOE), we consider the problem of certifying an upper bound on the maximum value of the quadratic form $\boldsymbol x^\top \boldsymbol…

Data Structures and Algorithms · Computer Science 2019-04-09 Afonso S. Bandeira , Dmitriy Kunisky , Alexander S. Wein

In this response, we try to give a repair to our previous proof for PCA Based Hurst Exponent Estimator for fBm Signals by using orthogonal projection. Moreover, we answer the question raised recently: If a centered Gaussian process $G_t$…

Mathematical Physics · Physics 2015-05-13 Li Li

Gaussian process (GP) regression is widely used for uncertainty quantification, yet the standard formulation assumes noise-free covariates. When inputs are measured with error, this errors-in-variables (EIV) setting can lead to…

Methodology · Statistics 2026-03-19 Hengrui Luo , Xiaoye S. Li , Yang Liu , Marcus Noack , Ji Qiang , Mark D. Risser

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

In the context of principal components analysis (PCA), the bootstrap is commonly applied to solve a variety of inference problems, such as constructing confidence intervals for the eigenvalues of the population covariance matrix $\Sigma$.…

Statistics Theory · Mathematics 2022-02-17 Junwen Yao , Miles E. Lopes

We consider the Cox regression model and prove some properties of the maximum partial likelihood estimator $\hat\beta_n$ and of the the Breslow estimator $\Lambda_n$. The asymptotic properties of these estimators have been widely studied in…

Statistics Theory · Mathematics 2020-02-20 Cécile Durot , Eni Musta

In this paper, we establish explicit quantitative Berry-Esseen bounds in the hyper-rectangle distance $d_R$, the convex distance $d_{\mathscr{C}}$ and the $1$-Wasserstein distance $d_W$ for high-dimensional, non-linear functionals of…

Probability · Mathematics 2026-02-03 Andreas Basse-O'Connor , David Kramer-Bang

Although there is an extensive literature on the maxima of Gaussian processes, there are relatively few non-asymptotic bounds on their lower-tail probabilities. The aim of this paper is to develop such a bound, while also allowing for many…

Probability · Mathematics 2021-12-02 Miles E. Lopes , Junwen Yao

Many statistical estimation techniques for high-dimensional or functional data are based on a preliminary dimension reduction step, which consists in projecting the sample $\bX_1, \hdots, \bX_n$ onto the first $D$ eigenvectors of the…

Statistics Theory · Mathematics 2010-04-26 Gérard Biau , André Mas

This paper develops a simple method to construct confidence bands, centered at a principal component analysis (PCA) based estimator, for the slope function in a functional linear regression model with a scalar response variable and a…

Statistics Theory · Mathematics 2017-05-02 Masaaki Imaizumi , Kengo Kato

Assuming projective determinacy, we extend Spector's strong version of the Spector-Gandy Theorem to all odd levels of the projective hierarchy: Theorem. For every space $X$ which is a finite product of the natural numbers $N$ and Baire…

Logic · Mathematics 2022-02-09 Joan R. Moschovakis , Yiannis N. Moschovakis

We study principal component analysis (PCA) for mean zero i.i.d. Gaussian observations $X_1,\dots, X_n$ in a separable Hilbert space $\mathbb{H}$ with unknown covariance operator $\Sigma.$ The complexity of the problem is characterized by…

Statistics Theory · Mathematics 2019-01-21 Vladimir Koltchinskii , Matthias Löffler , Richard Nickl

Let $\mu$ be a probability measure on $\text{GL}_d(\mathbb R)$ and denote by $S_n:= g_n \cdots g_1$ the associated random matrix product, where $g_j$'s are i.i.d.'s with law $\mu$. We study statistical properties of random variables of the…

Probability · Mathematics 2022-01-31 Tien-Cuong Dinh , Lucas Kaufmann , Hao Wu

Let $X_{1},\ldots,X_{n}$ be i.i.d. sample in $\mathbb{R}^{p}$ with zero mean and the covariance matrix $\mathbf{\Sigma}$. The problem of recovering the projector onto an eigenspace of $\mathbf{\Sigma}$ from these observations naturally…

Statistics Theory · Mathematics 2017-03-03 Alexey Naumov , Vladimir Spokoiny , Vladimir Ulyanov

Let $X_1, \ldots, X_n$ be i.i.d. sample in $\mathbb{R}^p$ with zero mean and the covariance matrix $\mathbf{\Sigma^*}$. The classical PCA approach recovers the projector $\mathbf{P^*_{\mathcal{J}}}$ onto the principal eigenspace of…

Statistics Theory · Mathematics 2019-06-28 Igor Silin , Vladimir Spokoiny

The extremal dependence structure of a regularly varying $d$-dimensional random vector can be described by its angular measure. The standard nonparametric estimator of this measure is the empirical measure of the observed angles of the $k$…

Statistics Theory · Mathematics 2025-03-31 Holger Drees

This paper first strictly proved that the growth of the second moment of a large class of Gaussian processes is not greater than power function and the covariance matrix is strictly positive definite. Under these two conditions, the maximum…

Statistics Theory · Mathematics 2022-07-21 Shifei Luo

We provide finite sample bounds on the Normal approximation to the law of the least squares estimator of the projection parameters normalized by the sandwich-based standard errors. Our results hold in the increasing dimension setting and…

Statistics Theory · Mathematics 2021-10-25 Arun Kumar Kuchibhotla , Alessandro Rinaldo , Larry Wasserman

We analyse the reconstruction error of principal component analysis (PCA) and prove non-asymptotic upper bounds for the corresponding excess risk. These bounds unify and improve existing upper bounds from the literature. In particular, they…

Statistics Theory · Mathematics 2019-04-01 Markus Reiß , Martin Wahl