English
Related papers

Related papers: Spiked covariances and principal components analys…

200 papers

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

A system with many degrees of freedom can be characterized by a covariance matrix; principal components analysis (PCA) focuses on the eigenvalues of this matrix, hoping to find a lower dimensional description. But when the spectrum is…

Biological Physics · Physics 2017-04-26 Serena Bradde , William Bialek

Let $X$ be a mean zero Gaussian random vector in a separable Hilbert space ${\mathbb H}$ with covariance operator $\Sigma:={\mathbb E}(X\otimes X).$ Let $\Sigma=\sum_{r\geq 1}\mu_r P_r$ be the spectral decomposition of $\Sigma$ with…

Statistics Theory · Mathematics 2016-01-08 Vladimir Koltchinskii , Karim Lounici

We study factor models augmented by observed covariates that have explanatory powers on the unknown factors. In financial factor models, the unknown factors can be reasonably well explained by a few observable proxies, such as the…

Methodology · Statistics 2018-09-18 Jianqing Fan , Yuan Ke , Yuan Liao

Principal Component Analysis (PCA) is an important tool of dimension reduction especially when the dimension (or the number of variables) is very high. Asymptotic studies where the sample size is fixed, and the dimension grows [i.e., High…

Statistics Theory · Mathematics 2009-11-20 Sungkyu Jung , J. S. Marron

Multivariate analysis of variance (MANOVA) is a powerful and versatile method to infer and quantify main and interaction effects in metric multivariate multi-factor data. It is, however, neither robust against change in units nor a…

Statistics Theory · Mathematics 2018-02-13 Dennis Dobler , Sarah Friedrich , Markus Pauly

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

In this paper, we characterize the asymptotic and large scale behavior of the eigenvalues of wavelet random matrices in high dimensions. We assume that possibly non-Gaussian, finite-variance $p$-variate measurements are made of a…

Statistics Theory · Mathematics 2024-06-11 Patrice Abry , B. Cooper Boniece , Gustavo Didier , Herwig Wendt

We study the crossover behavior of statistical properties of eigenvalues in a chaotic microcavity with different refractive indices. The level spacing distributions change from Wigner to Poisson distributions as the refractive index of a…

Quantum Physics · Physics 2019-04-03 Jung-Wan Ryu , Sang Wook Kim

In experimental design, aliasing of effects occurs in fractional factorial experiments, where certain low order factorial effects are indistinguishable from certain high order interactions: low order contrasts may be orthogonal to one…

Methodology · Statistics 2024-08-30 Paul R. Rosenbaum , Jose R. Zubizarreta

In many atmospheric and earth sciences, it is of interest to identify dominant spatial patterns of variation based on data observed at $p$ locations and $n$ time points with the possibility that $p>n$. While principal component analysis…

Methodology · Statistics 2016-02-29 Wen-Ting Wang , Hsin-Cheng Huang

Machine learning (ML) can process large sets of data generated from complex systems, which is ideal for classification tasks as often appeared in critical phenomena. Meanwhile ML techniques have been found effective in detecting critical…

Computational Physics · Physics 2024-05-07 Shen Jianmin , Wang Shanshan , Li Wei , Xu Dian , Yang Yuxiang , Wang Yanyang , Gao Feng , Zhu Yueying , Tuo Kui

Assessing variability according to distinct factors in data is a fundamental technique of statistics. The method commonly regarded to as analysis of variance (ANOVA) is, however, typically confined to the case where all levels of a factor…

Methodology · Statistics 2013-03-15 Steven Geinitz , Reinhard Furrer

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

We introduce Adaptive Subspace PCA (AS-PCA), a framework for principal component analysis of random elements in a general separable Hilbert space. AS-PCA projects the covariance operator onto a data-adaptive finite-dimensional subspace…

Statistics Theory · Mathematics 2026-03-24 Xinyi Li , Margaret Hoch , Michael R. Kosorok

In this note, we claim that diagonal scaling of a sample covariance matrix is asymptotically inconsistent if the ratio of the dimension to the sample size converges to a positive constant, where population is assumed to be Gaussian with a…

Statistics Theory · Mathematics 2018-08-20 Tomonari Sei

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

This paper studies the inference of the regression coefficient matrix under multivariate response linear regressions in the presence of hidden variables. A novel procedure for constructing confidence intervals of entries of the coefficient…

Methodology · Statistics 2022-01-21 Xin Bing , Wei Cheng , Huijie Feng , Yang Ning