English
Related papers

Related papers: Asymptotics of Empirical Eigen-structure for Ultra…

200 papers

This is the first part of a paper that studies the phase transition in the asymptotic limit of the rank 1 real Wishart spiked model. In this paper, we consider $N$-dimensional real Wishart matrices $S$ in the class…

Probability · Mathematics 2010-11-25 M. Y. Mo

We study the fundamental problem of Principal Component Analysis in a statistical distributed setting in which each machine out of $m$ stores a sample of $n$ points sampled i.i.d. from a single unknown distribution. We study algorithms for…

Machine Learning · Computer Science 2017-02-28 Dan Garber , Ohad Shamir , Nathan Srebro

We propose a novel method of finding principal components in multivariate data sets that lie on an embedded nonlinear Riemannian manifold within a higher-dimensional space. Our aim is to extend the geometric interpretation of PCA, while…

Methodology · Statistics 2024-06-05 Zhigang Yao , Benjamin Eltzner , Tung Pham

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

Let $\bm{x}_1,\cdots,\bm{x}_n$ be a random sample of size $n$ from a $p$-dimensional population distribution, where $p=p(n)\rightarrow\infty$. Consider a symmetric matrix $W=X^\top X$ with parameters $n$ and $p$, where…

Probability · Mathematics 2023-06-16 Jianwei Hu , Seydou Keita , Kang Fu

The aim of this paper is to study asymptotic geometric properties almost surely or/and in probability of extreme order statistics of an i.i.d. random field (potential) indexed by sites of multidimensional lattice cube, the volume of which…

Probability · Mathematics 2016-12-05 Arvydas Astrauskas

Consider a standard white Wishart matrix with parameters $n$ and $p$. Motivated by applications in high-dimensional statistics and signal processing, we perform asymptotic analysis on the maxima and minima of the eigenvalues of all the $m…

Statistics Theory · Mathematics 2019-05-22 T. Tony Cai , Tiefeng Jiang , Xiaoou Li

Extremes play a special role in Anomaly Detection. Beyond inference and simulation purposes, probabilistic tools borrowed from Extreme Value Theory (EVT), such as the angular measure, can also be used to design novel statistical learning…

Machine Learning · Statistics 2016-04-01 Nicolas Goix , Anne Sabourin , Stéphan Clémençon

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

This paper deals with the asymptotic statistical properties of a class of redescending M-estimators in linear models with increasing dimension. This class is wide enough to include popular high breakdown point estimators such as…

Statistics Theory · Mathematics 2016-12-20 Ezequiel Smucler

We consider the five classes of multivariate statistical problems identified by James (1964), which together cover much of classical multivariate analysis, plus a simpler limiting case, symmetric matrix denoising. Each of James' problems…

Statistics Theory · Mathematics 2018-02-06 Iain M. Johnstone , Alexei Onatski

We consider the problem of how many components to retain in the application of principal component analysis when the dimension is much higher than the number of observations. To estimate the number of components, we propose to sequentially…

Methodology · Statistics 2018-06-29 Sungkyu Jung , Myung Hee Lee , Jeongyoun Ahn

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

We provide a remedy for two concerns that have dogged the use of principal components in regression: (i) principal components are computed from the predictors alone and do not make apparent use of the response, and (ii) principal components…

Methodology · Statistics 2009-06-23 R. Dennis Cook , Liliana Forzani

We develop a theory which describes the behaviour of eigenvalues of a class of one-dimensional random non-Hermitian operators introduced recently by Hatano and Nelson. Under general assumptions on random parameters we prove that the…

Condensed Matter · Physics 2009-10-30 Ilya Ya. Goldsheid , Boris A. Khoruzhenko

We study estimation of the covariance matrix under relative condition number loss $\kappa(\Sigma^{-1/2} \hat{\Sigma} \Sigma^{-1/2})$, where $\kappa(\Delta)$ is the condition number of matrix $\Delta$, and $\hat{\Sigma}$ and $\Sigma$ are the…

Statistics Theory · Mathematics 2018-10-18 David L. Donoho , Behrooz Ghorbani

Estimating eigenvectors and low-dimensional subspaces is of central importance for numerous problems in statistics, computer science, and applied mathematics. This paper characterizes the behavior of perturbed eigenvectors for a range of…

Statistics Theory · Mathematics 2018-09-14 Joshua Cape , Minh Tang , Carey E. Priebe

In this work we continue the study of the Weyl asymptotics of the distribution of eigenvalues of non-self-adjoint (pseudo)differential operators with small random perturbations, by treating the case of multiplicative perturbations in…

Spectral Theory · Mathematics 2009-12-02 Johannes Sjoestrand

Under certain conditions, the largest eigenvalue of a sample covariance matrix undergoes a well-known phase transition when the sample size $n$ and data dimension $p$ diverge proportionally. In the subcritical regime, this eigenvalue has…

Statistics Theory · Mathematics 2025-04-01 Nina Dörnemann , Miles E. Lopes

Euclidean random matrices arise in a wide range of physical systems where interactions are determined by spatial configurations, including disordered media and cooperative phenomena in atomic ensembles. Unlike classical random matrix…

Statistical Mechanics · Physics 2026-05-08 Pasquale Casaburi , Pierpaolo Vivo