English
Related papers

Related papers: Eigenvector overlaps in large sample covariance ma…

200 papers

Modern Machine Learning (ML) and Deep Neural Networks (DNNs) often operate on high-dimensional data and rely on overparameterized models, where classical low-dimensional intuitions break down. In particular, the proportional regime where…

Machine Learning · Statistics 2026-04-17 Zhenyu Liao , Michael W. Mahoney

We consider general high-dimensional spiked sample covariance models and show that their leading sample spiked eigenvalues and their linear spectral statistics are asymptotically independent when the sample size and dimension are…

Statistics Theory · Mathematics 2020-09-25 Zhixiang Zhang , Shurong Zheng , Guangming Pan , Pingshou Zhong

Consider a $N\times n$ random matrix $Y_n=(Y_{ij}^{n})$ where the entries are given by $Y_{ij}^{n}=\frac{\sigma(i/N,j/n)}{\sqrt{n}} X_{ij}^{n}$, the $X_{ij}^{n}$ being centered i.i.d. and $\sigma:[0,1]^2 \to (0,\infty)$ being a continuous…

Probability · Mathematics 2007-06-13 W. Hachem , P. Loubaton , J. Najim

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

Probability · Mathematics 2021-03-02 Wlodek Bryc , Jack W. Silverstein

We consider complex sample covariance matrices $M_N=\frac{1}{N}YY^*$ where $Y$ is a $N \times p$ random matrix with i.i.d. entries $Y_{ij}, 1\leq i\leq N, 1\leq j \leq p$ with distribution $F$. Under some regularity and decay assumption on…

Probability · Mathematics 2011-01-05 S. Péché

Consider a $n\times n$ sparse non-Hermitian random matrix $X_n$ defined as the Hadamard product between a random matrix with centered independent and identically distributed entries and a sparse Bernoulli matrix with success probability…

Probability · Mathematics 2026-02-25 Walid Hachem , Michail Louvaris , Jamal Najim

We study universal traits which emerge both in real-world complex datasets, as well as in artificially generated ones. Our approach is to analogize data to a physical system and employ tools from statistical physics and Random Matrix Theory…

Machine Learning · Computer Science 2024-04-08 Noam Levi , Yaron Oz

In this paper we derive the optimal linear shrinkage estimator for the high-dimensional mean vector using random matrix theory. The results are obtained under the assumption that both the dimension $p$ and the sample size $n$ tend to…

Statistics Theory · Mathematics 2018-07-17 Taras Bodnar , Ostap Okhrin , Nestor Parolya

For two large matrices ${\mathbf X}$ and ${\mathbf Y}$ with Gaussian i.i.d.\ entries and dimensions $T\times N_X$ and $T\times N_Y$, respectively, we derive the probability distribution of the singular values of $\mathbf{X}^T \mathbf{Y}$ in…

Statistics Theory · Mathematics 2025-08-29 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

This is a continuation of our earlier paper on the universality of the eigenvalues of Wigner random matrices. The main new results of this paper are an extension of the results in that paper from the bulk of the spectrum up to the edge. In…

Probability · Mathematics 2015-05-13 Terence Tao , Van Vu

We study the statistics of Dirichlet eigenvalues of the random Schr\"odinger operator $-\epsilon^{-2}\Delta^{(\text{d})}+\xi^{(\epsilon)}(x)$, with $\Delta^{(\text{d})}$ the discrete Laplacian on $\mathbb Z^d$ and $\xi^{(\epsilon)}(x)$…

Probability · Mathematics 2020-01-06 Marek Biskup , Ryoki Fukushima , Wolfgang Koenig

We study the universality of spectral statistics of large random matrices. We consider $N\times N$ symmetric, hermitian or quaternion self-dual random matrices with independent, identically distributed entries (Wigner matrices) where the…

Mathematical Physics · Physics 2015-05-18 Laszlo Erdos

Eigenvector continuation is a computational method that finds the extremal eigenvalues and eigenvectors of a Hamiltonian matrix with one or more control parameters. It does this by projection onto a subspace of eigenvectors corresponding to…

Nuclear Theory · Physics 2021-01-22 Avik Sarkar , Dean Lee

We consider a $p$-dimensional time series where the dimension $p$ increases with the sample size $n$. The resulting data matrix $X$ follows a stochastic volatility model: each entry consists of a positive random volatility term multiplied…

Probability · Mathematics 2020-01-15 Johannes Heiny , Thomas Mikosch

We address overcrowding estimates for the singular values of random iid matrices, as well as for the eigenvalues of random Wigner matrices. We show evidence of long range separation under arbitrary perturbation even in matrices of discrete…

Probability · Mathematics 2018-10-09 Hoi H. Nguyen

Eigenvectors associated with non-degenerate eigenvalues are shown to correspond to columns of the adjugate of the characteristic matrix. Degenerate eigenvalues are associated with eigenvectors that correspond to reduced complement tensors…

Mathematical Physics · Physics 2024-06-25 M. I. Krivoruchenko

We study the eigenvector mass distribution of an $N\times N$ Wigner matrix on a set of coordinates $I$ satisfying $| I | \ge c N$ for some constant $c >0$. For eigenvectors corresponding to eigenvalues at the spectral edge, we show that the…

Probability · Mathematics 2025-10-14 Lucas Benigni , Nixia Chen , Patrick Lopatto , Xiaoyu Xie

The existence of limiting spectral distribution (LSD) of $\hat{\Gamma}_u+\hat{\Gamma}_u^*$, the symmetric sum of the sample autocovariance matrix $\hat{\Gamma}_u$ of order $u$, is known when the observations are from an infinite dimensional…

Statistics Theory · Mathematics 2016-03-31 Monika Bhattacharjee , Arup Bose

Suppose that we observe $y \in \mathbb{R}^n$ and $X \in \mathbb{R}^{n \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* +\epsilon \\ X & = & X_0 + W, \end{eqnarray*} where $X_0$ is an $n \times m$…

Machine Learning · Statistics 2017-04-04 Mark Rudelson , Shuheng Zhou

This article is devoted to the study of overlap measures of densities of two exponential populations. Various Overlapping Coefficients, namely: Matusita's measure $\rho$, Morisita's measure $\lambda$ and Weitzman's measure $\Delta$. A new…

Methodology · Statistics 2017-04-11 Hamza Dhaker , Papa Ngom , Malick Mbodj