English
Related papers

Related papers: Gaps between Singular Values of Sample Covariance …

200 papers

This paper is to investigate the spectral properties of sample covariance matrices under a more general population. We consider a class of matrices of the form $\mathbf S_n=\frac1n\mathbf B_n\mathbf X_n\mathbf X_n^*\mathbf B_n^*$, where…

Probability · Mathematics 2018-01-11 Yanqing Yin

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

We consider the singular vectors of any $m \times n$ submatrix of a rectangular $M \times N$ Gaussian matrix and study their asymptotic overlaps with those of the full matrix, in the macroscopic regime where $N \,/\, M\,$, $m \,/\, M$ as…

Probability · Mathematics 2025-01-16 Elie Attal , Romain Allez

Let $M_n = (\xi_{ij})_{1 \leq i,j \leq n}$ be a real symmetric random matrix in which the upper-triangular entries $\xi_{ij}, i<j$ and diagonal entries $\xi_{ii}$ are independent. We show that with probability tending to 1, $M_n$ has no…

Probability · Mathematics 2014-12-04 Terence Tao , Van Vu

We study numerically and analytically the spectrum of incidence matrices of random labeled graphs on N vertices : any pair of vertices is connected by an edge with probability p. We give two algorithms to compute the moments of the…

Statistical Mechanics · Physics 2015-06-24 M. Bauer , O. Golinelli

In this paper, we consider $m$ independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables and assume the product of the $m$ rectangular matrices is an $n$ by…

Probability · Mathematics 2021-04-08 Yongcheng Qi , Hongru Zhao

We address overcrowding estimates for the singular values of random iid matrices, as well as for the eigenvalues of random Wigner matrices. We show evidence of long range separation under arbitrary perturbation even in matrices of discrete…

Probability · Mathematics 2018-10-09 Hoi H. Nguyen

The paper deals with distribution of singular values of product of random matrices arising in the analysis of deep neural networks. The matrices resemble the product analogs of the sample covariance matrices, however, an important…

Mathematical Physics · Physics 2020-11-23 Leonid Pastur

In this paper, we investigate extreme singular values of the analysis matrix of a Gabor frame $(g, \Lambda)$ with a random window $g$. Columns of such matrices are time and frequency shifts of $g$, and $\Lambda\subset…

Probability · Mathematics 2019-02-05 Palina Salanevich

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

Machine Learning · Statistics 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

This work is concerned with finite range bounds on the variance of individual eigenvalues of Wigner random matrices, in the bulk and at the edge of the spectrum, as well as for some intermediate eigenvalues. Relying on the GUE example,…

Probability · Mathematics 2012-07-06 Sandrine Dallaporta

We consider a product of an arbitrary number of independent rectangular Gaussian random matrices. We derive the mean densities of its eigenvalues and singular values in the thermodynamic limit, eventually verified numerically. These…

Statistical Mechanics · Physics 2011-06-28 Z. Burda , A. Jarosz , G. Livan , M. A. Nowak , A. Swiech

We investigate the universality of singular value and eigenvalue distributions of matrix valued functions of independent random matrices and apply these general results in several examples. In particular we determine the limit distribution…

Probability · Mathematics 2014-08-19 F. Götze , H. Kösters , A. Tikhomirov

The scaled standard Wigner matrix (symmetric with mean zero, variance one i.i.d. entries), and its limiting eigenvalue distribution, namely the semi-circular distribution, has attracted much attention. The $2k$th moment of the limit equals…

Probability · Mathematics 2021-03-18 Arup Bose , Koushik Saha , Arusharka Sen , Priyanka Sen

In this paper we show that the empirical eigenvalue distribution of any sample covariance matrix generated by independent copies of a stationary regular sequence has a limiting distribution depending only on the spectral density of the…

Probability · Mathematics 2014-08-12 Florence Merlevede , Magda Peligrad

We observe that the distribution of the eigenvalues of an $N$-by-$N$ GUE random matrix is log-concave on $\mathbb{R}^N$, and that the same is true for the law of a single gap between two consecutive eigenvalues. We use this observation to…

Probability · Mathematics 2026-01-12 Samuel G. G. Johnston

In this note, we show that the norm of an $n\times n$ random jointly exchangeable matrix with zero diagonal can be estimated in terms of the norm of its $n/2\times n/2$ submatrix located in the top right corner. As a consequence, we prove a…

Probability · Mathematics 2019-01-07 Konstantin Tikhomirov , Pierre Youssef

Let $d\geq 3$ be a fixed integer and $A$ be the adjacency matrix of a random $d$-regular directed or undirected graph on $n$ vertices. We show there exist constants $\mathfrak d>0$, \begin{align*} {\mathbb P}(\text{$A$ is singular in…

Probability · Mathematics 2019-01-01 Jiaoyang Huang

We consider the empirical eigenvalue distribution of random real symmetric matrices with stochastically independent skew-diagonals and study its limit if the matrix size tends to infinity. We allow correlations between entries on the same…

Probability · Mathematics 2015-10-23 Kristina Schubert

In this work we consider the problem of estimating a high-dimensional $p \times p$ covariance matrix $\Sigma$, given $n$ observations of confounded data with covariance $\Sigma + \Gamma \Gamma^T$, where $\Gamma$ is an unknown $p \times q$…

Methodology · Statistics 2019-12-03 Rajen D. Shah , Benjamin Frot , Gian-Andrea Thanei , Nicolai Meinshausen