English
Related papers

Related papers: On singular values of data matrices with general i…

200 papers

Concatenating matrices is a common technique for uncovering shared structures in data through singular value decomposition (SVD) and low-rank approximations. The fundamental question arises: How does the singular value spectrum of the…

Machine Learning · Computer Science 2025-07-01 Maksym Shamrai

We investigate the spectral distribution of large sample covariance matrices with independent columns and entries in the columns that stem from Markov chains. We characterize the limiting spectral densities by their moments.…

Probability · Mathematics 2012-03-19 Olga Friesen , Matthias Löwe

We place ourselves in the setting of high-dimensional statistical inference where the number of variables $p$ in a dataset of interest is of the same order of magnitude as the number of observations $n$. We consider the spectrum of certain…

Statistics Theory · Mathematics 2010-01-05 Noureddine El Karoui

Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance…

Probability · Mathematics 2022-01-04 Arup Bose , Priyanka Sen

Consider the empirical spectral distribution of complex random $n\times n$ matrix whose entries are independent and identically distributed random variables with mean zero and variance $1/n$. In this paper, via applying potential theory in…

Probability · Mathematics 2007-06-13 Guangming Pan , Wang Zhou

Let $(\varepsilon_{t})_{t>0}$ be a sequence of independent real random vectors of $p$-dimension and let $X_T= \sum_{t=s+1}^{s+T}\varepsilon_t\varepsilon^T_{t-s}/T$ be the lag-$s$ ($s$ is a fixed positive integer) auto-covariance matrix of…

Probability · Mathematics 2018-01-23 Qinwen Wang , Jianfeng Yao

The coherence of a random matrix, which is defined to be the largest magnitude of the Pearson correlation coefficients between the columns of the random matrix, is an important quantity for a wide range of applications including…

Probability · Mathematics 2011-02-16 Tony Cai , Tiefeng Jiang

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

We study the densities of limiting distributions of squared singular values of high-dimensional matrix products composed of independent complex Gaussian (complex Ginibre) and truncated unitary matrices which are taken from Haar distributed…

Probability · Mathematics 2015-12-23 Thorsten Neuschel

In this paper, we study the perturbation of the extreme singular values of a matrix in the particular case where it is obtained after appending an arbitrary column vector. Such results have many applications in bifurcation theory, signal…

Spectral Theory · Mathematics 2014-12-17 Stephane Chretien , Sebastien Darses

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

Graph matrices are a type of matrix which has played a crucial role in analyzing the sum of squares hierarchy on average case problems. However, except for rough norm bounds, little is known about graph matrices. In this paper, we take a…

Combinatorics · Mathematics 2024-06-26 Wenjun Cai , Aaron Potechin

We place ourselves in the setting of high-dimensional statistical inference, where the number of variables $p$ in a data set of interest is of the same order of magnitude as the number of observations $n$. More formally, we study the…

Probability · Mathematics 2009-12-11 Noureddine El Karoui

We are concerned with the general problem of proving the existence of joint distributions of two discrete random variables $M$ and $N$ subject to infinitely many constraints of the form $\mathbb{P}\left(M=i,N=j\right)=0$. In particular, the…

Probability · Mathematics 2020-03-18 Joseph Squillace

We study the singular values (and Lyapunov exponents) for products of $N$ independent $n\times n$ random matrices with i.i.d. entries. Such matrix products have been extensively analyzed using free probability, which applies when $n\to…

Probability · Mathematics 2025-03-12 Boris Hanin , Tianze Jiang

An invariant ensemble of $N\times N$ random matrices can be characterised by a joint distribution for eigenvalues $P(\lambda_1,\cdots,\lambda_N)$. The study of the distribution of linear statistics, i.e. of quantities of the form…

Statistical Mechanics · Physics 2017-09-25 Aurélien Grabsch , Christophe Texier

We determine the limiting empirical singular value distribution for random unitary matrices with Haar distribution and discrete Fourier transform (DFT) matrices when a random set of columns and rows is removed.

Functional Analysis · Mathematics 2010-03-05 Brendan Farrell

The properties of eigenvalues of large dimensional random matrices have received considerable attention. One important achievement is the existence and identification of the limiting spectral distribution of the empirical spectral…

Combinatorics · Mathematics 2009-06-12 Wenxue Du , Xueliang Li , Yiyang Li

We investigate the universality of singular value and eigenvalue distributions of matrix valued functions of independent random matrices and apply these general results in several examples. In particular we determine the limit distribution…

Probability · Mathematics 2014-08-19 F. Götze , H. Kösters , A. Tikhomirov

This paper studies the asymptotic spectral properties of the sample covariance matrix for high dimensional compositional data, including the limiting spectral distribution, the limit of extreme eigenvalues, and the central limit theorem for…

Statistics Theory · Mathematics 2023-12-25 Qianqian Jiang , Jiaxin Qiu , Zeng Li