English
Related papers

Related papers: Spectral analysis of high-dimensional sample covar…

200 papers

We study the limiting spectral measure of large random Helson matrices and large random matrices of certain patterned structures. Given a real random variable $X \in L^{2+ \varepsilon}(\mathbb{P}) $ for some $\varepsilon > 0$ and…

Probability · Mathematics 2026-02-26 Yanqi Qiu , Guocheng Zhen

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

This paper addresses the asymptotic behavior of a particular type of information-plus-noise-type matrices, where the column and row number of the matrices are large and of the same order, while signals are diverged and time delays of the…

Information Theory · Computer Science 2019-03-11 Guanping Lu , Jinsong Wu , Robert C. Qiu

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

Machine Learning · Statistics 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

Multivariate hypergeometric distribution arises frequently in elementary statistics and probability courses, for simultaneously studying the occurence law of specified events, when sampling without replacement from a finite population with…

Statistics Theory · Mathematics 2021-01-05 X. G. Duan

This paper investigates the rate of convergence for the central limit theorem of linear spectral statistic (LSS) associated with large-dimensional sample covariance matrices. We consider matrices of the form ${\mathbf…

Probability · Mathematics 2025-06-05 Jian Cui , Jiang Hu , Zhidong Bai , Guorong Hu

We take on a Random Matrix theory viewpoint to study the spectrum of certain reversible Markov chains in random environment. As the number of states tends to infinity, we consider the global behavior of the spectrum, and the local behavior…

Probability · Mathematics 2010-06-15 Charles Bordenave , Pietro Caputo , Djalil Chafai

Partial Least Squares (PLS) learns shared structure from paired data via the top singular vectors of the empirical cross-covariance (PLS-SVD), but multimodal datasets often have missing entries in both views. We study PLS-SVD under…

Machine Learning · Computer Science 2026-05-18 Anders Gjølbye , Ida Kargaard , Emma Kargaard , Lina Skerath , Lars Kai Hansen

We evaluate the covariance matrix of the matter power spectrum using perturbation theory up to dominant terms at 1-loop order and compare it to numerical simulations. We decompose the covariance matrix into the disconnected (Gaussian) part,…

Cosmology and Nongalactic Astrophysics · Physics 2017-01-18 Irshad Mohammed , Uros Seljak , Zvonimir Vlah

We prove a local law in the bulk of the spectrum for random Gram matrices $XX^*$, a generalization of sample covariance matrices, where $X$ is a large matrix with independent, centered entries with arbitrary variances. The limiting…

Probability · Mathematics 2017-03-13 Johannes Alt , László Erdős , Torben Krüger

The existence of limiting spectral distribution (LSD) of $\hat{\Gamma}_u+\hat{\Gamma}_u^*$, the symmetric sum of the sample autocovariance matrix $\hat{\Gamma}_u$ of order $u$, is known when the observations are from an infinite dimensional…

Statistics Theory · Mathematics 2016-03-31 Monika Bhattacharjee , Arup Bose

We investigate the spectral distribution of random matrix ensembles with correlated entries. We consider symmetric matrices with real valued entries and stochastically independent diagonals. Along the diagonals the entries may be…

Probability · Mathematics 2015-03-13 Olga Friesen , Matthias Löwe

Spectral properties of random matrices play an important role in statistics, machine learning, communications, and many other areas. Engaging results regarding the convergence of the empirical spectral distribution (ESD) and the…

Statistics Theory · Mathematics 2025-07-08 Zeyan Zhuang , Xin Zhang , Dongfang Xu , Shenghui Song

We consider Erd\H{o}s-R\'enyi-type random hypergraphs that are non-uniform, in the sense that hyperedges of different sizes may coexist, and inhomogeneous, in that connection probabilities may depend on the hyperedge size. All parameters…

Probability · Mathematics 2026-04-03 Luca Avena , Elia Bisi , Eleonora Bordiga

In this paper, we derive the analytical behavior of the limiting spectral distribution of non-central covariance matrices of the "general information-plus-noise" type, as studied in [14]. Through the equation defining its Stieltjes…

Statistics Theory · Mathematics 2023-06-29 Huanchao Zhou , Jiang Hu , Zhidong Bai , Jack W. Silverstein

We show that the empirical spectral distribution (ESD) of the sample autocovariance matrix (ACVM) converges as the dimension increases, when the time series is a linear process with reasonable restriction on the coefficients. The limit does…

Probability · Mathematics 2014-07-03 Anirban Basak , Arup Bose , Sanchayan Sen

Random feature maps are ubiquitous in modern statistical machine learning, where they generalize random projections by means of powerful, yet often difficult to analyze nonlinear operators. In this paper, we leverage the "concentration"…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-03-09 Rémy Mariétan , Stephan Morgenthaler

The large scale behavior of systems having a large number of interacting degrees of freedom is suitably described using renormalization group, from non-Gaussian distributions. Renormalization group techniques used in physics are then…

High Energy Physics - Theory · Physics 2022-03-04 Vincent Lahoche , Dine Ousmane Samary , Mohamed Tamaazousti

We consider the limiting spectral distribution of matrices of the form $\frac{1}{2b_{n}+1} (R + X)(R + X)^{*}$, where $X$ is an $n\times n$ band matrix of bandwidth $b_{n}$ and $R$ is a non random band matrix of bandwidth $b_{n}$. We show…

Probability · Mathematics 2017-08-02 Indrajit Jana , Alexander Soshnikov