English
Related papers

Related papers: Concentration of Random Feature Matrices in High-D…

200 papers

The first paper in this series introduced a new family of nonasymptotic matrix concentration inequalities that sharply capture the spectral properties of very general random matrices in terms of an associated noncommutative model. These…

Probability · Mathematics 2025-11-13 Afonso S. Bandeira , Giorgio Cipolloni , Dominik Schröder , Ramon van Handel

Pseudospectral analysis serves as a powerful tool in matrix computation and the study of both linear and nonlinear dynamical systems. Among various numerical strategies, random sampling, especially in the form of rank-$1$ perturbations,…

Spectral Theory · Mathematics 2025-05-19 Kuo Gai , Bin Shi

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Multivariate statistical analysis is concerned with observations on several variables which are thought to possess some degree of inter-dependence. Driven by problems in genetics and the social sciences, it first flowered in the earlier…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone

This manuscript studies statistical properties of linear classifiers obtained through minimization of an unregularized convex risk over a finite sample. Although the results are explicitly finite-dimensional, inputs may be passed through…

Machine Learning · Computer Science 2012-06-15 Matus Telgarsky

Random matrix theory allows one to deduce the eigenvalue spectrum of a large matrix given only statistical information about its elements. Such results provide insight into what factors contribute to the stability of complex dynamical…

Disordered Systems and Neural Networks · Physics 2025-01-30 Joseph W. Baron , Thomas Jun Jewell , Christopher Ryder , Tobias Galla

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

It recently has been found that methods of the statistical theories of spectra can be a useful tool in the analysis of spectra far from levels of Hamiltonian systems. Several examples originate from areas, such as quantitative linguistics…

Statistical Mechanics · Physics 2020-05-26 Rongrong Xie , Weibing Deng , Mauricio P. Pato

This review article provides an overview of random matrix theory (RMT) with a focus on its growing impact on the formulation and inference of statistical models and methodologies. Emphasizing applications within high-dimensional statistics,…

Methodology · Statistics 2024-12-11 Swapnaneel Bhattacharyya , Srijan Chattopadhyay , Sevantee Basu

Random matrix theory, which characterizes spectral distributions of infinitely large matrices, plays a central role across diverse fields, including high-dimensional data analysis, ecology, neuroscience, and machine learning. Among its key…

Disordered Systems and Neural Networks · Physics 2026-05-26 Arata Tomoto , Jun-nosuke Teramae

Statistical properties of non--symmetric real random matrices of size $M$, obtained as truncations of random orthogonal $N\times N$ matrices are investigated. We derive an exact formula for the density of eigenvalues which consists of two…

Statistical Mechanics · Physics 2010-10-21 Boris A. Khoruzhenko , Hans-Juergen Sommers , Karol Zyczkowski

Spectral properties of Gram matrices are central to high dimensional asymptotic analyses of statistical estimators in regression and covariance estimation. These properties, in turn, depend critically on the extreme singular values and…

Statistics Theory · Mathematics 2026-03-03 Partha Sarkar , Kshitij Khare , Sanvesh Srivastava

We study the spectral density of factor models of multivariate time series. By making use of the Random Matrix Theory we analytically quantify the effect of noise dressing on the spectral density due to the finiteness of the sample. We…

Statistical Mechanics · Physics 2007-05-23 Fabrizio Lillo , Rosario N. Mantegna

The ability to tailor the spectral response of photonic devices is paramount to the advancement of a broad range of applications. The vast design space offered by disordered optical media provide enhanced functionality for spectral…

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are…

Methodology · Statistics 2018-08-14 Jianqing Fan , Kaizheng Wang , Yiqiao Zhong , Ziwei Zhu

This article studies the \emph{robust covariance matrix estimation} of a data collection $X = (x_1,\ldots,x_n)$ with $x_i = \sqrt \tau_i z_i + m$, where $z_i \in \mathbb R^p$ is a \textit{concentrated vector} (e.g., an elliptical random…

Probability · Mathematics 2022-04-12 Cosme Louart , Romain Couillet

We introduce a random matrix framework for studying statistical-mechanical lattice systems through spectral observables. Equilibrium configurations sampled from a Boltzmann measure are mapped to matrix ensembles whose covariance structure…

Disordered Systems and Neural Networks · Physics 2026-05-21 Yaprak Önder , Abbas Ali Saberi , Roderich Moessner

We take on a Random Matrix theory viewpoint to study the spectrum of certain reversible Markov chains in random environment. As the number of states tends to infinity, we consider the global behavior of the spectrum, and the local behavior…

Probability · Mathematics 2010-06-15 Charles Bordenave , Pietro Caputo , Djalil Chafai

A central question in random matrix theory is universality. When an emergent phenomena is observed from a large collection of chosen random variables it is natural to ask if this behavior is specific to the chosen random variable or if the…

Probability · Mathematics 2021-01-13 Jake Koenig , Hoi Nguyen

We study principal components regression (PCR) in an asymptotic high-dimensional regression setting, where the number of data points is proportional to the dimension. We derive exact limiting formulas for the estimation and prediction…

Statistics Theory · Mathematics 2025-09-18 Alden Green , Elad Romanov