English
Related papers

Related papers: Spiked Singular Values and Vectors under Extreme A…

200 papers

In this paper, we consider the singular values and singular vectors of low rank perturbations of large rectangular random matrices, in the regime the matrix is "long": we allow the number of rows (columns) to grow polynomially in the number…

Probability · Mathematics 2021-10-22 Gérard Ben Arous , Daniel Zhengyu Huang , Jiaoyang Huang

Across many disciplines from neuroscience and genomics to machine learning, atmospheric science and finance, the problems of denoising large data matrices to recover signals obscured by noise, and of estimating the structure of these…

Data Analysis, Statistics and Probability · Physics 2023-12-06 Itamar D. Landau , Gabriel C. Mel , Surya Ganguli

The classical random matrix theory is mostly focused on asymptotic spectral properties of random matrices as their dimensions grow to infinity. At the same time many recent applications from convex geometry to functional analysis to…

Functional Analysis · Mathematics 2014-03-05 Mark Rudelson , Roman Vershynin

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

Relying on random matrix theory (RMT), this paper studies asymmetric order-$d$ spiked tensor models with Gaussian noise. Using the variational definition of the singular vectors and values of (Lim, 2005), we show that the analysis of the…

Probability · Mathematics 2022-11-22 Mohamed El Amine Seddik , Maxime Guillaud , Romain Couillet

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

Asymptotic behavior of the singular value decomposition (SVD) of blown up matrices and normalized blown up contingency tables exposed to Wigner-noise is investigated.It is proved that such an m\times n matrix almost surely has a constant…

Probability · Mathematics 2010-01-11 Marianna Bolla , Katalin Friedl , Andras Kramli

Computing the first few singular vectors of a large matrix is a problem that frequently comes up in statistics and numerical analysis. Given the presence of noise, exact calculation is hard to achieve, and the following problem is of…

Numerical Analysis · Mathematics 2010-04-13 Van Vu

The spectral form factor of random matrix theory plays a key role in the description of disordered and chaotic quantum systems. While its moments are known to be approximately Gaussian, corrections subleading in the matrix dimension, $D$,…

Quantum Physics · Physics 2026-01-06 Alex Altland , Francisco Divi , Tobias Micklitz , Silvia Pappalardi , Maedeh Rezaei

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

Machine Learning · Statistics 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

Consider large signal-plus-noise data matrices of the form $S + \Sigma^{1/2} X$, where $S$ is a low-rank deterministic signal matrix and the noise covariance matrix $\Sigma$ can be anisotropic. We establish the asymptotic joint distribution…

Statistics Theory · Mathematics 2024-01-23 Zeqin Lin , Guangming Pan , Peng Zhao , Jia Zhou

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

Probability · Mathematics 2021-03-02 Wlodek Bryc , Jack W. Silverstein

Using a nonperturbative approach we examine the large frequency asymptotics of the two-point level density correlator in weakly disordered metallic grains. This allows us to study the behavior of the two-level structure factor close to the…

Condensed Matter · Physics 2016-08-31 A. V. Andreev , B. L. Altshuler

We study the asymptotic behavior of the spectrum of a random matrix where a non-linearity is applied entry-wise to a Wigner matrix perturbed by a rank-one spike with independent and identically distributed entries. In this setting, we show…

Probability · Mathematics 2023-10-24 Alice Guionnet , Justin Ko , Florent Krzakala , Pierre Mergny , Lenka Zdeborová

We consider the edge statistics of large dimensional deformed rectangular matrices of the form $Y_t=Y+\sqrt{t}X,$ where $Y$ is a $p \times n$ deterministic signal matrix whose rank is comparable to $n$, $X$ is a $p\times n$ random noise…

Probability · Mathematics 2022-05-25 Xiucai Ding , Fan Yang

We provide a new robust convergence analysis of the well-known power method for computing the dominant singular vectors of a matrix that we call the noisy power method. Our result characterizes the convergence behavior of the algorithm when…

Data Structures and Algorithms · Computer Science 2015-02-05 Moritz Hardt , Eric Price

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

We perform a non-asymptotic analysis on the singular vector distribution under Gaussian noise. In particular, we provide sufficient conditions on a matrix for its first few singular vectors to have near normal distribution. Our result can…

Numerical Analysis · Mathematics 2014-12-12 Rongrong Wang

We study the asymptotic spectral behavior of high-dimensional random Gram matrices with sparsity and a variance profile, motivated by applications in wireless communications. Specifically, we consider the Gram matrices $\mathbf S_n=\mathbf…

Statistics Theory · Mathematics 2026-02-10 Rui Wang , Guangming Pan , Dandan Jiang
‹ Prev 1 2 3 10 Next ›