English
Related papers

Related papers: Eigenvalue distribution of the Neural Tangent Kern…

200 papers

We study the eigenvalue distributions of the Conjugate Kernel and Neural Tangent Kernel associated to multi-layer feedforward neural networks. In an asymptotic regime where network width is increasing linearly in sample size, under random…

Machine Learning · Statistics 2020-10-13 Zhou Fan , Zhichao Wang

This paper is concerned with the asymptotic empirical eigenvalue distribution of a non linear random matrix ensemble. More precisely we consider $M= \frac{1}{m} YY^*$ with $Y=f(WX)$ where $W$ and $X$ are random rectangular matrices with…

Probability · Mathematics 2022-01-14 Lucas Benigni , Sandrine Péché

This paper is concerned with the asymptotic distribution of the largest eigenvalues for some nonlinear random matrix ensemble stemming from the study of neural networks. More precisely we consider $M= \frac{1}{m} YY^\top$ with $Y=f(WX)$…

Probability · Mathematics 2022-01-14 Lucas Benigni , Sandrine Péché

We study a class of random matrices that appear in several communication and signal processing applications, and whose asymptotic eigenvalue distribution is closely related to the reconstruction error of an irregularly sampled bandlimited…

Information Theory · Computer Science 2008-06-24 Alessandro Nordio , Carla-Fabiana Chiasserini , Emanuele Viterbo

We use the steepest descents method to study the integral kernel of a family of normal random matrix ensembles with eigenvalue distribution P_{N}(z_{1},...,z_{N}) = Z_{N}^{-1} e^{-N\Sigma_{i=1}^{N}V_{\alpha}(z_{i})}…

Mathematical Physics · Physics 2015-05-28 Alexei M. Veneziani , Tiago Pereira , Domingos H. U. Marchetti

In the present work, eigenvalue distributions defined by a random rectangular matrix whose components are neither independently nor identically distributed are analyzed using replica analysis and belief propagation. In particular, we…

Portfolio Management · Quantitative Finance 2016-05-24 Takashi Shinzato

In this paper, we consider a data matrix $X_N\in\mathbb{R}^{N\times p}$ where all the rows are i.i.d. samples in $\mathbb{R}^p$ of mean zero and covariance matrix $\Sigma\in\mathbb{R}^{p\times p}$. Here the population matrix $\Sigma$ is of…

Probability · Mathematics 2013-05-06 Dai Shi

In this paper, we investigate the eigenvalue distribution of a class of kernel random matrices whose $(i,j)$-th entry is $f(X_i,X_j)$ where $f$ is a symmetric function belonging to the Paley-Wiener space $\mathcal{B}_c$ and $(X_i)_{1\leq i…

Statistics Theory · Mathematics 2025-07-22 Jebalia Mohamed , Ahmed Souabni

In this note, we prove that if $X\in\mathbb{R}^{n\times d}$ and $Y\in\mathbb{R}^{n\times p}$ are two independent matrices with i.i.d entries then the empirical spectral distribution of $\frac{1}{d}XX^\top \odot \frac{1}{p}YY^\top$, where…

Probability · Mathematics 2025-02-19 Sebastien Abou Assaly , Lucas Benigni

We consider n-by-n matrices whose (i, j)-th entry is f(X_i^T X_j), where X_1, ...,X_n are i.i.d. standard Gaussian random vectors in R^p, and f is a real-valued function. The eigenvalue distribution of these random kernel matrices is…

Probability · Mathematics 2012-03-26 Xiuyuan Cheng , Amit Singer

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue distributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be derived directly as a consequence of two common…

Information Theory · Computer Science 2007-07-13 Matthew J. M. Peacock , Iain B. Collings , Michael L. Honig

We study random matrices acting on tensor product spaces which have been transformed by a linear block operation. Using operator-valued free probability theory, under some mild assumptions on the linear map acting on the blocks, we compute…

Probability · Mathematics 2016-01-26 Octavio Arizmendi , Ion Nechita , Carlos Vargas

In this paper, we consider N-dimensional real Wishart matrices Y in the class $W_{\mathbb{R}}(\Sigma,M)$ in which all but one eigenvalues of $\Sigma$ is 1. Let the non-trivial eigenvalue of $\Sigma$ be $1+\tau$, then as N,…

Probability · Mathematics 2011-01-27 M. Y. Mo

Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) defined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue…

Machine Learning · Statistics 2024-02-16 Zhichao Wang , Denny Wu , Zhou Fan

Consider a $N\times n$ random matrix $Y_n=(Y_{ij}^{n})$ where the entries are given by $Y_{ij}^{n}=\frac{\sigma(i/N,j/n)}{\sqrt{n}} X_{ij}^{n}$, the $X_{ij}^{n}$ being centered i.i.d. and $\sigma:[0,1]^2 \to (0,\infty)$ being a continuous…

Probability · Mathematics 2007-06-13 W. Hachem , P. Loubaton , J. Najim

We analyze the form of the probability distribution function P_{n}^{(\beta)}(w) of the Schmidt-like random variable w = x_1^2/(\sum_{j=1}^n x^{2}_j/n), where x_j are the eigenvalues of a given n \times n \beta-Gaussian random matrix, \beta…

Disordered Systems and Neural Networks · Physics 2015-06-11 M. P. Pato , G. Oshanin

In this paper, we are concerned with higher-order analogues of the Tracy-Widom distribution, which describe the eigenvalue distributions in unitary random matrix models near critical edge points. The associated kernels are constructed by…

Mathematical Physics · Physics 2025-04-22 Dan Dai , Wen-Gao Long , Shuai-Xia Xu , Lu-Ming Yao , Lun Zhang

In random matrix theory, Marchenko-Pastur law states that random matrices with independent and identically distributed entries have a universal asymptotic eigenvalue distribution under large dimension limit, regardless of the choice of…

High Energy Physics - Theory · Physics 2015-05-12 Xiaochuan Lu , Hitoshi Murayama

In this work we continue the study of the Weyl asymptotics of the distribution of eigenvalues of non-self-adjoint (pseudo)differential operators with small random perturbations, by treating the case of multiplicative perturbations in…

Spectral Theory · Mathematics 2009-12-02 Johannes Sjoestrand

We compute the asymptotic empirical eigenvalue distribution of the matrix $M = \bigodot_{i=1}^k \frac{1}{d_i}X^{(i)}{X^{(i)}}^\top$ where $X^{(i)}\in\mathbb{R}^{n\times d_i}$ are independent matrices with independent rows but general…

Probability · Mathematics 2026-01-14 Lucas Benigni , Ziyad Zaklani
‹ Prev 1 2 3 10 Next ›