中文
相关论文

相关论文: Largest Eigenvalues of the Conjugate Kernel of Sin…

200 篇论文

This paper is concerned with the asymptotic empirical eigenvalue distribution of a non linear random matrix ensemble. More precisely we consider $M= \frac{1}{m} YY^*$ with $Y=f(WX)$ where $W$ and $X$ are random rectangular matrices with…

概率论 · 数学 2022-01-14 Lucas Benigni , Sandrine Péché

Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) defined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue…

机器学习 · 统计学 2024-02-16 Zhichao Wang , Denny Wu , Zhou Fan

We compute the asymptotic eigenvalue distribution of the neural tangent kernel of a two-layer neural network under a specific scaling of dimension. Namely, if $X\in\mathbb{R}^{n\times d}$ is an i.i.d random matrix, $W\in\mathbb{R}^{d\times…

概率论 · 数学 2025-08-28 Lucas Benigni , Elliot Paquette

We study the eigenvalue distributions of the Conjugate Kernel and Neural Tangent Kernel associated to multi-layer feedforward neural networks. In an asymptotic regime where network width is increasing linearly in sample size, under random…

机器学习 · 统计学 2020-10-13 Zhou Fan , Zhichao Wang

We study the asymptotic spectral distribution of the conjugate kernel random matrix $YY^\top$, where $Y= f(WX)$ arises from a two-layer neural network model. We consider the setting where $W$ and $X$ are random rectangular matrices with…

概率论 · 数学 2026-01-07 Alice Guionnet , Vanessa Piccolo

In this paper, we investigate the eigenvalue distribution of a class of kernel random matrices whose $(i,j)$-th entry is $f(X_i,X_j)$ where $f$ is a symmetric function belonging to the Paley-Wiener space $\mathcal{B}_c$ and $(X_i)_{1\leq i…

统计理论 · 数学 2025-07-22 Jebalia Mohamed , Ahmed Souabni

Let $X$ be a $p\times n$ independent identically distributed real Gaussian matrix with positive mean $\mu $ and variance $\sigma^2$ entries. The goal of this paper is to investigate the largest eigenvalue of the noncentral sample covariance…

概率论 · 数学 2024-11-07 Huihui Cheng , Minjie Song

This short note studies the fluctuations of the largest eigenvalue of symmetric random matrices with correlated Gaussian entries having positive mean. Under the assumption that the covariance kernel is absolutely summable, it is proved that…

概率论 · 数学 2024-10-18 Arijit Chakrabarty , Rajat Subhra Hazra , Moumanti Podder

In this work, we investigate the asymptotic spectral density of the random feature matrix $M = Y Y^\ast$ with $Y = f(WX)$ generated by a single-hidden-layer neural network, where $W$ and $X$ are random rectangular matrices with i.i.d.…

机器学习 · 统计学 2021-11-12 Vanessa Piccolo , Dominik Schröder

Joint distribution function of N eigenvalues of U(N) invariant random-matrix ensemble can be interpreted as a probability density to find N fictitious non-interacting fermions to be confined in a one-dimensional space. Within this picture a…

凝聚态物理 · 物理学 2017-02-08 E. Kanzieper , V. Freilikher

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

概率论 · 数学 2021-03-02 Wlodek Bryc , Jack W. Silverstein

In this paper, we characterize the asymptotic and large scale behavior of the eigenvalues of wavelet random matrices in high dimensions. We assume that possibly non-Gaussian, finite-variance $p$-variate measurements are made of a…

统计理论 · 数学 2024-06-11 Patrice Abry , B. Cooper Boniece , Gustavo Didier , Herwig Wendt

In this paper, we investigate a two-layer fully connected neural network of the form $f(X)=\frac{1}{\sqrt{d_1}}\boldsymbol{a}^\top \sigma\left(WX\right)$, where $X\in\mathbb{R}^{d_0\times n}$ is a deterministic data matrix,…

统计理论 · 数学 2023-04-17 Zhichao Wang , Yizhe Zhu

In this paper, the exact distribution of the largest eigenvalue of a singular random matrix for multivariate analysis of variance (MANOVA) is discussed. The key to developing the distribution theory of eigenvalues of a singular random…

统计理论 · 数学 2021-03-17 Koki Shimizu , Hiroki Hashiguchi

We consider the asymptotic fluctuation behavior of the largest eigenvalue of certain sample covariance matrices in the asymptotic regime where both dimensions of the corresponding data matrix go to infinity. More precisely, let $X$ be an…

概率论 · 数学 2009-09-29 Noureddine El Karoui

This article investigates the eigenspectrum of the inner product-type kernel matrix $\sqrt{p} \mathbf{K}=\{f( \mathbf{x}_i^{\sf T} \mathbf{x}_j/\sqrt{p})\}_{i,j=1}^n $ under a binary mixture model in the high dimensional regime where the…

机器学习 · 统计学 2019-09-17 Zhenyu Liao , Romain Couillet

We study the Conjugate Kernel associated to a multi-layer linear-width feed-forward neural network with random weights, biases and data. We show that the empirical spectral distribution of the Conjugate Kernel converges to a deterministic…

概率论 · 数学 2023-06-12 Clément Chouard

The article considers an inhomogeneous Erd\H{o}s-R\"enyi random graph on $\{1,\ldots, N\}$, where an edge is placed between vertices $i$ and $j$ with probability $\varepsilon_N f(i/N,j/N)$, for $i\le j$, the choice being made independent…

概率论 · 数学 2024-02-28 Arijit Chakrabarty , Sukrit Chakraborty , Rajat Subhra Hazra

In this article, we explore the spectral properties of general random kernel matrices $[K(U_i,U_j)]_{1\leq i\neq j\leq n}$ from a Lipschitz kernel $K$ with $n$ independent random variables $U_1,U_2,\ldots, U_n$ distributed uniformly over…

概率论 · 数学 2025-08-22 Anirban Chatterjee , Jiaoyang Huang

Given a large sample covariance matrix $S_N=\frac 1n\Gamma_N^{1/2}Z_N Z_N^*\Gamma_N^{1/2}\, ,$ where $Z_N$ is a $N\times n$ matrix with i.i.d. centered entries, and $\Gamma_N$ is a $N\times N$ deterministic Hermitian positive semidefinite…

概率论 · 数学 2021-01-08 Florence Merlevède , Jamal Najim , Peng Tian
‹ 上一页 1 2 3 10 下一页 ›