English
Related papers

Related papers: The spectrum of kernel random matrices

200 papers

We study the spectrum of an asymmetric random matrix with block structured variances. The rows and columns of the random square matrix are divided into $D$ partitions with arbitrary size (linear in $N$). The parameters of the model are the…

Probability · Mathematics 2015-10-28 Johnatan Aljadeff , David Renfrew , Merav Stern

One of the distinguishing characteristics of modern deep learning systems is that they typically employ neural network architectures that utilize enormous numbers of parameters, often in the millions and sometimes even in the billions.…

Machine Learning · Statistics 2021-11-15 Ben Adlam , Jake Levinson , Jeffrey Pennington

We derive the distribution of the eigenvalues of a large sample covariance matrix when the data is dependent in time. More precisely, the dependence for each variable $i=1,...,p$ is modelled as a linear process…

Probability · Mathematics 2012-01-19 Oliver Pfaffel , Eckhard Schlemm

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

In this note, we study the n x n random Euclidean matrix whose entry (i,j) is equal to f (|| Xi - Xj ||) for some function f and the Xi's are i.i.d. isotropic vectors in Rp. In the regime where n and p both grow to infinity and are…

Probability · Mathematics 2012-09-27 Charles Bordenave

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases.…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Yingying Fan , Jinchi Lv

We consider the problem of inferring the interactions between a set of N binary variables from the knowledge of their frequencies and pairwise correlations. The inference framework is based on the Hopfield model, a special case of the Ising…

Statistical Mechanics · Physics 2015-05-27 Simona Cocco , Remi Monasson , Vitor Sessak

Let $n>m$, and let $A$ be an $(m\times n)$-matrix of full rank. Then obviously the estimate $\|Ax\|\leq\|A\|\|x\|$ holds for the euclidean norm of $x$ and $Ax$ and the spectral norm as the assigned matrix norm. We study the sets of all $x$…

Rings and Algebras · Mathematics 2022-03-16 Harry Yserentant

We study some connections between the random moment problem and the random matrix theory. A uniform draw in a space of moments can be lifted into the spectral probability measure of the pair (A,e) where A is a random matrix from a classical…

Probability · Mathematics 2009-09-29 Fabrice Gamboa , Alain Rouault

In this paper, we develop new statistical theory for probabilistic principal component analysis models in high dimensions. The focus is the estimation of the noise variance, which is an important and unresolved issue when the number of…

Statistics Theory · Mathematics 2014-06-23 Damien Passemier , Zhaoyuan Li , Jian-Feng Yao

What is the connection of random matrices with integrable systems? Is this connection really useful? Introducing apprpriate times in the distribution of the ensemble of matrices, one shows that the corresponding distribution of the…

solv-int · Physics 2008-02-03 Pierre van Moerbeke

Periodicity is often studied in timeseries modelling with autoregressive methods but is less popular in the kernel literature, particularly for higher dimensional problems such as in textures, crystallography, and quantum mechanics. Large…

Machine Learning · Statistics 2018-05-15 Anthony Tompkins , Fabio Ramos

We study the singularity probability of n*n random matrices with i.i.d. entries from highly biased discrete distributions. We obtain sharp non-asymptotic bounds for this probability and derive estimates on the least singular values. Our…

Probability · Mathematics 2025-12-12 Zeyan Song

We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete…

Machine Learning · Statistics 2015-11-24 Yang Ning , Tianqi Zhao , Han Liu

The notion of `stable rank' of a matrix is central to the analysis of randomized matrix algorithms, covariance estimation, deep neural networks, and recommender systems. We compare the properties of the stable rank and intrinsic dimension…

Numerical Analysis · Mathematics 2024-12-20 Ilse C. F. Ipsen , Arvind K. Saibaba

Linear statistics, a random variable build out of the sum of the evaluation of functions at the eigenvalues of a N times N random matrix,sum[j=1 to N]f(xj) or tr f(M), is an ubiquitous statistical characteristics in random matrix theory.…

Mathematical Physics · Physics 2019-12-18 Chao Min , Yang Chen

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

We analyze the spectral properties of correlation matrices between distinct statistical systems. Such matrices are intrinsically non symmetric, and lend themselves to extend the spectral analyses usually performed on standard Pearson…

Statistical Finance · Quantitative Finance 2012-06-29 Giacomo Livan , Luca Rebecchi

We address the problem of filling missing entries in a kernel Gram matrix, given a related full Gram matrix. We attack this problem from the viewpoint of regression, assuming that the two kernel matrices can be considered as explanatory…

Quantitative Methods · Quantitative Biology 2011-11-10 Yoshihiro Yamanishi , Jean-Philippe Vert

Patterned random matrices such as the reverse circulant, the symmetric circulant, the Toeplitz and the Hankel matrices and their almost sure limiting spectral distribution (LSD), have attracted much attention. Under the assumption that the…

Probability · Mathematics 2022-03-14 Arup Bose , Koushik Saha , Priyanka Sen