English
Related papers

Related papers: On Random Matrices Arising in Deep Neural Networks…

200 papers

For a random matrix of entries sampled independently from a fairly general distribution in Z we study the probability that the cokernel is isomorphic to a given finite abelian group, or when it is cyclic. This includes the probability that…

Probability · Mathematics 2018-06-05 Hoi H. Nguyen , Melanie Matchett Wood

Applying the concept of matricial freeness which generalizes freeness in free probability, we have recently studied asymptotic joint distributions of symmetric blocks of Gaussian random matrices (Gaussian Symmetric Block Ensemble). This…

Operator Algebras · Mathematics 2018-05-28 Romuald Lenczewski

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

We study the convergence properties of a pair of learning algorithms (learning with and without memory). This leads us to study the dominant eigenvalue of a class of random matrices. This turns out to be related to the roots of the…

Probability · Mathematics 2007-05-23 Natalia Komarova , Igor Rivin

Covariance matrices of amino acid displacements, commonly used to characterize the large-scale movements of proteins, are investigated through the prism of Random Matrix Theory. Bulk universality is detected in the local spacing statistics…

Quantitative Methods · Quantitative Biology 2013-05-29 Raffaello Potestio , Fabio Caccioli , Pierpaolo Vivo

In this paper, we study random matrix models which are obtained as a non-commutative polynomial in random matrix variables of two kinds: (a) a first kind which have a discrete spectrum in the limit, (b) a second kind which have a joint…

Probability · Mathematics 2018-09-17 Benoit Collins , Takahiro Hasebe , Noriyoshi Sakuma

This is a course on Random Matrix Theory which includes traditional as well as advanced topics presented with an extensive use of classical logarithmic plasma analogy and that of the quantum systems of one-dimensional interacting fermions…

Disordered Systems and Neural Networks · Physics 2012-08-24 V. E. Kravtsov

We place ourselves in the setting of high-dimensional statistical inference, where the number of variables $p$ in a data set of interest is of the same order of magnitude as the number of observations $n$. More formally, we study the…

Probability · Mathematics 2009-12-11 Noureddine El Karoui

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

Covariance matrix estimation arises in multivariate problems including multivariate normal sampling models and regression models where random effects are jointly modeled, e.g. random-intercept, random-slope models. A Bayesian analysis of…

Methodology · Statistics 2016-07-14 Ignacio Alvarez , Jarad Niemi , Matt Simpson

We show that, within a finite window of parameter space, random matrix theory (RMT) statistics emerge in observables of a finite-volume massive free scalar field theory after a local operator quench. The spacing-ratio distribution of…

High Energy Physics - Theory · Physics 2026-05-12 Dmitry S. Ageev , Vasilii V. Pushkarev

I use quaternion free probability calculus - an extension of free probability to non-Hermitian matrices (which is introduced in a succinct but self-contained way) - to derive in the large-size limit the mean densities of the eigenvalues and…

Mathematical Physics · Physics 2015-05-20 Andrzej Jarosz

In this study, we consider the realm of covariance matrices in machine learning, particularly focusing on computing Fr\'echet means on the manifold of symmetric positive definite matrices, commonly referred to as Karcher or geometric means.…

Machine Learning · Statistics 2024-06-06 Florent Bouchard , Ammar Mian , Malik Tiomoko , Guillaume Ginolhac , Frédéric Pascal

We consider a random matrix whose entries are independent Gaussian variables taking values in the field of quaternions with variance $1/n$. Using logarithmic potential theory, we prove the almost sure convergence, as the dimension $n$ goes…

Probability · Mathematics 2011-09-05 Florent Benaych-Georges , Francois Chapon

We study asymptotic properties of expectation propagation (EP) -- a method for approximate inference originally developed in the field of machine learning. Applied to generalized linear models, EP iteratively computes a multivariate…

Information Theory · Computer Science 2018-05-11 Burak Çakmak , Manfred Opper

We study a class of random matrices that appear in several communication and signal processing applications, and whose asymptotic eigenvalue distribution is closely related to the reconstruction error of an irregularly sampled bandlimited…

Information Theory · Computer Science 2008-06-24 Alessandro Nordio , Carla-Fabiana Chiasserini , Emanuele Viterbo

In this paper we describe a strategy to study the Anderson model of an electron in a random potential at weak coupling by a renormalization group analysis. There is an interesting technical analogy between this problem and the theory of…

Condensed Matter · Physics 2009-10-28 J. Magnen , G. Poirot , V. Rivasseau

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

Modern datasets are often in the form of matrices or arrays,potentially having correlations along each set of data indices. For example, data involving repeated measurements of several variables over time may exhibit temporal correlation as…

Methodology · Statistics 2010-08-13 Peter D. Hoff

Probabilistic programs encode stochastic models as ordinary-looking programs with primitives for sampling numbers from predefined distributions and conditioning. Their applications include, among many others, machine learning and modeling…

Formal Languages and Automata Theory · Computer Science 2025-12-16 Dominik Geißler , Tobias Winkler
‹ Prev 1 8 9 10 Next ›