English
Related papers

Related papers: Large deviations for the largest eigenvalue of Gau…

200 papers

Consider the Erd\H{o}s-Renyi random graph on n vertices where each edge is present independently with probability c/n, with c>0 fixed. For large n, a typical random graph locally behaves like a Galton-Watson tree with Poisson offspring…

Probability · Mathematics 2016-04-08 Charles Bordenave , Pietro Caputo

The gradient noise (GN) in the stochastic gradient descent (SGD) algorithm is often considered to be Gaussian in the large data regime by assuming that the \emph{classical} central limit theorem (CLT) kicks in. This assumption is often made…

Machine Learning · Statistics 2019-12-03 Umut Şimşekli , Mert Gürbüzbalaban , Thanh Huy Nguyen , Gaël Richard , Levent Sagun

We establish large deviations estimates for the largest eigenvalue of Wigner matrices with sub-Gaussian entries. Under technical assumptions, we show that the large deviation behavior of the largest eigenvalue is universal for small…

Probability · Mathematics 2023-03-01 Fanny Augeri , Alice Guionnet , Jonathan Husson

We study the probability distribution function $P(\lambda)$ of the largest eigenvalue $\lambda_{\rm max}$ of $N \times N$ random matrices of the form $H + V$, where $H$ belongs to the GOE/GUE ensemble and $V$ is a full rank deterministic…

Statistical Mechanics · Physics 2025-10-14 Pierre Le Doussal

We consider inhomogeneous Erd\H{o}s-R\'enyi graphs. We suppose that the maximal mean degree $d$ satisfies $d \ll \log n$. We characterize the asymptotic behavior of the $n^{1 - o(1)}$ largest eigenvalues of the adjacency matrix and its…

Probability · Mathematics 2017-04-11 Florent Benaych-Georges , Charles Bordenave , Antti Knowles

We consider an inhomogeneous Erd\H{o}s-R\'enyi random graph $G_N$ with vertex set $[N] = \{1,\dots,N\}$ for which the pair of vertices $i,j \in [N]$, $i\neq j$, is connected by an edge with probability $r(\tfrac{i}{N},\tfrac{j}{N})$,…

Probability · Mathematics 2020-08-20 Arijit Chakrabarty , Rajat Subhra Hazra , Frank den Hollander , Matteo Sfragara

We present a large deviation principle at speed N for the largest eigenvalue of some additively deformed Wigner matrices. In particular this includes Gaussian ensembles with full-rank general deformation. For the non-Gaussian ensembles, the…

Probability · Mathematics 2023-03-22 Benjamin McKenna

The article considers an inhomogeneous Erd\H{o}s-R\"enyi random graph on $\{1,\ldots, N\}$, where an edge is placed between vertices $i$ and $j$ with probability $\varepsilon_N f(i/N,j/N)$, for $i\le j$, the choice being made independent…

Probability · Mathematics 2024-02-28 Arijit Chakrabarty , Sukrit Chakraborty , Rajat Subhra Hazra

We compute the stationary in-degree probability, $P_{in}(k)$, for a growing network model with directed edges and arbitrary out-degree probability. In particular, under preferential linking, we find that if the nodes have a light tail…

Physics and Society · Physics 2008-10-21 Daniel Fraiman

We compute exact asymptotic results for the probability of the occurrence of large deviations of the largest (smallest) eigenvalue of random matrices belonging to the Gaussian orthogonal, unitary and symplectic ensembles. In particular, we…

Statistical Mechanics · Physics 2009-11-13 David S. Dean , Satya N. Majumdar

We derive properties of Latent Variable Models for networks, a broad class of models that includes the widely-used Latent Position Models. These include the average degree distribution, clustering coefficient, average path length and degree…

Methodology · Statistics 2015-06-26 Riccardo Rastelli , Nial Friel , Adrian E. Raftery

Starting with the large deviation principle (LDP) for the Erd\H{o}s-R\'enyi binomial random graph $\mathcal{G}(n,p)$ (edge indicators are i.i.d.), due to Chatterjee and Varadhan (2011), we derive the LDP for the uniform random graph…

Probability · Mathematics 2018-05-01 Amir Dembo , Eyal Lubetzky

A pedagogical account of some aspects of Extreme Value Statistics (EVS) is presented from the somewhat non-standard viewpoint of Large Deviation Theory. We address the following problem: given a set of $N$ i.i.d. random variables…

Statistical Mechanics · Physics 2015-09-02 Pierpaolo Vivo

We consider the Gaussian beta-ensemble when $\beta$ scales with $n$ the number of particles such that $\displaystyle{{n}^{-1}\ll \beta\ll 1}$. Under a certain regime for $\beta$, we show that the largest particle satisfies a large…

Probability · Mathematics 2019-04-16 Cambyse Pakzad

We present an analytical technique to compute the probability of rare events in which the largest eigenvalue of a random matrix is atypically large (i.e.\ the right tail of its large deviations). The results also transfer to the left tail…

Statistical Mechanics · Physics 2021-05-26 Antoine Maillard

We find large deviations rates for consensus-based distributed inference for directed networks. When the topology is deterministic, we establish the large deviations principle and find exactly the corresponding rate function, equal at all…

Information Theory · Computer Science 2016-06-29 Dragana Bajović , José M. F. Moura , João Xavier , Bruno Sinopoli

In recent years, various notions of capacity and complexity have been proposed for characterizing the generalization properties of stochastic gradient descent (SGD) in deep learning. Some of the popular notions that correlate well with the…

Optimization and Control · Mathematics 2021-06-15 Mert Gurbuzbalaban , Umut Şimşekli , Lingjiong Zhu

The upper tail problem in a random graph asks to estimate the probability that the number of copies of some fixed subgraph in an Erd\H{o}s--R\'enyi random graph exceeds its expectation by some constant factor. There has been much exciting…

Combinatorics · Mathematics 2020-10-27 Yang P. Liu , Yufei Zhao

In a series of two papers, we investigate the large deviations and asymptotic behavior of stochastic models of brain neural networks with random interaction coefficients. In this first paper, we take into account the spatial structure of…

Probability · Mathematics 2017-01-05 Tanguy Cabana , Jonathan Touboul

We study cluster sizes in supercritical $d$-dimensional inhomogeneous percolation models with long-range edges -- such as long-range percolation -- and/or heavy-tailed degree distributions -- such as geometric inhomogeneous random graphs…

Probability · Mathematics 2025-11-12 Joost Jorritsma , Júlia Komjáthy , Dieter Mitsche