English
Related papers

Related papers: Large deviations for the largest eigenvalue of Gau…

200 papers

Although there is an extensive literature on the maxima of Gaussian processes, there are relatively few non-asymptotic bounds on their lower-tail probabilities. The aim of this paper is to develop such a bound, while also allowing for many…

Probability · Mathematics 2021-12-02 Miles E. Lopes , Junwen Yao

Consider the random graph sampled uniformly from the set of all simple graphs with a given degree sequence. Under mild conditions on the degrees, we establish a Large Deviation Principle (LDP) for these random graphs, viewed as elements of…

Probability · Mathematics 2020-11-25 Souvik Dhara , Subhabrata Sen

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

We consider an inhomogeneous Erd\H{o}s-R\'enyi random graph $G_N$ with vertex set $[N] = \{1,\dots,N\}$ for which the pair of vertices $i,j \in [N]$, $i\neq j$, is connected by an edge with probability $r_N(\tfrac{i}{N},\tfrac{j}{N})$,…

Probability · Mathematics 2025-01-08 Rajat Subhra Hazra , Frank den Hollander , Maarten Markering

Consider first passage percolation with identical and independent weight distributions and first passage time ${\rm T}$. In this paper, we study the upper tail large deviations $\mathbb{P}({\rm T}(0,nx)>n(\mu+\xi))$, for $\xi>0$ and $x\neq…

Probability · Mathematics 2023-02-02 Clément Cosco , Shuta Nakajima

Let $X_k$ denote the number of $k$-term arithmetic progressions in a random subset of $\mathbb{Z}/N\mathbb{Z}$ or $\{1, \dots, N\}$ where every element is included independently with probability $p$. We determine the asymptotics of $\log…

Probability · Mathematics 2019-11-12 Bhaswar B. Bhattacharya , Shirshendu Ganguly , Xuancheng Shao , Yufei Zhao

We consider a finite collection of independent Hermitian heavy-tailed random matrices of growing dimension. Our model includes the L\'evy matrices proposed by Bouchaud and Cizeau, as well as sparse random matrices with O(1) non-zero entries…

Probability · Mathematics 2024-09-24 Charles Bordenave , Alice Guionnet , Camille Male

We consider the problem of finding a large clique in an Erd\H{o}s--R\'enyi random graph where we are allowed unbounded computational time but can only query a limited number of edges. Recall that the largest clique in $G \sim G(n,1/2)$ has…

Combinatorics · Mathematics 2024-07-12 Endre Csóka , András Pongrácz

Let $\mathcal A$ be the adjacency matrix of a random $d$-regular graph on $N$ vertices, and we denote its eigenvalues by $\lambda_1\geq \lambda_2\cdots \geq \lambda_{N}$. For $N^{2/3}\ll d\leq N/2$, we prove optimal rigidity estimates of…

Probability · Mathematics 2024-08-01 Yukun He

The injection of heavy-tailed noise into the iterates of stochastic gradient descent (SGD) has garnered growing interest in recent years due to its theoretical and empirical benefits for optimization and generalization. However, its…

Machine Learning · Statistics 2025-05-13 Umut Şimşekli , Mert Gürbüzbalaban , Sinan Yıldırım , Lingjiong Zhu

The eigenvalue density for members of the Gaussian orthogonal and unitary ensembles follows the Wigner semi-circle law. If the Gaussian entries are all shifted by a constant amount c/Sqrt(2N), where N is the size of the matrix, in the large…

Mathematical Physics · Physics 2009-04-21 Kevin E. Bassler , Peter J. Forrester , Norman E. Frankel

We establish a large deviation principle (LDP) for probability graphons, which are symmetric functions from the unit square into the space of probability measures. This notion extends classical graphons and provides a flexible framework for…

Probability · Mathematics 2025-09-18 Pierfrancesco Dionigi , Giulio Zucal

Complex networks in different areas exhibit degree distributions with heavy upper tail. A preferential attachment mechanism in a growth process produces a graph with this feature. We herein investigate a variant of the simple preferential…

Probability · Mathematics 2018-04-18 Angelica Pachon , Laura Sacerdote , Shuyi Yang

We empirically demonstrate that full-batch gradient descent on neural network training objectives typically operates in a regime we call the Edge of Stability. In this regime, the maximum eigenvalue of the training loss Hessian hovers just…

Machine Learning · Computer Science 2022-11-24 Jeremy M. Cohen , Simran Kaur , Yuanzhi Li , J. Zico Kolter , Ameet Talwalkar

We prove a version of Nagaev's theorem for the branching random walk with heavy-tailed associated random walk. For a branching random walk on $\mathbb{R}$ we consider the random measure $Z_n = \sum_{|u|=n} e^{-V_u} \delta_{V_u}$ where…

Probability · Mathematics 2026-03-18 Jakob Stonner

For any fixed simple graph $H=(V,E)$ and any fixed $u>0$, we establish the leading order of the exponential rate function for the probability that the number of copies of $H$ in the Erd\H{o}s--R\'enyi graph $G(n,p)$ exceeds its expectation…

Probability · Mathematics 2020-04-28 Nicholas A. Cook , Amir Dembo

The self averaging properties of conductance $g$ are explored in random resistor networks with a broad distribution of bond strengths $P(g)\simg^{\mu-1}$. Distributions of equivalent conductances are estimated numerically on hierarchical…

Condensed Matter · Physics 2009-10-22 R. F. Angulo , E. Medina

In this paper we study the joint distributional convergence of the largest eigenvalues of the sample covariance matrix of a $p$-dimensional time series with iid entries when $p$ converges to infinity together with the sample size $n$. We…

Probability · Mathematics 2016-08-26 Johannes Heiny , Thomas Mikosch

Distributions of the size of the largest component, in particular the large-deviation tail, are studied numerically for two graph ensembles, for Erdoes-Renyi random graphs with finite connectivity and for two-dimensional bond percolation.…

Disordered Systems and Neural Networks · Physics 2015-05-20 A. K. Hartmann

In dense Erd\H{o}s-R\'enyi random graphs, we are interested in the events where large numbers of a given subgraph occur. The mean behavior of subgraph counts is known, and only recently were the related large deviations results discovered.…

Probability · Mathematics 2014-04-03 Shankar Bhamidi , Jan Hannig , Chia Ying Lee , James Nolen