English
Related papers

Related papers: Large deviations for the largest eigenvalue of Gau…

200 papers

We consider preferential attachment random graphs which may be obtained as follows: It starts with a single node. If a new node appears, it is linked by an edge to one or more existing node(s) with a probability proportional to function of…

Probability · Mathematics 2015-01-29 K. Doku-Amponsah , F. O. Mettle , E. N. N. Nortey

In this paper we derive results concerning the connected components and the diameter of random graphs with an arbitrary i.i.d. degree sequence. We study these properties primarily, but not exclusively, when the tail of the degree…

Probability · Mathematics 2007-05-23 Remco van der Hofstad , Gerard Hooghiemstra , Dmitri Znamenski

Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and…

Optimization and Control · Mathematics 2026-05-19 Begoña García Malaxechebarría , Courtney Paquette , Maryam Fazel , Dmitriy Drusvyatskiy

Let $M_n$ be the maximum of $n$ zero-mean gaussian variables $X_1,..,X_n$ with covariance matrix of minimum eigenvalue $\lambda$ and maximum eigenvalue $\Lambda$. Then, for $n \ge 70$, $$\Pr\{M_n \ge \lambda \left (2 \log n - 2.5 - \log(2…

Statistics Theory · Mathematics 2013-12-05 J. A. Hartigan

For a finite, simple, and undirected graph $G$ with $n$ vertices, $m$ edges, and largest eigenvalue $\lambda$, Nikiforov introduced the degree deviation of $G$ as $s=\sum_{u\in V(G)}\left|d_G(u)-\frac{2m}{n}\right|$. Contributing to a…

Combinatorics · Mathematics 2024-09-24 Dieter Rautenbach , Florian Werner

This contribution establishes exact tail asymptotics of $\sup_{(s,t)\in\mathbf{E}}$ $X(s,t)$ for a large class of nonhomogeneous Gaussian random fields $X$ on a bounded convex set $\mathbf{E}\subset\mathbb{R}^2$, with variance function that…

Probability · Mathematics 2016-03-16 Krzysztof Dȩbicki , Enkelejd Hashorva , Lanpeng Ji

We study the near-critical behavior of the sparse Erd\H{o}s-R\'enyi random graph $\mathcal{G}(n,p)$ on $n\gg1$ vertices, where the connection probability $p$ satisfies $np = 1+\theta(b_n^2/n)^{1/3}$, with $n^{3/10}\ll {b_n}\ll n^{1/2}$, and…

Probability · Mathematics 2023-12-29 Luisa Andreis , Gianmarco Bet , Maxence Phalempin

Large deviations for fat tailed distributions, i.e. those that decay slower than exponential, are not only relatively likely, but they also occur in a rather peculiar way where a finite fraction of the whole sample deviation is concentrated…

Statistical Mechanics · Physics 2015-06-03 Mario Filiasi , Giacomo Livan , Matteo Marsili , Maria Peressi , Erik Vesselli , Elia Zarinelli

We investigate theoretical guarantees for the false-negative rate (FNR) -- the fraction of true causal edges whose orientation is not recovered, under single-variable random interventions and an $\epsilon$-interventional faithfulness…

Machine Learning · Computer Science 2025-11-05 Mathieu Chevalley , Arash Mehrjou , Patrick Schwab

This paper develops a general approach to characterize the long-time trajectory behavior of nonconvex gradient descent in generalized single-index models in the large aspect ratio regime. In this regime, we show that for each iteration the…

Machine Learning · Computer Science 2025-09-16 Qiyang Han

We consider the branching random walk on the real line where the underlying motion is of a simple random walk and branching is at least binary and at most decaying exponentially in law. It is well known that the normalized empirical measure…

Probability · Mathematics 2012-07-11 Oren Louidor , Will Perkins

This article studies the infinite-width limit of deep feedforward neural networks whose weights are dependent, and modelled via a mixture of Gaussian distributions. Each hidden node of the network is assigned a nonnegative random variable…

Machine Learning · Statistics 2025-02-06 Hoil Lee , Fadhel Ayed , Paul Jung , Juho Lee , Hongseok Yang , François Caron

There is an increasing realization that algorithmic inductive biases are central in preventing overfitting; empirically, we often see a benign overfitting phenomenon in overparameterized settings for natural learning algorithms, such as…

Machine Learning · Computer Science 2021-10-14 Difan Zou , Jingfeng Wu , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

In this paper, we study the upper tail large deviation for the one-dimensional frog model. In this model, sleeping and active frogs are assigned to vertices on $\mathbb Z$. While sleeping frogs do not move, the active ones move as…

Probability · Mathematics 2023-12-06 Van Hao Can , Naoki Kubota , Shuta Nakajima

Recent findings by Cohen et al., 2021, demonstrate that when training neural networks using full-batch gradient descent with a step size of $\eta$, the largest eigenvalue $\lambda_{\max}$ of the full-batch Hessian consistently stabilizes…

Machine Learning · Computer Science 2025-12-30 Arseniy Andreyev , Pierfrancesco Beneventano

Symmetric tridiagonal matrices appear ubiquitously in mathematical physics, serving as the matrix representation of discrete random Schr\"odinger operators. In this work we investigate the top eigenvalue of these matrices in the large…

Probability · Mathematics 2025-06-04 Yi Han

Whilst deep neural networks have shown great empirical success, there is still much work to be done to understand their theoretical properties. In this paper, we study the relationship between random, wide, fully connected, feedforward…

Machine Learning · Statistics 2018-08-17 Alexander G. de G. Matthews , Mark Rowland , Jiri Hron , Richard E. Turner , Zoubin Ghahramani

We consider the Erd\"{o}s--R\'{e}nyi random graph $G_{n,p}$ and we analyze the simple irreversible epidemic process on the graph, known in the literature as bootstrap percolation. We give a quantitative version of some results by Janson et…

Probability · Mathematics 2020-01-17 Giovanni Luca Torrisi , Michele Garetto , Emilio Leonardi

We study the probability distribution of the index ${\mathcal N}_+$, i.e., the number of positive eigenvalues of an $N\times N$ Gaussian random matrix. We show analytically that, for large $N$ and large $\mathcal{N}_+$ with the fraction…

Statistical Mechanics · Physics 2015-03-17 Satya N. Majumdar , Céline Nadal , Antonello Scardicchio , Pierpaolo Vivo

The problem of community detection receives great attention in recent years. Many methods have been proposed to discover communities in networks. In this paper, we propose a Gaussian stochastic blockmodel that uses Gaussian distributions to…

Social and Information Networks · Computer Science 2015-03-19 Junhao Zhang , Tongfei Chen , Junfeng Hu