Related papers: Full large deviation principles for the largest ei…
Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…
For a large $n\times m$ Gaussian matrix, we compute the joint statistics, including large deviation tails, of generalized and total variance - the scaled log-determinant $H$ and trace $T$ of the corresponding $n\times n$ covariance matrix.…
Denote by $\lambda_1(A), \ldots, \lambda_n(A)$ the eigenvalues of an $(n\times n)$-matrix $A$. Let $Z_n$ be an $(n\times n)$-matrix chosen uniformly at random from the matrix analogue to the classical $\ell_ p^n$-ball, defined as the set of…
This work is concerned with Freidlin-Wentzell type large deviation principle for a family of multi-scale quasilinear and semilinear stochastic partial differential equations. Employing the weak convergence method and Khasminskii's time…
We determine to leading order the maximum of the characteristic polynomial for Wigner matrices and $\beta$-ensembles. In the special case of Gaussian-divisible Wigner matrices, our method provides universality of the maximum up to…
We consider the exactly solvable model of exponential directed last passage percolation on $\mathbb{Z}^2$ in the large deviation regime. Conditional on the upper tail large deviation event $\mathcal{U}_{\delta}:=\{T_{n}\geq (4+\delta)n\}$…
Consider a real diagonal deterministic matrix $X_n$ of size $n$ with spectral measure converging to a compactly supported probability measure. We perturb this matrix by adding a random finite rank matrix, with delocalized eigenvectors. We…
The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…
We prove the large deviations principle for empirical Bures-Wasserstein barycenters of independent, identically-distributed samples of covariance matrices and covariance operators. As an application, we explore some consequences of our…
We consider real symmetric and complex Hermitian random matrices with the additional symmetry $h_{xy}=h_{N-x,N-y}$. The matrix elements are independent (up to the fourfold symmetry) and not necessarily identically distributed. This ensemble…
One-rank perturbations of Wigner matrices have been closely studied: let $P=\frac{1}{\sqrt{n}}A+\theta vv^T$ with $A=(a_{ij})_{1 \leq i,j \leq n} \in \mathbb{R}^{n \times n}$ symmetric, $(a_{ij})_{1 \leq i \leq j \leq n}$ i.i.d. with…
We study large deviation upper bounds and mean-squared error (MSE) guarantees of a general framework of nonlinear stochastic gradient methods in the online setting, in the presence of heavy-tailed noise. Unlike existing works that rely on…
Random hyperspherical harmonics are Gaussian Laplace eigenfunctions on the unit $d$-dimensional sphere ($d\ge 2$). We study the convergence in Total Variation distance for their nonlinear statistics in the high energy limit, i.e., for…
Although there is an extensive literature on the maxima of Gaussian processes, there are relatively few non-asymptotic bounds on their lower-tail probabilities. The aim of this paper is to develop such a bound, while also allowing for many…
We obtain sharp large deviation estimates for exceedance probabilities in dependent triangular array threshold models with a diverging number of latent factors. The prefactors quantify how latent-factor dependence and tail geometry enter at…
An influential line of recent work has focused on the generalization properties of unregularized gradient-based learning procedures applied to separable linear classification with exponentially-tailed loss functions. The ability of such…
We investigate an additive perturbation of a complex Wishart random matrix and prove that a large deviation principle holds for the spectral measures. The rate function is associated to a vector equilibrium problem coming from logarithmic…
We study large deviation principles for Gaussian processes lifted to the free nilpotent group of step N. We apply this to a large class of Gaussian processes lifted to geometric rough paths. A large deviation principle for enhanced…
The theory of large deviations constitutes a mathematical cornerstone in the foundations of Boltzmann-Gibbs statistical mechanics, based on the additive entropy $S_{BG}=- k_B\sum_{i=1}^W p_i \ln p_i$. Its optimization under appropriate…
We introduce a spectral approach to characterizing the three-dimensional Edwards-Anderson spin glass. By analyzing the eigenvalue statistics of overlap matrices constructed from two-dimensional cross-sections, we identify a crossover from…