Related papers: Pathwise central limit theorem and moderate deviat…
In this paper, we characterize the noise of stochastic gradients and analyze the noise-induced dynamics during training deep neural networks by gradient-based optimizers. Specifically, we firstly show that the stochastic gradient noise…
This paper develops asymptotic theory for quantile estimation via stochastic gradient descent (SGD) with a constant learning rate. The quantile loss function is neither smooth nor strongly convex. Beyond conventional perspectives and…
We study the stochastic Leray-{\alpha} model of Euler equations with transport noise. We first use weak convergence approach to show the large deviations of the stochastic Leray-{\alpha} model of Euler equations in a suitable scaling limit.…
Recent theoretical works have characterized the dynamics of wide shallow neural networks trained via gradient descent in an asymptotic mean-field limit when the width tends towards infinity. At initialization, the random sampling of the…
In this paper we consider a branching particle system consisting of particles moving according to the Ornstein-Uhlenbeck process in $\Rd$ and undergoing a binary, supercritical branching with a constant rate $\lambda>0$. This system is…
We consider N single server infinite buffer queues with service rate \beta. Customers arrive at rate N\alpha, choose L queues uniformly, and join the shortest. We study the processes R^N for large N, where R^N_t(k) is the fraction of queues…
A law of large numbers and a central limit theorem are derived for linear statistics of random symmetric matrices whose on-or-above diagonal entries are independent, but neither necessarily identically distributed, nor necessarily all of…
The work concerns deviation estimates for multivalued McKean-Vlasov stochastic differential equations. First of all, we prove the large deviation principle for them by the weak convergence approach. Then the central limit theorem for them…
This paper introduces a comprehensive extension of the path integral formalism to model stochastic processes with arbitrary multiplicative noise. To do so, It\^o diffusive process is generalized by incorporating a multiplicative noise term…
A Langevin equation with multiplicative noise is an equation schematically of the form dq/dt = - F(q) + e(q) xi, where e(q) xi is Gaussian white noise whose amplitude e(q) depends on q itself. I show how to convert such equations into path…
Stochastic gradient descent (SGD) has emerged as the quintessential method in a data scientist's toolbox. Using SGD for high-stakes applications requires, however, careful quantification of the associated uncertainty. Towards that end, in…
We consider nonlinear parabolic evolution equations of the form $\partial_{t}u=F(t,x,Du,D^{2}u) $, subject to noise of the form $H(x,Du) \circ dB$ where $H$ is linear in $Du$ and $\circ dB$ denotes the Stratonovich differential of a…
Combining fractional calculus and the Rough Path Theory we study the existence and uniqueness of mild solutions to evolutions equations driven by a H\"older continuous function with H\"older exponent in $(1/3,1/2)$. Our stochastic integral…
We deduce sufficient conditions for the Central Limit Theorem (CLT) in the Lebesgue-Riesz space L(p) defined on some measure space for the sequence of centered random variables satisfying the strong mixing (Rosenblatt) condition. We…
Let ${\cal T}$ be a rooted Galton-Watson tree with offspring distribution $\{p_k\}$ that has $p_0=0$, mean $m=\sum kp_k>1$ and exponential tails. Consider the $\lambda$-biased random walk $\{X_n\}_{n\geq 0}$ on ${\cal T}$; this is the…
We produce a series of Central Limit Theorems (CLTs) associated to compact metric measure spaces $(K,d,\eta)$, with $\eta$ a reasonable probability measure. For the first CLT, we can ignore $\eta$ by isometrically embedding $K$ into…
In this paper, we consider a class of reflected stochastic differential equations for which the constraint is not on the paths of the solution but on its law. We establish a small noise large deviation principle, a large deviation for short…
The question of whether the central limit theorem (CLT) holds for the total number of edges in exponential random graph models (ERGMs) in the subcritical region of parameters has remained an open problem. In this paper, we establish the…
We consider block codes whose rate converges to the channel capacity with increasing block length at a certain speed and examine the best possible decay of the probability of error. We prove that a moderate deviation principle holds for all…
We investigate a class of stochastic partial differential equations of reaction-diffusion type defined on graphs, which can be derived as the limit of SPDEs on narrow planar channels. In the first part, we demonstrate that this limit can be…