English
Related papers

Related papers: Pathwise central limit theorem and moderate deviat…

200 papers

In this paper, we characterize the noise of stochastic gradients and analyze the noise-induced dynamics during training deep neural networks by gradient-based optimizers. Specifically, we firstly show that the stochastic gradient noise…

Machine Learning · Computer Science 2021-09-22 Yixin Wu , Rui Luo , Chen Zhang , Jun Wang , Yaodong Yang

This paper develops asymptotic theory for quantile estimation via stochastic gradient descent (SGD) with a constant learning rate. The quantile loss function is neither smooth nor strongly convex. Beyond conventional perspectives and…

Machine Learning · Statistics 2026-04-06 Ziyang Wei , Jiaqi Li , Likai Chen , Wei Biao Wu

We study the stochastic Leray-{\alpha} model of Euler equations with transport noise. We first use weak convergence approach to show the large deviations of the stochastic Leray-{\alpha} model of Euler equations in a suitable scaling limit.…

Analysis of PDEs · Mathematics 2023-05-09 Yong Chen , Yuanyuan Gong

Recent theoretical works have characterized the dynamics of wide shallow neural networks trained via gradient descent in an asymptotic mean-field limit when the width tends towards infinity. At initialization, the random sampling of the…

Probability · Mathematics 2022-03-29 Zhengdao Chen , Grant M. Rotskoff , Joan Bruna , Eric Vanden-Eijnden

In this paper we consider a branching particle system consisting of particles moving according to the Ornstein-Uhlenbeck process in $\Rd$ and undergoing a binary, supercritical branching with a constant rate $\lambda>0$. This system is…

Probability · Mathematics 2011-11-23 Radosław Adamczak , Piotr Miłoś

We consider N single server infinite buffer queues with service rate \beta. Customers arrive at rate N\alpha, choose L queues uniformly, and join the shortest. We study the processes R^N for large N, where R^N_t(k) is the fraction of queues…

Probability · Mathematics 2007-05-23 Carl Graham

A law of large numbers and a central limit theorem are derived for linear statistics of random symmetric matrices whose on-or-above diagonal entries are independent, but neither necessarily identically distributed, nor necessarily all of…

Probability · Mathematics 2007-05-23 Greg Anderson , Ofer Zeitouni

The work concerns deviation estimates for multivalued McKean-Vlasov stochastic differential equations. First of all, we prove the large deviation principle for them by the weak convergence approach. Then the central limit theorem for them…

Probability · Mathematics 2022-08-10 Kun Fang , Huijie Qiao

This paper introduces a comprehensive extension of the path integral formalism to model stochastic processes with arbitrary multiplicative noise. To do so, It\^o diffusive process is generalized by incorporating a multiplicative noise term…

Mathematical Physics · Physics 2025-03-06 F. S. Abril-Bermúdez , C. J. Quimbay , J. E. Trinidad-Segovia , M. A Sánchez-Granero

A Langevin equation with multiplicative noise is an equation schematically of the form dq/dt = - F(q) + e(q) xi, where e(q) xi is Gaussian white noise whose amplitude e(q) depends on q itself. I show how to convert such equations into path…

High Energy Physics - Phenomenology · Physics 2010-02-16 Peter Arnold

Stochastic gradient descent (SGD) has emerged as the quintessential method in a data scientist's toolbox. Using SGD for high-stakes applications requires, however, careful quantification of the associated uncertainty. Towards that end, in…

Statistics Theory · Mathematics 2025-10-24 Bhavya Agrawalla , Krishnakumar Balasubramanian , Promit Ghosal

We consider nonlinear parabolic evolution equations of the form $\partial_{t}u=F(t,x,Du,D^{2}u) $, subject to noise of the form $H(x,Du) \circ dB$ where $H$ is linear in $Du$ and $\circ dB$ denotes the Stratonovich differential of a…

Analysis of PDEs · Mathematics 2010-11-09 Michael Caruana , Peter Friz , Harald Oberhauser

Combining fractional calculus and the Rough Path Theory we study the existence and uniqueness of mild solutions to evolutions equations driven by a H\"older continuous function with H\"older exponent in $(1/3,1/2)$. Our stochastic integral…

Analysis of PDEs · Mathematics 2013-05-06 María J. Garrido-Atienza , Kening Lu , Björn Schmalfuss

We deduce sufficient conditions for the Central Limit Theorem (CLT) in the Lebesgue-Riesz space L(p) defined on some measure space for the sequence of centered random variables satisfying the strong mixing (Rosenblatt) condition. We…

Probability · Mathematics 2019-12-05 M. R. Formica , E. Ostrovsky , L. Sirota

Let ${\cal T}$ be a rooted Galton-Watson tree with offspring distribution $\{p_k\}$ that has $p_0=0$, mean $m=\sum kp_k>1$ and exponential tails. Consider the $\lambda$-biased random walk $\{X_n\}_{n\geq 0}$ on ${\cal T}$; this is the…

Probability · Mathematics 2007-05-23 Yuval Peres , Ofer Zeitouni

We produce a series of Central Limit Theorems (CLTs) associated to compact metric measure spaces $(K,d,\eta)$, with $\eta$ a reasonable probability measure. For the first CLT, we can ignore $\eta$ by isometrically embedding $K$ into…

Probability · Mathematics 2020-01-14 Steven Rosenberg , Jie Xu

In this paper, we consider a class of reflected stochastic differential equations for which the constraint is not on the paths of the solution but on its law. We establish a small noise large deviation principle, a large deviation for short…

Probability · Mathematics 2023-03-27 Ping Chen , Jianliang Zhai

The question of whether the central limit theorem (CLT) holds for the total number of edges in exponential random graph models (ERGMs) in the subcritical region of parameters has remained an open problem. In this paper, we establish the…

Probability · Mathematics 2025-04-09 Xiao Fang , Song-Hao Liu , Qi-Man Shao , Yi-Kun Zhao

We consider block codes whose rate converges to the channel capacity with increasing block length at a certain speed and examine the best possible decay of the probability of error. We prove that a moderate deviation principle holds for all…

Information Theory · Computer Science 2015-03-20 Yucel Altug , Aaron B. Wagner

We investigate a class of stochastic partial differential equations of reaction-diffusion type defined on graphs, which can be derived as the limit of SPDEs on narrow planar channels. In the first part, we demonstrate that this limit can be…

Probability · Mathematics 2024-03-21 Sandra Cerrai , Wen-Tai Hsu