Related papers: The ODE Method for Asymptotic Statistics in Stocha…
Let $\{u(t,x)\}_{t>0,x\in{{\mathbb R}^{d}}}$ denote the solution to a $d$-dimensional parabolic Anderson model with delta initial condition and driven by a multiplicative noise that is white in time and has a spatially homogeneous…
In this paper, we aim to study the asymptotic behavior for multi-scale McKean-Vlasov stochastic dynamical systems. Firstly, we obtain a central limit type theorem, i.e, the deviation between the slow component $X^{\varepsilon}$ and the…
We investigate statistical properties of the optimal value of the Sample Average Approximation of stochastic programs, continuing the study in Kr\"atschmer (2023). Central Limit Theorem type results are derived for the optimal value. As a…
In this paper, we study the asymptotic behavior of a semi-linear slow-fast stochastic partial differential equation with singular coefficients. Using the Poisson equation in Hilbert space, we first establish the strong convergence in the…
We discuss the problem of adaptive discrete-time signal denoising in the situation where the signal to be recovered admits a "linear oracle" -- an unknown linear estimate that takes the form of convolution of observations with a…
Using an Environmentally Friendly Renormalization we derive, from an underlying field theory representation, a formal expression for the equation of state, $y=f(x)$, that exhibits all desired asymptotic and analyticity properties in the…
In this paper we present some new limit theorems for power variation of $k$th order increments of stationary increments L\'evy driven moving averages. In this infill sampling setting, the asymptotic theory gives very surprising results,…
We study the contour dependence of the out-of-time-ordered correlation function (OTOC) both in weakly coupled field theory and in the Sachdev-Ye-Kitaev (SYK) model. We show that its value, including its Lyapunov spectrum, depends…
We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…
In this paper, we study the convergence properties of the Stochastic Gradient Descent (SGD) method for finding a stationary point of a given objective function $J(\cdot)$. The objective function is not required to be convex. Rather, our…
This paper establishes the asymptotic error distribution of the tamed Euler method for stochastic differential equations (SDEs) with a coupled monotonicity condition, that is, the limit distribution of the corresponding normalized error…
We present Lyapunov stability and asymptotic stability theorems for steady state solutions of general state-dependent delay differential equations (DDEs) using Lyapunov-Razumikhin methods. Our results apply to DDEs with multiple discrete…
This paper is concerned with normal approximation under relaxed moment conditions using Stein's method. We obtain the explicit rates of convergence in the central limit theorem for (i) nonlinear statistics with finite absolute moment of…
Many machine learning and optimization algorithms are built upon the framework of stochastic approximation (SA), for which the selection of step-size (or learning rate) $\{\alpha_n\}$ is crucial for success. An essential condition for…
The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…
Statistical machine learning models trained with stochastic gradient algorithms are increasingly being deployed in critical scientific applications. However, computing the stochastic gradient in several such applications is highly expensive…
Stochastic approximation (SA) is a powerful class of iterative algorithms for nonlinear root-finding that can be used for minimizing a loss function, $L(\boldsymbol{\theta})$, with respect to a parameter vector $\boldsymbol{\theta}$, when…
In this paper we study the functional central limit theorem for stationary Markov chains with self-adjoint operator and general state space. We investigate the case when the variance of the partial sum is not asymptotically linear in n; and…
In this paper, by introducing a new type asymptotic coupling by reflection, we explore the long time behavior of random probability measure flows associated with a large class of one-dimensional McKean-Vlasov SDEs with common noise.…
This Letter demonstrates for chaotic maps (logistic, classical and quantum standard maps (SMs)) that the exponential growth rate ($\Lambda$) of the out-of-time-ordered four-point correlator (OTOC) is equal to the classical Lyapunov exponent…