Related papers: Asymptotic limit of fully coupled multi-scale non-…
Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…
We consider a discrete-time system of n coupled random vectors, a.k.a. interacting particles. The dynamics involve a vanishing step size, some random centered perturbations, and a mean vector field which induces the coupling between the…
Two-time-scale stochastic approximation, a generalized version of the popular stochastic approximation, has found broad applications in many areas including stochastic control, optimization, and machine learning. Despite its popularity,…
This paper is devoted to the problem of approximating non-linear Stochastic Partial Differential Equations (SPDEs) via interacting particle systems. In particular, we consider the Stochastic McKean-Vlasov equation, which is the…
This work is devoted to studying asymptotic behaviors for Volterra type McKean-Vlasov stochastic differential equations with small noise. By applying the weak convergence approach, we establish the large and moderate deviation principles.…
This paper is devoted to the non-asymptotic control of the mean-squared error for the Ruppert-Polyak stochastic averaged gradient descent introduced in the seminal contributions of [Rup88] and [PJ92]. In our main results, we establish…
We present the validity of stochastic averaging principle for non-autonomous slow-fast stochastic differential equations (SDEs) whose fast motions admit random periodic solutions. Our investigation is motivated by some problems arising from…
We consider a nonlinear discrete stochastic control system, and our goal is to design a feedback control policy in order to lead the system to a prespecified state. We adopt a stochastic approximation viewpoint of this problem. It is known…
In this work, we present a generalized methodology for analyzing the convergence of quasi-optimal Taylor and Legendre approximations, applicable to a wide class of parameterized elliptic PDEs with finite-dimensional deterministic and…
We study the asymptotic behavior of solution of semi-linear PDEs. Neither periodicity nor ergodicity will be assumed. In return, we assume that the coefficients admit a limit in \`{C}esaro sense. In such a case, the averaged coefficients…
We undertake a precise study of the asymptotic and non-asymptotic properties of stochastic approximation procedures with Polyak-Ruppert averaging for solving a linear system $\bar{A} \theta = \bar{b}$. When the matrix $\bar{A}$ is Hurwitz,…
We develop a new approach to study the long time behaviour of solutions to nonlinear stochastic differential equations in the sense of McKean, as well as propagation of chaos for the corresponding mean-field particle system approximations.…
A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes not related to…
In this paper, we present the asymptotic distribution of M-estimators for parameters in non-stationary AR(p) processes. The innovations are assumed to be in the domain of attraction of a stable law with index $0<\alpha\le2$. In particular,…
We provide a new version of the Tikhonov theorem for both two-scale forward systems and also two-scale forward-backward systems of stochastic differential equations, which also covers the McKean-Vlasov case. Differently from what is usually…
Recently, it has been shown in [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43, 2 (2015), 468--527] that there exists a system of stochastic differential equations (SDE) on the time…
We prove the well-posedness of some non-linear stochastic differential equations in the sense of McKean-Vlasov driven by non-degenerate symmetric $\alpha$-stable L\'evy processes with values in $R^d$ under some mild H{\"o}lder regularity…
In this paper, we study the entrance measures of time-inhomogeneous McKean-Vlasov SDEs. The existence is obtained in great generality, where the system can be expanding globally and/or degenerate for numerous number of time intervals. When…
The mean field limits of systems of interacting diffusions (also called stochastic interacting particle systems (SIPS)) have been intensively studied since McKean \cite{mckean1966class}. The interacting diffusions pave a way to…
In this paper we study model reduction of linear and bilinear quadratic stochastic control problems with parameter uncertainties. Specifically, we consider slow-fast systems with unknown diffusion coefficient and study the convergence of…