English
Related papers

Related papers: Approximation to stochastic variance reduced gradi…

200 papers

Recently, optimization on the Riemannian manifold have provided valuable insights to the optimization community. In this regard, extending these methods to to the Wasserstein space is of particular interest, since optimization on…

Machine Learning · Computer Science 2025-11-05 Mingyang Yi , Bohan Wang

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochastic differential…

Machine Learning · Computer Science 2019-09-05 Yuanyuan Feng , Tingran Gao , Lei Li , Jian-Guo Liu , Yulong Lu

A convergence theorem for the continuous weak approximation of the solution of stochastic differential equations by general one step methods is proved, which is an extension of a theorem due to Milstein. As an application, uniform second…

Numerical Analysis · Mathematics 2013-03-19 Kristian Debrabant , Andreas Rößler

We establish generalization error bounds for stochastic gradient Langevin dynamics (SGLD) with constant learning rate under the assumptions of dissipativity and smoothness, a setting that has received increased attention in the…

Machine Learning · Statistics 2021-11-29 Tyler Farghly , Patrick Rebeschini

We design a numerical scheme for solving a Dynamic Programming equation with Malliavin weights arising from the time-discretization of backward stochastic differential equations with the integration by parts-representation of the…

Statistics Theory · Mathematics 2016-01-07 Emmanuel Gobet , Plamen Turkedjiev

A number of researchers have independently introduced topologies on the set of laws of stochastic processes that extend the usual weak topology. Depending on the respective scientific background this was motivated by applications and…

Probability · Mathematics 2021-05-18 Julio Backhoff , Daniel Bartl , Mathias Beiglböck , Johannes Wiesel

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson

This paper presents symmetry reduction for material stochastic Lagrangian systems with advected quantities whose configuration space is a Lie group. Such variational principles yield deterministic as well as stochastic constrained…

Mathematical Physics · Physics 2018-08-24 Xin Chen , Ana Bela Cruzeiro , Tudor S. Ratiu

This work considers weak approximations of stochastic partial differential equations (SPDEs) driven by L\'evy noise. The SPDEs at hand are parabolic with additive noise processes. A weak-convergence rate for the corresponding Galerkin…

Probability · Mathematics 2016-03-09 Tobias Stüwe , Andrea Barth

This paper studies the problem of computing a linear approximation of quadratic Wasserstein distance $W_2$. In particular, we compute an approximation of the negative homogeneous weighted Sobolev norm whose connection to Wasserstein…

Numerical Analysis · Mathematics 2022-03-02 Philip Greengard , Jeremy G. Hoskins , Nicholas F. Marshall , Amit Singer

We provide a Lyapunov convergence analysis for time-inhomogeneous variable coefficient stochastic differential equations (SDEs). Three typical examples include overdamped, irreversible drift, and underdamped Langevin dynamics. We first…

Probability · Mathematics 2024-02-05 Qi Feng , Xinzhe Zuo , Wuchen Li

We develop a systematic approach to the linear-noise approximation for stochastic reaction systems with distributed delays. Unlike most existing work our formalism does not rely on a master equation, instead it is based upon a dynamical…

Statistical Mechanics · Physics 2013-12-13 Tobias Brett , Tobias Galla

We establish a general framework to study the rate of convergence of a Euler type approximation scheme with decreasing time steps to the invariant measure, for a general class of stochastic systems. The error is measured in general…

Probability · Mathematics 2026-03-03 Aurélien Alfonsi , Vlad Bally , Arturo Kohatsu-Higa

We present a Lyapunov type approach to the problem of existence and uniqueness of general law-dependent stochastic differential equations. In the existing literature most results concerning existence and uniqueness are obtained under…

Probability · Mathematics 2019-11-19 Sima Mehri , Wilhelm Stannat

We study pathwise approximation of scalar stochastic differential equations at a single time point or globally in time by means of methods that are based on finitely many observations of the driving Brownian motion. We prove lower error…

Numerical Analysis · Mathematics 2017-10-25 Mario Hefter , André Herzwurm , Thomas Müller-Gronbach

In this paper, we study an ordinary differential equation with a degenerate global attractor at the origin, to which we add a white noise with a small parameter that regulates its intensity. Under general conditions, for any fixed…

Probability · Mathematics 2025-05-27 Gerardo Barrera , Conrado da Costa , Milton Jara

We propose two Euler-Maruyama (EM) type numerical schemes in order to approximate the invariant measure of a stochastic differential equation (SDE) driven by an $\alpha$-stable L\'evy process ($1<\alpha<2$): an approximation scheme with the…

Probability · Mathematics 2023-06-21 Peng Chen , Changsong Deng , Rene Schilling , Lihu Xu

This paper explores the rates of convergence of solutions for multivariate stochastic differential equations (SDEs) driven by L\'evy processes within the small-time stable domain of attraction (DoA). Explicit bounds are derived for the…

Probability · Mathematics 2025-09-17 Jorge González Cázares , David Kramer-Bang

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin…

Optimization and Control · Mathematics 2022-01-12 Tobias Breiten , Carsten Hartmann , Lara Neureither , Upanshu Sharma

This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and…

Optimization and Control · Mathematics 2021-10-19 Tyler Lekang , Andrew Lamperski