English
Related papers

Related papers: On the long-time integration of stochastic gradien…

200 papers

We present a numerical method for the approximation of solutions for the class of stochastic differential equations driven by Brownian motions which induce stochastic variation in fixed directions. This class of equations arises naturally…

Numerical Analysis · Mathematics 2010-06-15 David F. Anderson , Jonathan C. Mattingly

The rate of strong convergence is investigated for an approximation scheme for a class of stochastic differential equations driven by a time-changed Brownian motion, where the random time changes $(E_t)_{t\ge 0}$ considered include the…

Probability · Mathematics 2020-03-02 Sixian Jin , Kei Kobayashi

We derive and analyze numerical methods for underdamped (kinetic) Langevin dynamics in a domain with elastic reflection at the boundary. First-order approximations are based on an Euler-type scheme incorporating collision-handling at the…

Numerical Analysis · Mathematics 2025-12-10 B. Leimkuhler , A. Sharma , M. V. Tretyakov

This paper establishes a discretization scheme for a large class of stochastic differential equations driven by a time-changed Brownian motion with drift, where the time change is given by a general inverse subordinator. The scheme involves…

Probability · Mathematics 2015-11-13 Ernest Jum , Kei Kobayashi

We present a new class of numerical methods for solving stochastic differential equations with additive noise on general Riemannian manifolds with high weak order of accuracy. In opposition to the popular approach with projection methods,…

Numerical Analysis · Mathematics 2025-06-19 Eugen Bronasco , Adrien Busnot Laurent , Baptiste Huguet

Our work is part of the close link between continuous-time dissipative dynamical systems and optimization algorithms, and more precisely here, in the stochastic setting. We aim to study stochastic convex minimization problems through the…

Optimization and Control · Mathematics 2025-02-21 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

In this article, we focus on the sampling of the configurational Gibbs-Boltzmann distribution, that is, the calculation of averages of functions of the position coordinates of a molecular $N$-body system modelled at constant temperature. We…

Numerical Analysis · Mathematics 2025-04-30 Benedict Leimkuhler , Charles Matthews

In this paper, we design and analyze a new family of adaptive subgradient methods for solving an important class of weakly convex (possibly nonsmooth) stochastic optimization problems. Adaptive methods that use exponential moving averages…

Optimization and Control · Mathematics 2020-05-26 Parvin Nazari , Davoud Ataee Tarzanagh , George Michailidis

We discretize the stochastic Allen-Cahn equation with additive noise by means of a spectral Galerkin method in space and a tamed version of the exponential Euler method in time. The resulting error bounds are analyzed for the…

Numerical Analysis · Mathematics 2021-01-20 Meng Cai , Siqing Gan , Xiaojie Wang

Gradient optimization algorithms using epochs, that is those based on stochastic gradient descent without replacement (SGDo), are predominantly used to train machine learning models in practice. However, the mathematical theory of SGDo and…

Machine Learning · Computer Science 2025-12-05 Stefan Perko

We study efficiency of non-parametric estimation of diffusions (stochastic differential equations driven by Brownian motion) from long stationary trajectories. First, we introduce estimators based on conditional expectation which is…

Probability · Mathematics 2021-05-26 Xi Chen , Ilya Timofeyev

Recently, it has been shown in [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43, 2 (2015), 468--527] that there exists a system of stochastic differential equations (SDE) on the time…

Probability · Mathematics 2016-09-27 Larisa Yaroslavtseva

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

This work is devoted to averaging principle of a two-time-scale stochastic partial differential equation on a bounded interval $[0, l]$, where both the fast and slow components are directly perturbed by additive noises. Under some regular…

Probability · Mathematics 2018-02-06 Hongbo Fu , Li Wan , Jicheng Liu , Xianming Liu

We consider a class of stochastic gradient optimization schemes. Assuming that the objective function is strongly convex, we prove weak error estimates which are uniform in time for the error between the solution of the numerical scheme,…

Numerical Analysis · Mathematics 2026-01-27 Charles-Edouard Bréhier , Marc Dambrine , Nassim En-Nebbazi

This paper aims at developing a systematic study for the weak rate of convergence of the Euler-Maruyama scheme for stochastic differential equations with very irregular drift and constant diffusion coefficients. We apply our method to…

Probability · Mathematics 2017-04-27 Hoang-Long Ngo , Dai Taguchi

In this paper we consider the Euler-Maruyama scheme for a class ofstochastic delay differential equations driven by a fractional Brownian motion with index $H\in(0,1)$. We establish the consistency of the scheme and study the rate of…

Probability · Mathematics 2025-06-27 Orimar Sauri

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson

The aim of this work is to provide the strong convergence results of numerical approximations of a general second order non-autonomous semilinear stochastic partial differential equation (SPDE) driven simultaneously by an additive…

Numerical Analysis · Mathematics 2024-09-11 Aurelien Junior Noupelah , Jean Daniel Mukam , Antoine Tambue

The linear fractional stable motion generalizes two prominent classes of stochastic processes, namely stable L\'evy processes, and fractional Brownian motion. For this reason it may be regarded as a basic building block for continuous time…

Statistics Theory · Mathematics 2022-08-17 Fabian Mies , Mark Podolskij
‹ Prev 1 2 3 10 Next ›