English
Related papers

Related papers: On the convergence of adaptive approximations for …

200 papers

Tuning the step size of stochastic gradient descent is tedious and error prone. This has motivated the development of methods that automatically adapt the step size using readily available information. In this paper, we consider the family…

Machine Learning · Computer Science 2024-11-13 Robert M. Gower , Mathieu Blondel , Nidham Gazagnadou , Fabian Pedregosa

The aim of this paper is to obtain convergence in mean in the uniform topology of piecewise linear approximations of Stochastic Differential Equations (SDEs) with $C^1$ drift and $C^2$ diffusion coefficients with uniformly bounded…

Probability · Mathematics 2025-03-13 Sahani Pathiraja

We present an implicit Split-Step explicit Euler type Method (dubbed SSM) for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of superlinear growth in space, Lipschitz in measure and non-constant…

Numerical Analysis · Mathematics 2022-05-10 Xingyuan Chen , Goncalo dos Reis

A scheme for stabilizing stochastic approximation iterates by adaptively scaling the step sizes is proposed and analyzed. This scheme leads to the same limiting differential equation as the original scheme and therefore has the same…

Probability · Mathematics 2010-07-28 Sameer Kamal

The strong convergence of numerical methods for stochastic differential equations (SDEs) for $t\in[0,\infty)$ is proved. The result is applicable to any one-step numerical methods with Markov property that have the finite time strong…

Numerical Analysis · Mathematics 2023-07-12 Wei Liu , Yudong Wang

We demonstrate an approach to the numerical solution of nonlinear stochastic differential equations with Markovian switching. Such equations describe the stochastic dynamics of processes where the drift and diffusion coefficients are…

Numerical Analysis · Mathematics 2024-08-28 Cónall Kelly , Kate O'Donovan

This paper concerns the stability of analytical and numerical solutions of nonlinear stochastic delay differential equations (SDDEs). We derive sufficient conditions for the stability, contractivity and asymptotic contractivity in mean…

Numerical Analysis · Mathematics 2014-01-21 Siqing Gan , Aiguo Xiao , Desheng Wang

We study the relationship between mixed stochastic differential equations and the corresponding rough path equations driven by standard Brownian motion and fractional Brownian motion with Hurst parameter $H>1/2$. We establish a correction…

Probability · Mathematics 2015-04-28 Andreas Neuenkirch , Taras Shalaiko

In this paper, we are concerned with convergence rate of Euler-Maruyama (EM) scheme for stochastic differential delay equations (SDDEs) of neutral type, where the neutral term, the drift term and the diffusion term are allowed to be of…

Probability · Mathematics 2016-03-23 Yanting Ji , Jianhai Bao , Chenggui Yuan

We present a numerical method for the approximation of solutions for the class of stochastic differential equations driven by Brownian motions which induce stochastic variation in fixed directions. This class of equations arises naturally…

Numerical Analysis · Mathematics 2010-06-15 David F. Anderson , Jonathan C. Mattingly

A new, improved split-step backward Euler (SSBE) method is introduced and analyzed for stochastic differential delay equations(SDDEs) with generic variable delay. The method is proved to be convergent in mean-square sense under conditions…

Numerical Analysis · Mathematics 2011-07-05 Xiaojie Wang , Siqing Gan

This paper considers mean square error (MSE) analysis for stochastic gradient sampling algorithms applied to underdamped Langevin dynamics under a global convexity assumption. A novel discrete Poisson equation framework is developed to…

Numerical Analysis · Mathematics 2025-11-07 Jianfeng Lu , Xuda Ye , Zhennan Zhou

We propose a geometric numerical analysis of SDEs admitting Lie symmetries which allows us to individuate a symmetry adapted coordinates system where the given SDE has notable invariant properties. An approximation scheme preserving the…

Probability · Mathematics 2020-08-04 Francesco C. De Vecchi , Andrea Romano , Stefania Ugolini

This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of SDEs with a drift which is not globally Lipschitz. It is proved that if the timestep is bounded appropriately, then over a finite time interval the…

Numerical Analysis · Mathematics 2016-09-27 Wei Fang , Michael Bryce Giles

Over the last few decades, the numerical methods for stochastic differential delay equations (SDDEs) have been investigated and developed by many scholars. Nevertheless, there is still little work to be completed. By virtue of the novel…

Numerical Analysis · Mathematics 2022-09-21 Zhuoqi Liu , Qian Guo , Shuaibin Gao

Construction of splitting-step methods and properties of related non-negativity and boundary preserving numerical algorithms for solving stochastic differential equations (SDEs) of Ito-type are discussed. We present convergence proofs for a…

Numerical Analysis · Mathematics 2007-05-23 Esteban Moro , Henri Schurz

We consider a generic convex-concave saddle point problem with separable structure, a form that covers a wide-ranged machine learning applications. Under this problem structure, we follow the framework of primal-dual updates for saddle…

Machine Learning · Statistics 2015-06-15 Zhanxing Zhu , Amos J. Storkey

This paper proposes a thorough theoretical analysis of Stochastic Gradient Descent (SGD) with non-increasing step sizes. First, we show that the recursion defining SGD can be provably approximated by solutions of a time inhomogeneous…

Optimization and Control · Mathematics 2021-02-02 Xavier Fontaine , Valentin De Bortoli , Alain Durmus

This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of the ergodic SDEs with a drift which is not globally Lipschitz over an infinite time interval. If the timestep is bounded appropriately, we show not…

Numerical Analysis · Mathematics 2017-03-21 Wei Fang , Michael B. Giles

In this note we prove sharp lower error bounds for numerical methods for jump-diffusion stochastic differential equations (SDEs) with discontinuous drift. We study the approximation of jump-diffusion SDEs with non-adaptive as well as…

Numerical Analysis · Mathematics 2023-12-06 Paweł Przybyłowicz , Verena Schwarz , Michaela Szölgyenyi