English
Related papers

Related papers: A decreasing step method for strongly oscillating …

200 papers

Penalized estimation methods for diffusion processes and dependent data have recently gained significant attention due to their effectiveness in handling high-dimensional stochastic systems. In this work, we introduce an adaptive…

Statistics Theory · Mathematics 2024-12-24 Alessandro De Gregorio , Dario Frisardi , Francesco Iafrate , Stefano Iacus

Variational inequalities have recently attracted considerable interest in machine learning as a flexible paradigm for models that go beyond ordinary loss function minimization (such as generative adversarial networks and related deep…

Optimization and Control · Mathematics 2020-02-12 Yu-Guan Hsieh , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

We give a new take on the error analysis of approximations of stochastic differential equations (SDEs), utilizing and developing the stochastic sewing lemma of L\^e (2020). This approach allows one to exploit regularization by noise effects…

Probability · Mathematics 2021-08-10 Oleg Butkovsky , Konstantinos Dareiotis , Máté Gerencsér

In this paper, we propose an Anderson-accelerated stochastic extragradient algorithm for solving a class of stochastic variational inequalities, by incorporating Anderson acceleration into the stochastic extragradient method under a…

Optimization and Control · Mathematics 2026-05-27 Xin Qu , Wei Bian , Xiaojun Chen

We study the convergence behavior of the stochastic heavy-ball method with a small stepsize. Under a change of time scale, we approximate the discrete method by a stochastic differential equation that models small random perturbations of a…

Probability · Mathematics 2019-10-21 Wenqing Hu , Chris Junchi Li , Xiang Zhou

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

Machine Learning · Statistics 2026-05-12 Anan Saha , Arnab Ganguly

Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of…

Probability · Mathematics 2019-10-11 Mateusz B. Majka , Aleksandar Mijatović , Lukasz Szpruch

We consider stochastic variational inequality problems where the mapping is monotone over a compact convex set. We present two robust variants of stochastic extragradient algorithms for solving such problems. Of these, the first scheme…

Optimization and Control · Mathematics 2014-03-25 Farzad Yousefian , Angelia Nedic , Uday V. Shanbhag

Stochastic gradient descent in continuous time (SGDCT) provides a computationally efficient method for the statistical learning of continuous-time models, which are widely used in science, engineering, and finance. The SGDCT algorithm…

Probability · Mathematics 2019-06-18 Justin Sirignano , Konstantinos Spiliopoulos

A new explicit stabilized scheme of weak order one for stiff and ergodic stochastic differential equations (SDEs) is introduced. In the absence of noise, the new method coincides with the classical deterministic stabilized scheme (or…

Numerical Analysis · Mathematics 2018-06-28 Assyr Abdulle , Ibrahim Almuslimani , Gilles Vilmart

The paper considers an Euler discretization based numerical scheme for approximating functionals of invariant distribution of an ergodic diffusion. Convergence of the numerical scheme is shown for suitably chosen discretization step, and a…

Probability · Mathematics 2018-05-31 Arnab Ganguly , P. Sundar

In recent work of Hairer, Hutzenthaler and Jentzen, see [9], a stochastic differential equation (SDE) with infinitely often differentiable and bounded coefficients was constructed such that the Monte Carlo Euler method for approximation of…

Numerical Analysis · Mathematics 2016-03-30 Thomas Müller-Gronbach , Larisa Yaroslavtseva

We present an implicit Split-Step explicit Euler type Method (dubbed SSM) for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of superlinear growth in space, Lipschitz in measure and non-constant…

Numerical Analysis · Mathematics 2022-05-10 Xingyuan Chen , Goncalo dos Reis

Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…

Machine Learning · Statistics 2020-05-15 Anas Barakat , Pascal Bianchi

Stochastic variance reduced optimization methods are known to be globally convergent while they suffer from slow local convergence, especially when moderate or high accuracy is needed. To alleviate this problem, we propose an optimization…

Optimization and Control · Mathematics 2021-11-15 Hamed Sadeghi , Pontus Giselsson

Efficient simulation of SDEs is essential in many applications, particularly for ergodic systems that demand efficient simulation of both short-time dynamics and large-time statistics. However, locally Lipschitz SDEs often require special…

Numerical Analysis · Mathematics 2021-02-26 Xingjie Li , Fei Lu , Felix X. -F. Ye

In this paper, we introduce the tamed stochastic gradient descent method (TSGD) for optimization problems. Inspired by the tamed Euler scheme, which is a commonly used method within the context of stochastic differential equations, TSGD is…

Optimization and Control · Mathematics 2021-06-18 Monika Eisenmann , Tony Stillfjord

In this paper, we investigate the convergence order in probability of a novel ergodic numerical scheme for damped stochastic nonlinear Schr\"{o}dinger equation with an additive noise. Theoretical analysis shows that our scheme is of order…

Numerical Analysis · Mathematics 2016-11-29 Jialin Hong , Lihai Ji , Xu Wang

In this paper numerical methods for solving stochastic differential equations with Markovian switching (SDEwMSs) are developed by pathwise approximation. The proposed family of strong predictor-corrector Euler-Maruyama methods is designed…

Numerical Analysis · Mathematics 2011-03-08 Jun Ye , Haibo Li , Lili Xiao

The paper establishes the strong convergence rates of a spatio-temporal full discretization of the stochastic wave equation with nonlinear damping in dimension one and two. We discretize the SPDE by applying a spectral Galerkin method in…

Numerical Analysis · Mathematics 2024-12-30 Meng Cai , David Cohen , Xiaojie Wang