English
Related papers

Related papers: Randomized derivative-free Milstein algorithm for …

200 papers

The paper proposes a systematic framework for building data-driven stochastic differential equation (SDE) models from sparse, noisy observations. Unlike traditional parametric approaches, which assume a known functional form for the drift,…

Machine Learning · Statistics 2025-08-18 Arnab Ganguly , Riten Mitra , Jinpu Zhou

We consider decentralized gradient-free optimization of minimizing Lipschitz continuous functions that satisfy neither smoothness nor convexity assumption. We propose two novel gradient-free algorithms, the Decentralized Gradient-Free…

Optimization and Control · Mathematics 2025-01-29 Zhenwei Lin , Jingfan Xia , Qi Deng , Luo Luo

We study strong approximation of $d$-dimensional stochastic differential equations (SDEs) with a discontinuous drift coefficient driven by a $d$-dimensional Brownian motion $W$. More precisely, we essentially assume that the drift…

Probability · Mathematics 2025-05-22 Christopher Rauhögger

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

In this paper, we discuss the numerical approximation of random periodic solutions (r.p.s.) of stochastic differential equations (SDEs) with multiplicative noise. We prove the existence of the random periodic solution as the limit of the…

Numerical Analysis · Mathematics 2017-10-09 Chunrong Feng , Yu Liu , Huaizhong Zhao

We combine the rough path theory and stochastic backward error analysis to develop a new framework for error analysis on numerical schemes. Based on our approach, we prove that the almost sure convergence rate of the modified Milstein…

Numerical Analysis · Mathematics 2021-03-23 Chuying Huang

This paper focuses on the randomized Milstein scheme for approximating solutions to stochastic Volterra integral equations with weakly singular kernels, where the drift coefficients are non-differentiable. An essential component of the…

Numerical Analysis · Mathematics 2023-12-07 Zhaohang Wang , Zhuoqi Liu , Shuaibin Gao , Junhao Hu

We study pathwise approximation of scalar stochastic differential equations at a single point. We provide the exact rate of convergence of the minimal errors that can be achieved by arbitrary numerical methods that are based (in a…

Probability · Mathematics 2007-05-23 Thomas Muller-Gronbach

In this paper, we consider a new approach for semi-discretization in time and spatial discretization of a class of semi-linear stochastic partial differential equations (SPDEs) with multiplicative noise. The drift term of the SPDEs is only…

Numerical Analysis · Mathematics 2023-07-10 Yukun Li , Liet Vo , Guanqian Wang

This paper focuses on analyzing the error of the randomized Euler algorithm when only noisy information about the coefficients of the underlying stochastic differential equation (SDE) and the driving Wiener process is available. Two classes…

Numerical Analysis · Mathematics 2023-07-11 Marcin Baranek , Andrzej Kałuża , Paweł M. Morkisz , Paweł Przybyłowicz , Michał Sobieraj

We propose STARS, a randomized derivative-free algorithm for unconstrained optimization when the function evaluations are contaminated with random noise. STARS takes dynamic, noise-adjusted smoothing step-sizes that minimize the…

Optimization and Control · Mathematics 2015-07-14 Ruobing Chen , Stefan Wild

A common approach for minimizing a smooth nonlinear function is to employ finite-difference approximations to the gradient. While this can be easily performed when no error is present within the function evaluations, when the function is…

Optimization and Control · Mathematics 2022-03-24 Hao-Jun Michael Shi , Yuchen Xie , Melody Qiming Xuan , Jorge Nocedal

We consider an unconstrained problem of minimizing a smooth convex function which is only available through noisy observations of its values, the noise consisting of two parts. Similar to stochastic optimization problems, the first part is…

Optimization and Control · Mathematics 2020-09-22 Eduard Gorbunov , Pavel Dvurechensky , Alexander Gasnikov

Kruse and Wu [Math. Comp. 88 (2019) 2793--2825] proposed a fully discrete randomized Galerkin finite element method for semilinear stochastic evolution equations (SEEs) driven by additive noise and showed that this method attains a temporal…

Numerical Analysis · Mathematics 2026-02-12 Xiao Qi , Yue Wu , Yubin Yan

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

This article studies an infinite dimensional analog of Milstein's scheme for finite dimensional stochastic ordinary differential equations (SODEs). The Milstein scheme is known to be impressively efficient for SODEs which fulfill a certain…

Numerical Analysis · Mathematics 2021-11-02 Arnulf Jentzen , Michael Roeckner

A new explicit stochastic scheme of order 1 is proposed for solving commutative stochastic differential equations (SDEs) with non-globally Lipschitz continuous coefficients. The proposed method is a semi-tamed version of Milstein scheme to…

Numerical Analysis · Mathematics 2021-10-13 Yulong Liu , Yuanling Niu , Xiujun Cheng

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We introduce an explicit adaptive Milstein method for stochastic differential equations (SDEs) with no commutativity condition. The drift and diffusion are separately locally Lipschitz and together satisfy a monotone condition. This method…

Numerical Analysis · Mathematics 2022-11-22 Cónall Kelly , Gabriel Lord , Fandi Sun

We consider split-step Milstein methods for the solution of stiff stochastic differential equations with an emphasis on systems driven by multi-channel noise. We show their strong order of convergence and investigate mean-square stability…

Numerical Analysis · Mathematics 2014-11-27 V. Reshniak , A. Q. M. Khaliq , D. A. Voss , G. Zhang