English
Related papers

Related papers: Optimal approximation of anticipating SDEs

200 papers

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

This paper introduces time-continuous numerical schemes to simulate stochastic differential equations (SDEs) arising in mathematical finance, population dynamics, chemical kinetics, epidemiology, biophysics, and polymeric fluids. These…

Probability · Mathematics 2015-03-13 Nawaf Bou-Rabee , Eric Vanden-Eijnden

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

Metropolized integrators for ergodic stochastic differential equations (SDE) are proposed which (i) are ergodic with respect to the (known) equilibrium distribution of the SDE and (ii) approximate pathwise the solutions of the SDE on finite…

Numerical Analysis · Mathematics 2010-01-13 Nawaf Bou-Rabee , Eric Vanden-Eijnden

It is generally recognized that finite learning rate (LR), in contrast to infinitesimal LR, is important for good generalization in real-life deep nets. Most attempted explanations propose approximating finite-LR SGD with Ito Stochastic…

Machine Learning · Computer Science 2021-06-18 Zhiyuan Li , Sadhika Malladi , Sanjeev Arora

Higher order numerical schemes for stochastic partial differential equations that do not possess commutative noise require the simulation of iterated stochastic integrals. In this work, we extend the algorithms derived by Kloeden, Platen,…

Probability · Mathematics 2017-09-21 Claudine Leonhard , Andreas Rößler

The Expectation Maximization (EM) algorithm is a key reference for inference in latent variable models; unfortunately, its computational cost is prohibitive in the large scale learning setting. In this paper, we propose an extension of the…

Machine Learning · Statistics 2020-11-26 Gersende Fort , Eric Moulines , Hoi-To Wai

Stochastic interpolants offer a robust framework for continuously transforming samples between arbitrary data distributions, holding significant promise for generative modeling. Despite their potential, rigorous finite-time convergence…

Machine Learning · Computer Science 2025-08-12 Yuhao Liu , Rui Hu , Yu Chen , Longbo Huang

Sampling from Diffusion Models can alternatively be seen as solving differential equations, where there is a challenge in balancing speed and image visual quality. ODE-based samplers offer rapid sampling time but reach a performance limit,…

Machine Learning · Computer Science 2025-02-28 Qinpeng Cui , Xinyi Zhang , Qiqi Bao , Qingmin Liao

We present an error analysis of weak convergence of one-step numerical schemes for stochastic differential equations (SDEs) with super-linearly growing coefficients. Following Milstein's weak error analysis on the one-step approximation of…

Numerical Analysis · Mathematics 2023-03-29 Xiaojie Wang , Yuying Zhao , Zhongqiang Zhang

We present an error analysis of weak convergence of one-step numerical schemes for stochastic differential equations (SDEs) with super-linearly growing coefficients. Following Milstein's weak error analysis on the one-step approximation of…

Numerical Analysis · Mathematics 2023-03-29 Xiaojie Wang , Yuying Zhao , Zhongqiang Zhang

We introduce a new class of numerical methods for solving McKean-Vlasov stochastic differential equations, which are relevant in the context of distribution-dependent or mean-field models, under super-linear growth conditions for both the…

Numerical Analysis · Mathematics 2025-02-10 Jiamin Jian , Qingshuo Song , Xiaojie Wang , Zhongqiang Zhang , Yuying Zhao

Inspired by the stochastic particle method, this paper establishes an easily implementable explicit numerical method for McKean-Vlasov stochastic differential equations (MV-SDEs) with superlinear growth coefficients. The paper establishes…

Probability · Mathematics 2025-12-25 Yuanping Cui , Xiaoyue Li , Yi Liu , Fengyu Wang

Recently, it has been shown in [Jentzen, A., M\"uller-Gronbach, T., and Yaroslavtseva, L., Commun. Math. Sci., 14, 2016] that there exists a system of autonomous stochastic differential equations (SDE) on the time interval $[0,T]$ with…

Probability · Mathematics 2017-07-28 Thomas Müller-Gronbach , Larisa Yaroslavtseva

We define some approximation schemes for different kinds of generalized backward stochastic differential systems, considered in the Markovian framework. We propose a mixed approximation scheme for a decoupled system of forward reflected SDE…

Probability · Mathematics 2015-11-20 Lucian Maticiuc , Eduard Rotenstein

Recently, it has been shown in [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43, 2 (2015), 468--527] that there exists a system of stochastic differential equations (SDE) on the time…

Probability · Mathematics 2016-09-27 Larisa Yaroslavtseva

In the recent article [Jentzen, A., M\"uller-Gronbach, T., and Yaroslavtseva, L., Commun. Math. Sci., 14(6), 1477--1500, 2016] it has been established that for every arbitrarily slow convergence speed and every natural number $d \in…

Numerical Analysis · Mathematics 2020-06-04 Máté Gerencsér , Arnulf Jentzen , Diyora Salimova

A standard finite element method discretizes the stochastic linear Schr\"{o}dinger equation driven by additive noise in the spatial variables. The weak convergence of the resulting approximate solution is analyzed, and it is established…

Probability · Mathematics 2025-03-18 Mangala Prasad

Over the last few decades, the numerical methods for stochastic differential delay equations (SDDEs) have been investigated and developed by many scholars. Nevertheless, there is still little work to be completed. By virtue of the novel…

Numerical Analysis · Mathematics 2022-09-21 Zhuoqi Liu , Qian Guo , Shuaibin Gao

We study the approximation of the ergodic measure of the following stochastic differential equation (SDE) on $\mathbb{R}^d$: \begin{eqnarray}\label{e:SDEE} d X_t &=& (b_1(X_t)+b_2(X_t)) d t+\sigma(X_t) d W_t, \end{eqnarray} where $W_t$ is a…

Probability · Mathematics 2023-01-24 Xinghu Jin , Wei Wang , Lihu Xu , Tusheng Zhang