English
Related papers

Related papers: Rough path recursions and diffusion approximations

200 papers

Diffusion processes have been widely used for approximations in the queueing theory. There are different types of diffusion approximations. Among them, we are interested in those obtained through limits of a sequence of models which…

Probability · Mathematics 2015-01-20 Masakiyo Miyazawa

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

In this article, we show how the theory of rough paths can be used to provide a notion of solution to a class of nonlinear stochastic PDEs of Burgers type that exhibit too high spatial roughness for classical analytical methods to apply. In…

Probability · Mathematics 2010-08-11 Martin Hairer

We explore the limit of stochastic differential equations driven by some random processes satisfying singularly perturbed second order stochastic differential equations. The main tool we employ is the universal limit theorem in rough path…

Probability · Mathematics 2026-04-08 Qingming Zhao , Xueru Liu , Wei Wang

We study the Stochastic Gradient Descent (SGD) method in nonconvex optimization problems from the point of view of approximating diffusion processes. We prove rigorously that the diffusion process can approximate the SGD algorithm weakly…

Machine Learning · Statistics 2018-03-06 Wenqing Hu , Chris Junchi Li , Lei Li , Jian-Guo Liu

We consider again the fast-slow motions setups in the continuous time $\frac {dX_N(t)}{dt}=N^{1/2} \sig(X_N(t))(\xi(tN))+b(X_N(t)),\, t\in [0,T]$ and the discrete time $X_N((n+1)/N)=X_N(n/N)+N^{-1/2}\sig(X_N(n/N))\xi(n)+N^{-1}b(X_N(n/N)),\,…

Probability · Mathematics 2025-06-09 Yuri Kifer

In this article we show a robustness theorem for controlled stochastic differential equations driven by approximations of Brownian motion. Often, Brownian motion is used as an idealized model of a diffusion where approximations such as…

Optimization and Control · Mathematics 2023-12-07 Somnath Pradhan , Zachary Selk , Serdar Yüksel

We develop a diffusion approximation for systems subject to fast random resetting by small amplitudes. Equivalently, this describes systems with frequent but small catastrophes. We demonstrate the validity of the approximation by computing…

Statistical Mechanics · Physics 2026-02-26 Tobias Galla

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochastic differential…

Machine Learning · Computer Science 2019-09-05 Yuanyuan Feng , Tingran Gao , Lei Li , Jian-Guo Liu , Yulong Lu

We study approximations to a class of vector-valued equations of Burgers type driven by a multiplicative space-time white noise. A solution theory for this class of equations has been developed recently in [Hairer, Weber, Probab. Theory…

Probability · Mathematics 2016-06-02 Martin Hairer , Jan Maas , Hendrik Weber

We review recent developments of slow/fast stochastic differential equations, and also present a new result on Diffusion Homogenisation Theory with fractional and non-strong-mixing noise and providing new examples. The emphasise of the…

Probability · Mathematics 2023-03-07 Johann Gehringer , Xue-Mei Li

In the machine learning literature stochastic gradient descent has recently been widely discussed for its purported implicit regularization properties. Much of the theory, that attempts to clarify the role of noise in stochastic gradient…

Machine Learning · Computer Science 2022-10-21 Alberto Lanconelli , Christopher S. A. Lauria

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

In this paper, we aim to study the diffusion approximation for multi-scale McKean-Vlasov stochastic differential equations. More precisely, we prove the weak convergence of slow process $X^\varepsilon$ in $C([0,T];\mathbb{R}^n)$ towards the…

Probability · Mathematics 2022-06-07 Wei Hong , Shihu Li , Xiaobin Sun

Convergence of stochastic processes with jumps to diffusion processes is investigated in the case when the limit process has discontinuous coefficients. An example is given in which the diffusion approximation of a queueing model yields a…

Probability · Mathematics 2016-09-07 N. V. Krylov , R. Liptser

We describe a new, surprisingly simple algorithm, that simulates exact sample paths of a class of stochastic differential equations. It involves rejection sampling and, when applicable, returns the location of the path at a random…

Probability · Mathematics 2007-05-23 Alexandros Beskos , Gareth O. Roberts

Stochastic reaction-diffusion models can be analytically studied on complex networks using the linear noise approximation. This is illustrated through the use of a specific stochastic model, which displays traveling waves in its…

Statistical Mechanics · Physics 2015-06-16 Malbor Asllani , Tommaso Biancalani , Duccio Fanelli , Alan J. McKane

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

Many approaches to modelling reaction-diffusion systems with anomalous transport rely on deterministic equations and ignore fluctuations arising due to finite particle numbers. Starting from an individual-based model we use a…

Statistical Mechanics · Physics 2019-05-29 Joseph W. Baron , Tobias Galla

In this paper, we propose stochastic structure-preserving schemes to compute the effective diffusivity for particles moving in random flows. We first introduce the motion of particles using the Lagrangian formulation, which is modeled by…

Numerical Analysis · Mathematics 2020-08-24 Junlong Lyu , Zhongjian Wang , Jack Xin , Zhiwen Zhang
‹ Prev 1 2 3 10 Next ›