English
Related papers

Related papers: Approximation of heavy-tailed distributions via st…

200 papers

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

We consider the problem of approximating the stationary distribution of an ergodic Markov chain given a set of sampled transitions. Classical simulation-based approaches assume access to the underlying process so that trajectories of…

Machine Learning · Computer Science 2020-03-03 Junfeng Wen , Bo Dai , Lihong Li , Dale Schuurmans

In this paper, we introduce a new simple approach to developing and establishing the convergence of splitting methods for a large class of stochastic differential equations (SDEs), including additive, diagonal and scalar noise types. The…

Numerical Analysis · Mathematics 2024-03-11 James Foster , Goncalo dos Reis , Calum Strange

Stochastic differential equations (SDEs) are of utmost importance in various scientific and industrial areas. They are the natural description of dynamical processes whose precise equations of motion are either not known or too expensive to…

Methodology · Statistics 2017-11-08 Philipp Frank , Theo Steininger , Torsten A. Enßlin

We investigate synchronization by noise for stochastic differential equations (SDEs) driven by a fractional Brownian motion (fbm) with Hurst index $H\in(0,1)$. Provided that the SDE has a negative top Lyapunov exponent, we show that a weak…

Probability · Mathematics 2026-03-16 Alexandra Blessing , Mazyar Ghani Varzaneh

This paper studies decentralized stochastic nonconvex optimization problem over row-stochastic networks. We consider the heavy-tailed gradient noise which is empirically observed in many popular real-world applications. Specifically, we…

Optimization and Control · Mathematics 2026-01-19 Menglian Wang , Zhuanghua Liu , Luo Luo

We consider stochastic differential equations (SDEs) driven by a fractional Brownian motion with a drift coefficient that is allowed to be arbitrarily close to criticality in a scaling sense. We develop a comprehensive solution theory that…

Probability · Mathematics 2025-01-29 Lucio Galeati , Máté Gerencsér

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world…

Machine Learning · Computer Science 2023-10-20 Rembert Daems , Manfred Opper , Guillaume Crevecoeur , Tolga Birdal

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

This paper investigates a non-autonomous slow-fast system, which is generalized by stochastic differential equations (SDEs) with locally Lipschitz coefficients, subjected to standard Brownian motion (Bm) and fractional Brownian motion (fBm)…

Probability · Mathematics 2020-12-21 Ruifang Wang , Yong Xu , Hongge Yue

Although stochastic optimization is central to modern machine learning, the precise mechanisms underlying its success, and in particular, the precise role of the stochasticity, still remain unclear. Modelling stochastic optimization…

Machine Learning · Statistics 2020-06-12 Liam Hodgkinson , Michael W. Mahoney

Macroscopic traffic flow is stochastic, but the physics-informed deep learning methods currently used in transportation literature embed deterministic PDEs and produce point-valued outputs; the stochasticity of the governing dynamics plays…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Wuping Xin

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

In recent years, an intensive study of strong approximation of stochastic differential equations (SDEs) with a drift coefficient that may have discontinuities in space has begun. In many of these results it is assumed that the drift…

Probability · Mathematics 2021-03-01 Larisa Yaroslavtseva

In the recent article [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43 (2015), no. 2, 468--527] it has been shown that there exist stochastic differential equations (SDEs) with…

Numerical Analysis · Mathematics 2021-11-02 Arnulf Jentzen , Thomas Müller-Gronbach , Larisa Yaroslavtseva

Stochastic averaging for a class of backward stochastic differential equations driven by both standard and fractional Brownian motions (SFrBSDEs in short), is investigated. An averaged SFrBSDEs for the original SFrBSDEs is proposed, and…

Probability · Mathematics 2021-06-04 Ibrahima Faye , Sadibou Aidara , Yaya Sagna

We study distribution dependent stochastic differential equations with irregular, possibly distributional drift, driven by an additive fractional Brownian motion of Hurst parameter $H\in (0,1)$. We establish strong well-posedness under a…

Probability · Mathematics 2021-06-01 Lucio Galeati , Fabian A. Harang , Avi Mayorcas

In this paper, by using a Taylor development type formula, we show how it is possible to associate differential operators with stochastic differential equations driven by a fractional Brownian motion. As an application, we deduce that…

Probability · Mathematics 2007-05-23 Fabrice Baudoin , Laure Coutin

Understanding the generalization properties of heavy-tailed stochastic optimization algorithms has attracted increasing attention over the past years. While illuminating interesting aspects of stochastic optimizers by using heavy-tailed…

Machine Learning · Statistics 2025-06-03 Benjamin Dupuis , Umut Şimşekli

In Rajeev (2013), 'Translation invariant diffusion in the space of tempered distributions', it was shown that there is an one to one correspondence between solutions of a class of finite dimensional SDEs and solutions of a class of SPDEs in…

Probability · Mathematics 2016-05-26 Suprio Bhar