English
Related papers

Related papers: A theory of generalised coordinates for stochastic…

200 papers

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

Stochastic differential equations (SDEs) have been widely used to model real world random phenomena. Existing works mainly focus on the case where the time series is modeled by a single SDE, which might be restrictive for modeling time…

Machine Learning · Computer Science 2024-01-23 Zhongchang Sun , Yousef El-Laham , Svitlana Vyetrenko

We investigate the validity and accuracy of weak-noise (saddle-point or instanton) approximations for piecewise-smooth stochastic differential equations (SDEs), taking as an illustrative example a piecewise-constant SDE, which serves as a…

Statistical Mechanics · Physics 2013-11-05 Yaming Chen , Adrian Baule , Hugo Touchette , Wolfram Just

In this review, an overview of the recent history of stochastic differential equations (SDEs) in application to particle transport problems in space physics and astrophysics is given. The aim is to present a helpful working guide to the…

High Energy Astrophysical Phenomena · Physics 2017-03-31 R. Du Toit Strauss , Frederic Effenberger

Recently, various evolutionary partial differential equations (PDEs) with a mixed derivative have been emerged and drawn much attention. Nonetheless, their PDE-theoretical and numerical studies are still in their early stage. In this paper,…

Numerical Analysis · Mathematics 2017-12-12 Shun Sato , Takayasu Matsuo

Stochastic Differential Equations (SDEs) were originally devised by It\^o to provide a pathwise construction of diffusion processes. A less explored approach to represent them is through Time Change Equations (TCEs) as put forth by Doeblin.…

Probability · Mathematics 2024-03-25 Miriam Ramírez , Gerónimo Uribe Bravo

Stochastic averaging for a class of stochastic differential equations (SDEs) with fractional Brownian motion, of the Hurst parameter H in the interval (1/2, 1), is investigated. An averaged SDE for the original SDE is proposed, and their…

Dynamical Systems · Mathematics 2013-01-22 Yong Xu , Rong Guo , Di Liu , Huiqing Zhang , Jinqiao Duan

Spatially distributed problems are often approximately modelled in terms of partial differential equations (PDEs) for appropriate coarse-grained quantities (e.g. concentrations). The derivation of accurate such PDEs starting from finer…

Quantitative Methods · Quantitative Biology 2009-11-13 Liang Qiao , Radek Erban , C. T. Kelley , Ioannis G. Kevrekidis

This paper concerns quasi-stochastic approximation (QSA) to solve root finding problems commonly found in applications to optimization and reinforcement learning. The general constant gain algorithm may be expressed as the…

Optimization and Control · Mathematics 2024-04-02 Caio Kalil Lauand , Sean Meyn

Improving the predictive capability and computational cost of dynamical models is often at the heart of augmenting computational physics with machine learning (ML). However, most learning results are limited in interpretability and…

Machine Learning · Computer Science 2023-05-19 Abhinav Gupta , Pierre F. J. Lermusiaux

This paper proposes a thorough theoretical analysis of Stochastic Gradient Descent (SGD) with non-increasing step sizes. First, we show that the recursion defining SGD can be provably approximated by solutions of a time inhomogeneous…

Optimization and Control · Mathematics 2021-02-02 Xavier Fontaine , Valentin De Bortoli , Alain Durmus

We develop stochastic mixed finite element methods for spatially adaptive simulations of fluid-structure interactions when subject to thermal fluctuations. To account for thermal fluctuations, we introduce a discrete fluctuation-dissipation…

Mesoscale and Nanoscale Physics · Physics 2023-02-28 Pat Plunkett , Jon Hu , Chris Siefert , Paul J. Atzberger

Spatial differentiability of solutions of stochastic differential equations (SDEs) is a classical question in stochastic analysis. The case of coefficients with globally Lipschitz continuous derivatives is well understood in the literature.…

Probability · Mathematics 2022-04-27 Anselm Hudde , Martin Hutzenthaler , Sara Mazzonetto

It was recently established that the formalism of the generalized transfer operator (GTO) of dynamical systems (DS) theory, applied to stochastic differential equations (SDEs) of arbitrary form, belongs to the family of cohomological…

Mathematical Physics · Physics 2025-12-29 Igor V. Ovchinnikov

Reaction-nonlinear diffusion (RND) partial differential equations are a fruitful playground to model the formation of sharp travelling fronts, a fundamental pattern in nature. In this work, we demonstrate the utility and scope of…

Dynamical Systems · Mathematics 2023-08-08 Bronwyn H Bradshaw-Hajek , Ian Lizarraga , Robert Marangell , Martin Wechselberger

We introduce a general framework for nonlinear stochastic gradient descent (SGD) for the scenarios when gradient noise exhibits heavy tails. The proposed framework subsumes several popular nonlinearity choices, like clipped, normalized,…

Optimization and Control · Mathematics 2022-04-07 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar , Nemanja Milosevic , Dusan Stamenkovic

Increasingly larger data sets of processes in space and time ask for statistical models and methods that can cope with such data. We show that the solution of a stochastic advection-diffusion partial differential equation provides a…

Methodology · Statistics 2016-02-18 Fabio Sigrist , Hans R. Künsch , Werner A. Stahel

In many fields of application, dynamic processes that evolve through time are well described by systems of ordinary differential equations (ODEs). The analytical solution of the ODEs is often not available and different methods have been…

Methodology · Statistics 2017-07-19 Saverio Ranciati , Cinzia Viroli , Ernst Wit

This paper considers approximate smoothing for discretely observed non-linear stochastic differential equations. The problem is tackled by developing methods for linearising stochastic differential equations with respect to an arbitrary…

Methodology · Statistics 2019-01-21 Filip Tronarp , Simo Särkkä

Learning unknown stochastic differential equations (SDEs) from observed data is a significant and challenging task with applications in various fields. Current approaches often use neural networks to represent drift and diffusion functions,…

Machine Learning · Computer Science 2024-06-21 Aiqing Zhu , Qianxiao Li