English
Related papers

Related papers: Differentiating through Stochastic Differential Eq…

200 papers

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE…

Machine Learning · Computer Science 2021-10-27 Jiayang Xu , Aniruddhe Pradhan , Karthik Duraisamy

Many scientific problems focus on observed patterns of change or on how to design a system to achieve particular dynamics. Those problems often require fitting differential equation models to target trajectories. Fitting such models can be…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

Stochastic differential equations (SDEs) have been widely used to model real world random phenomena. Existing works mainly focus on the case where the time series is modeled by a single SDE, which might be restrictive for modeling time…

Machine Learning · Computer Science 2024-01-23 Zhongchang Sun , Yousef El-Laham , Svitlana Vyetrenko

In this paper we construct a framework for doing statistical inference for discretely observed stochastic differential equations (SDEs) where the driving noise has 'memory'. Classical SDE models for inference assume the driving noise to be…

Methodology · Statistics 2013-07-05 Martin Lysy , Natesh S. Pillai

Macroscopic traffic flow is stochastic, but the physics-informed deep learning methods currently used in transportation literature embed deterministic PDEs and produce point-valued outputs; the stochasticity of the governing dynamics plays…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Wuping Xin

The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation…

Machine Learning · Statistics 2025-06-27 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

We present a formalism to derive the stochastic differential equations (SDEs) for several solid-on-solid growth models. Our formalism begins with a mapping of the microscopic dynamics of growth models onto the particle systems with…

Statistical Mechanics · Physics 2009-11-07 Su-Chan Park , Doochul Kim , Jeong-Man Park

Although the governing equations of many systems, when derived from first principles, may be viewed as known, it is often too expensive to numerically simulate all the interactions they describe. Therefore researchers often seek simpler…

Computation · Statistics 2021-05-03 Tapio Schneider , Andrew M. Stuart , Jin-Long Wu

In this paper, a weak Local Linearization scheme for Stochastic Differential Equations (SDEs) with multiplicative noise is introduced. First, for a time discretization, the solution of the SDE is locally approximated by the solution of the…

Numerical Analysis · Mathematics 2015-06-19 J. C. Jimenez , C. Mora , M. Selva

The choice of how to retain information about past gradients dramatically affects the convergence properties of state-of-the-art stochastic optimization methods, such as Heavy-ball, Nesterov's momentum, RMSprop and Adam. Building on this…

Machine Learning · Computer Science 2020-03-13 Antonio Orvieto , Jonas Kohler , Aurelien Lucchi

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

Machine Learning · Computer Science 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher

Stochastic differential equations (SDEs) are well suited to modelling noisy and irregularly sampled time series found in finance, physics, and machine learning. Traditional approaches require costly numerical solvers to sample between…

Machine Learning · Computer Science 2025-10-30 Naoki Kiyohara , Edward Johns , Yingzhen Li

Considering generating samples with high rewards, we focus on optimizing deep neural networks parameterized stochastic differential equations (SDEs), the advanced generative models with high expressiveness, with policy gradient, the leading…

Machine Learning · Computer Science 2024-06-27 Xiangxin Zhou , Liang Wang , Yichi Zhou

Correlated with the trend of increasing degrees of freedom in robotic systems is a similar trend of rising interest in Spatio-Temporal systems described by Partial Differential Equations (PDEs) among the robotics and control communities.…

Robotics · Computer Science 2021-02-19 Ethan N. Evans , Andrew P. Kendall , Evangelos A. Theodorou

In areas such as finance, engineering, and science, we often face situations that change quickly and unpredictably. These situations are tough to handle and require special tools and methods capable of understanding and predicting what…

Systems and Control · Electrical Eng. & Systems 2024-04-23 Wencheng Bao , Shi Feng , Kaiwen Zhang

In this paper we propose a new methodology for decision-making under uncertainty using recent advancements in the areas of nonlinear stochastic optimal control theory, applied mathematics, and machine learning. Grounded on the fundamental…

Robotics · Computer Science 2021-07-12 Marcus Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

In this paper, we propose a data-driven framework for model discovery of stochastic differential equations (SDEs) from a single trajectory, without requiring the ergodicity or stationary assumption on the underlying continuous process. By…

Statistical Finance · Quantitative Finance 2026-01-12 Munawar Ali , Purba Das , Qi Feng , Liyao Gao , Guang Lin

Models defined by stochastic differential equations (SDEs) allow for the representation of random variability in dynamical systems. The relevance of this class of models is growing in many applied research areas and is already a standard…

Methodology · Statistics 2014-08-06 Umberto Picchini

Statistical (machine learning) tools for equation discovery require large amounts of data that are typically computer generated rather than experimentally observed. Multiscale modeling and stochastic simulations are two areas where learning…

Machine Learning · Statistics 2021-03-17 Joseph Bakarji , Daniel M. Tartakovsky