English
Related papers

Related papers: A Deterministic Approximation to Neural SDEs

200 papers

In this paper, we present a deep learning-based numerical method for approximating high dimensional stochastic partial differential equations (SPDEs). At each time step, our method relies on a predictor-corrector procedure. More precisely,…

Numerical Analysis · Mathematics 2022-09-13 He Zhang , Ran Zhang , Tao Zhou

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

Machine Learning · Computer Science 2023-08-29 Ziheng Wang , Justin Sirignano

Timeseries generated from a dynamical source can often be modeled as sample paths of a stochastic differential equation (SDE). The timeseries thus reflects the motion of a particle which flows along the direction provided by a drift /…

Dynamical Systems · Mathematics 2025-11-03 Suddhasattwa Das

Astronomical time series from large-scale surveys like LSST are often irregularly sampled and incomplete, posing challenges for classification and anomaly detection. We introduce a new framework based on Neural Stochastic Delay Differential…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Seungsu Kam , Dong-Young Lim , Sungil Kim

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…

Machine Learning · Statistics 2025-03-04 Ziheng Guo , James Greene , Ming Zhong

Neural network based methods have emerged as a promising paradigm for scientific computing, yet they face critical bottlenecks in high frequency function approximation and partial differential equation (PDE) solving.

Numerical Analysis · Mathematics 2026-04-06 Xuyang Gao , Liang Chen , Minqiang Xu , Jing Niu

This paper proposes an approach, Spectral Dynamics Embedding Control (SDEC), to optimal control for nonlinear stochastic systems. This method reveals an infinite-dimensional feature representation induced by the system's nonlinear…

Machine Learning · Computer Science 2025-08-27 Zhaolin Ren , Tongzheng Ren , Haitong Ma , Na Li , Bo Dai

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

In this article, we employ a collection of stochastic differential equations with drift and diffusion coefficients approximated by neural networks to predict the trend of chaotic time series which has big jump properties. Our contributions…

Machine Learning · Computer Science 2022-11-04 Luxuan Yang , Ting Gao , Yubin Lu , Jinqiao Duan , Tao Liu

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

The numerical approximation of partial differential equations (PDEs) poses formidable challenges in high dimensions since classical grid-based methods suffer from the so-called curse of dimensionality. Recent attempts rely on a combination…

Machine Learning · Computer Science 2023-07-31 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

Automated analysis of complex systems based on multiple readouts remains a challenge. Change point detection algorithms are aimed to locating abrupt changes in the time series behaviour of a process. In this paper, we present a novel change…

Machine Learning · Computer Science 2023-10-05 Artem Ryzhikov , Mikhail Hushchyn , Denis Derkach

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

Machine Learning · Computer Science 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

We consider the problem of learning Stochastic Differential Equations of the form $dX_t = f(X_t)dt+\sigma(X_t)dW_t $ from one sample trajectory. This problem is more challenging than learning deterministic dynamical systems because one…

Machine Learning · Statistics 2022-12-28 Matthieu Darcy , Boumediene Hamzi , Giulia Livieri , Houman Owhadi , Peyman Tavallali

The rates of strong convergence for various approximation schemes are investigated for a class of stochastic differential equations (SDEs) which involve a random time change given by an inverse subordinator. SDEs to be considered are unique…

Probability · Mathematics 2021-03-29 Sixian Jin , Kei Kobayashi

Dosing models often use differential equations to model biological dynamics. Neural differential equations in particular can learn to predict the derivative of a process, which permits predictions at irregular points of time. However, this…

Machine Learning · Computer Science 2023-06-27 Stav Belogolovsky , Ido Greenberg , Danny Eytan , Shie Mannor