English
Related papers

Related papers: In-Context Learning of Stochastic Differential Equ…

200 papers

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

Timeseries generated from a dynamical source can often be modeled as sample paths of a stochastic differential equation (SDE). The timeseries thus reflects the motion of a particle which flows along the direction provided by a drift /…

Dynamical Systems · Mathematics 2025-11-03 Suddhasattwa Das

The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation…

Machine Learning · Statistics 2025-06-27 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

We introduce a lattice random walk discretisation scheme for stochastic differential equations (SDEs) that samples binary or ternary increments at each step, suppressing complex drift and diffusion computations to simple 1 or 2 bit random…

Numerical Analysis · Mathematics 2026-02-18 Samuel Duffield , Maxwell Aifer , Denis Melanson , Zach Belateche , Patrick J. Coles

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

Diffusion models have proven effective for various applications such as images, audio and graph generation. Other important applications are image super-resolution and the solution of inverse problems. More recently, some works have used…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Marcelo dos Santos , Rayson Laroca , Rafael O. Ribeiro , João Neves , Hugo Proença , David Menotti

The data-driven discovery of long-time macroscopic dynamics and thermodynamics of dissipative systems with particle fidelity is hampered by significant obstacles. These include the strong time-scale limitations inherent to particle…

Machine Learning · Computer Science 2025-05-21 Zequn He , Celia Reina

Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior…

Machine Learning · Computer Science 2024-08-25 Defang Chen , Zhenyu Zhou , Can Wang , Chunhua Shen , Siwei Lyu

In this paper, we study dimension reduction techniques for large-scale controlled stochastic differential equations (SDEs). The drift of the considered SDEs contains a polynomial term satisfying a one-sided growth condition. Such…

Probability · Mathematics 2023-03-10 Martin Redmann

Delay Differential Equations (DDEs) are a class of differential equations that can model diverse scientific phenomena. However, identifying the parameters, especially the time delay, that make a DDE's predictions match experimental results…

Machine Learning · Computer Science 2024-05-16 Robert Stephany

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

Machine Learning · Statistics 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

Machine Learning · Statistics 2026-05-12 Anan Saha , Arnab Ganguly

Modelling partial differential equations (PDEs) is of crucial importance in science and engineering, and it includes tasks ranging from forecasting to inverse problems, such as data assimilation. However, most previous numerical and machine…

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for…

Machine Learning · Computer Science 2025-02-05 Xi Zhang , Yuan Pu , Yuki Kawamura , Andrew Loza , Yoshua Bengio , Dennis L. Shung , Alexander Tong

The fast simulation of dynamical systems is a key challenge in many scientific and engineering applications, such as weather forecasting, disease control, and drug discovery. With the recent success of deep learning, there is increasing…

Machine Learning · Computer Science 2024-10-02 Zezheng Song , Jiaxin Yuan , Haizhao Yang

Diffusion models with continuous stochastic differential equations (SDEs) have shown superior performances in image generation. It can serve as a deep generative prior to solving the inverse problem in magnetic resonance (MR)…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Chentao Cao , Zhuo-Xu Cui , Yue Wang , Shaonan Liu , Taijin Chen , Hairong Zheng , Dong Liang , Yanjie Zhu

Understanding the training dynamics of deep learning models is perhaps a necessary step toward demystifying the effectiveness of these models. In particular, how do data from different classes gradually become separable in their feature…

Machine Learning · Computer Science 2021-10-13 Jiayao Zhang , Hua Wang , Weijie J. Su

In this paper, we investigate the problem of strong approximation of the solutions of stochastic differential equations (SDEs) when the drift coefficient is given in integral form. We investigate its upper error bounds, in terms of the…

Numerical Analysis · Mathematics 2025-11-20 Paweł Przybyłowicz , Michał Sobieraj