English
Related papers

Related papers: Neural ODE and SDE Models for Adaptation and Plann…

200 papers

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

This study examines the challenges of modeling complex and noisy data related to socioeconomic factors over time, with a focus on data from various districts in Odisha, India. Traditional time-series models struggle to capture both trends…

Machine Learning · Computer Science 2026-04-02 Sandeep Kumar Samota , Reema Gupta , Snehashish Chakraverty

Neural Stochastic Differential Equations (Neural SDEs) provide a principled framework for modeling continuous-time stochastic processes and have been widely adopted in fields ranging from physics to finance. Recent advances suggest that…

Machine Learning · Computer Science 2026-03-17 Yuanjian Xu , Yuan Shuai , Jianing Hao , Guang Zhang

Discovering the underlying relationships among variables from temporal observations has been a longstanding challenge in numerous scientific disciplines, including biology, finance, and climate science. The dynamics of such systems are…

Machine Learning · Computer Science 2024-05-07 Benjie Wang , Joel Jennings , Wenbo Gong

We present a framework and algorithms to learn controlled dynamics models using neural stochastic differential equations (SDEs) -- SDEs whose drift and diffusion terms are both parametrized by neural networks. We construct the drift term to…

Machine Learning · Computer Science 2023-10-17 Franck Djeumou , Cyrus Neary , Ufuk Topcu

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

We present a novel model Graph Neural Stochastic Differential Equations (Graph Neural SDEs). This technique enhances the Graph Neural Ordinary Differential Equations (Graph Neural ODEs) by embedding randomness into data representation using…

Machine Learning · Computer Science 2023-08-25 Richard Bergna , Felix Opolka , Pietro Liò , Jose Miguel Hernandez-Lobato

Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…

Machine Learning · Computer Science 2021-05-12 Patrick Kidger , James Foster , Xuechen Li , Harald Oberhauser , Terry Lyons

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are…

Machine Learning · Computer Science 2019-06-07 Xuanqing Liu , Tesi Xiao , Si Si , Qin Cao , Sanjiv Kumar , Cho-Jui Hsieh

The brain-body-environment framework studies adaptive behavior through embodied and situated agents, emphasizing interactions between brains, biomechanics, and environmental dynamics. However, many models often treat the brain as a network…

Neurons and Cognition · Quantitative Biology 2025-10-01 Denizhan Pak , Quan Le Thien , Christopher J. Agostino

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

Machine Learning · Statistics 2026-05-12 Anan Saha , Arnab Ganguly

In data-driven modeling of spatiotemporal phenomena careful consideration often needs to be made in capturing the dynamics of the high wavenumbers. This problem becomes especially challenging when the system of interest exhibits shocks or…

Machine Learning · Computer Science 2022-12-28 Alec J. Linot , Joshua W. Burby , Qi Tang , Prasanna Balaprakash , Michael D. Graham , Romit Maulik

Mobile robots, such as ground vehicles and quadrotors, are becoming increasingly important in various fields, from logistics to agriculture, where they automate processes in environments that are difficult to access for humans. However, to…

Robotics · Computer Science 2025-10-08 Shao-Yi Yu , Jen-Wei Wang , Maya Horii , Vikas Garg , Tarek Zohdi

We introduce a data-driven learning framework that assimilates two powerful ideas: ideal large eddy simulation (LES) from turbulence closure modeling and neural stochastic differential equations (SDE) for stochastic modeling. The ideal LES…

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

Numerical Analysis · Mathematics 2025-06-18 Matteo Caldana , Jan S. Hesthaven

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

Machine Learning · Statistics 2026-01-09 James Rice

The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation…

Machine Learning · Statistics 2025-06-27 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth