English
Related papers

Related papers: Stable Neural Stochastic Differential Equations in…

200 papers

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

Machine Learning · Computer Science 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Learning solution operators for differential equations with neural networks has shown great potential in scientific computing, but ensuring their stability under input perturbations remains a critical challenge. This paper presents a robust…

Machine Learning · Computer Science 2026-01-13 Chutian Huang , Chang Ma , Kaibo Wang , Yang Xiang

Time series generation (TSG) is widely used across domains, yet most existing methods assume regular sampling and fixed output resolutions. These assumptions are often violated in practice, where observations are irregular and sparse, while…

Machine Learning · Computer Science 2026-02-02 Xu Zhang , Junwei Deng , Chang Xu , Hao Li , Jiang Bian

Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they…

Machine Learning · Computer Science 2020-01-09 Junteng Jia , Austin R. Benson

Stochastic differential equations (SDEs) are popular tools to analyse time series data in many areas, such as mathematical finance, physics, and biology. They provide a mechanistic description of the phenomeon of interest, and their…

Methodology · Statistics 2021-02-01 Théo Michelot , Richard Glennie , Catriona Harris , Len Thomas

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Combinations of neural ODEs with recurrent neural networks (RNN), like GRU-ODE-Bayes or ODE-RNN are well suited to model irregularly observed time series. While those models outperform existing discrete-time approaches, no theoretical…

Machine Learning · Statistics 2021-05-11 Calypso Herrera , Florian Krach , Josef Teichmann

Neural Ordinary Differential Equations (Neural ODEs) are the continuous analog of Residual Neural Networks (ResNets). We investigate whether the discrete dynamics defined by a ResNet are close to the continuous one of a Neural ODE. We first…

Machine Learning · Computer Science 2022-09-16 Michael E. Sander , Pierre Ablin , Gabriel Peyré

Neural ordinary differential equations are an attractive option for modelling temporal dynamics. However, a fundamental issue is that the solution to an ordinary differential equation is determined by its initial condition, and there is no…

Machine Learning · Computer Science 2020-11-06 Patrick Kidger , James Morrill , James Foster , Terry Lyons

We introduce OS-net (Orbitally Stable neural NETworks), a new family of neural network architectures specifically designed for periodic dynamical data. OS-net is a special case of Neural Ordinary Differential Equations (NODEs) and takes…

Dynamical Systems · Mathematics 2023-09-27 Marieme Ngom , Carlo Graziani

Poverty is a complex dynamic challenge that cannot be adequately captured using predefined differential equations. Nowadays, artificial machine learning (ML) methods have demonstrated significant potential in modelling real-world dynamical…

Dynamical Systems · Mathematics 2026-04-02 Sandeep Kumar Samota , Snehashish Chakraverty , Narayan Sethi

Diffusion models have proven effective for various applications such as images, audio and graph generation. Other important applications are image super-resolution and the solution of inverse problems. More recently, some works have used…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Marcelo dos Santos , Rayson Laroca , Rafael O. Ribeiro , João Neves , Hugo Proença , David Menotti

Neural networks inspired by differential equations have proliferated for the past several years. Neural ordinary differential equations (NODEs) and neural controlled differential equations (NCDEs) are two representative examples of them. In…

Machine Learning · Computer Science 2021-11-17 Sheo Yon Jhin , Heejoo Shin , Seoyoung Hong , Solhee Park , Noseong Park

End-to-end learning of dynamical systems with black-box models, such as neural ordinary differential equations (ODEs), provides a flexible framework for learning dynamics from data without prescribing a mathematical model for the dynamics.…

Machine Learning · Statistics 2022-06-20 Paidamoyo Chapfuwa , Sherri Rose , Lawrence Carin , Edward Meeds , Ricardo Henao

We propose Characteristic-Neural Ordinary Differential Equations (C-NODEs), a framework for extending Neural Ordinary Differential Equations (NODEs) beyond ODEs. While NODEs model the evolution of a latent variables as the solution to an…

Machine Learning · Computer Science 2022-11-10 Xingzi Xu , Ali Hasan , Khalil Elkhalil , Jie Ding , Vahid Tarokh

In this paper, we develop numerical methods for solving Stochastic Differential Equations (SDEs) with solutions that evolve within a hypercube $D$ in $\mathbb{R}^d$. Our approach is based on a convex combination of two numerical flows, both…

Numerical Analysis · Mathematics 2025-03-18 Utku Erdogan , Gabriel Lord

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó