English
Related papers

Related papers: Learning Time Delay Systems with Neural Ordinary D…

200 papers

Real-world dynamical systems with retardation effects are described in general not by a single, precisely defined time delay, but by a range of delay times. An exact mapping onto a set of $N+1$ ordinary differential equations exists when…

Dynamical Systems · Mathematics 2023-08-16 Daniel Henrik Nevermann , Claudius Gros

Forecasting time series and time-dependent data is a common problem in many applications. One typical example is solving ordinary differential equation (ODE) systems $\dot{x}=F(x)$. Oftentimes the right hand side function $F(x)$ is not…

Computational Physics · Physics 2019-10-14 Artem Chashchin , Mikhail Botchev , Ivan Oseledets , George Ovchinnikov

By developing new efficient techniques and using an appropriate fixed point theorem, we derive several new sufficient conditions for the pseudo almost periodic solutions with double measure for some system of differential equations with…

Analysis of PDEs · Mathematics 2020-03-11 Mohsen Miraoui , Dušan D. Repovš

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

This short, self-contained article seeks to introduce and survey continuous-time deep learning approaches that are based on neural ordinary differential equations (neural ODEs). It primarily targets readers familiar with ordinary and…

Machine Learning · Computer Science 2024-01-09 Lars Ruthotto

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Accurate time series prediction is challenging due to the inherent nonlinearity and sensitivity to initial conditions. We propose a novel approach that enhances neural network predictions through differential learning, which involves…

Machine Learning · Computer Science 2025-03-11 Akash Yadav , Eulalia Nualart

Neural ordinary differential equations (NODEs) treat computation of intermediate feature vectors as trajectories of ordinary differential equation parameterized by a neural network. In this paper, we propose a novel model, delay…

Machine Learning · Computer Science 2020-12-15 Srinivas Anumasa , P. K. Srijith

Recurrent neural networks (RNN) as used in machine learning are commonly formulated in discrete time, i.e. as recursive maps. This brings a lot of advantages for training models on data, e.g. for the purpose of time series prediction or…

Dynamical Systems · Mathematics 2020-07-02 Zahra Monfared , Daniel Durstewitz

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

Neural and Evolutionary Computing · Computer Science 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

Machine Learning · Computer Science 2022-02-08 Patrick Kidger

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Time-delay mappings constructed using neural networks have proven successful in performing nonlinear system identification; however, because of their discrete nature, their use in bifurcation analysis of continuous-time systems is limited.…

Temporal-difference (TD) networks are a class of predictive state representations that use well-established TD methods to learn models of partially observable dynamical systems. Previous research with TD networks has dealt only with…

Machine Learning · Computer Science 2012-05-14 Christopher M. Vigorito

Neural ordinary differential equations (Neural ODEs) is a class of machine learning models that approximate the time derivative of hidden states using a neural network. They are powerful tools for modeling continuous-time dynamical systems,…

Machine Learning · Statistics 2024-07-16 Wenbo Hao

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

Neural ordinary differential equations (neural ODEs) can effectively learn dynamical systems from time series data, but their behavior on graph-structured data remains poorly understood, especially when applied to graphs with different size…

Physics and Society · Physics 2026-02-10 Moritz Laber , Tina Eliassi-Rad , Brennan Klein

Consider an unknown nonlinear dynamical system that is known to be dissipative. The objective of this paper is to learn a neural dynamical model that approximates this system, while preserving the dissipativity property in the model. In…

Machine Learning · Computer Science 2024-04-09 Yuezhu Xu , S. Sivaranjani