English
Related papers

Related papers: Towards Foundation Inference Models that Learn ODE…

200 papers

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Advances in differentiable numerical integrators have enabled the use of gradient descent techniques to learn ordinary differential equations (ODEs). In the context of machine learning, differentiable solvers are central for Neural ODEs…

Machine Learning · Computer Science 2021-07-06 Weiming Zhi , Tin Lai , Lionel Ott , Edwin V. Bonilla , Fabio Ramos

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

Numerical Analysis · Mathematics 2025-06-18 Matteo Caldana , Jan S. Hesthaven

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

Machine Learning · Computer Science 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

This short, self-contained article seeks to introduce and survey continuous-time deep learning approaches that are based on neural ordinary differential equations (neural ODEs). It primarily targets readers familiar with ordinary and…

Machine Learning · Computer Science 2024-01-09 Lars Ruthotto

Data-driven modeling of dynamical systems is a crucial area of machine learning. In many scenarios, a thorough understanding of the model's behavior becomes essential for practical applications. For instance, understanding the behavior of a…

Machine Learning · Computer Science 2025-04-14 Krzysztof Kacprzyk , Mihaela van der Schaar

In this work, we investigate a method for simulation-free training of Neural Ordinary Differential Equations (NODEs) for learning deterministic mappings between paired data. Despite the analogy of NODEs as continuous-depth residual…

Machine Learning · Computer Science 2024-10-31 Semin Kim , Jaehoon Yoo , Jinwoo Kim , Yeonwoo Cha , Saehoon Kim , Seunghoon Hong

Nonlinear ordinary differential equations (ODEs) are powerful tools for modeling real-world dynamical systems. However, propagating initial state uncertainty through nonlinear dynamics, especially when the ODE is unknown and learned from…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Peter Amorese , Morteza Lahijanian

The joint prediction of continuous fields and statistical estimation of the underlying discrete parameters is a common problem for many physical systems, governed by PDEs. Hitherto, it has been separately addressed by employing operator…

Machine Learning · Computer Science 2024-11-06 Levi E. Lingsch , Dana Grund , Siddhartha Mishra , Georgios Kissas

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation…

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Neural Ordinary Differential Equations (ODEs) are elegant reinterpretations of deep networks where continuous time can replace the discrete notion of depth, ODE solvers perform forward propagation, and the adjoint method enables efficient,…

Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-06 Jiaxin Yuan , Haizhao Yang , Maria Cameron

As power systems transition toward renewable-rich and inverter-dominated operations, accurate time-domain dynamic analysis becomes increasingly critical. Such analysis supports key operational tasks, including transient stability…

Artificial Intelligence · Computer Science 2026-04-17 Haoran Li , Lihao Mai , Chenhan Xiao , Erik Blasch , Yang Weng

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss