English
Related papers

Related papers: On the Forward Invariance of Neural ODEs

200 papers

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

Machine Learning · Computer Science 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

This paper addresses the training of Neural Ordinary Differential Equations (neural ODEs), and in particular explores the interplay between numerical integration techniques, stability regions, step size, and initialization techniques. It is…

Machine Learning · Computer Science 2024-08-07 Theodor Westny , Arman Mohammadi , Daniel Jung , Erik Frisk

In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms. As an expository contribution we demonstrate how to re-formulate a wide variety of challenges from deep neural networks, (stochastic)…

Dynamical Systems · Mathematics 2025-07-08 Dennis Chemnitz , Maximilian Engel , Christian Kuehn , Sara-Viola Kuntz

We study the ability of neural networks to calculate feedback control signals that steer trajectories of continuous time non-linear dynamical systems on graphs, which we represent with neural ordinary differential equations (neural ODEs).…

Machine Learning · Computer Science 2022-06-22 Thomas Asikis , Lucas Böttcher , Nino Antulov-Fantulin

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Random ordinary differential equations (RODEs), i.e. ODEs with random parameters, are often used to model complex dynamics. Most existing methods to identify unknown governing RODEs from observed data often rely on strong prior knowledge.…

Numerical Analysis · Mathematics 2020-06-04 Junyu Liu , Zichao Long , Ranran Wang , Jie Sun , Bin Dong

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

Machine Learning · Computer Science 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

Stiff systems of ordinary differential equations (ODEs) are pervasive in many science and engineering fields, yet standard neural ODE approaches struggle to learn them. This limitation is the main barrier to the widespread adoption of…

Numerical Analysis · Mathematics 2024-10-10 Colby Fronk , Linda Petzold

We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these…

Machine Learning · Statistics 2019-10-29 Emilien Dupont , Arnaud Doucet , Yee Whye Teh

We propose a neural control method to provide guaranteed stabilization for mechanical systems using a novel negative imaginary neural ordinary differential equation (NINODE) controller. Specifically, we employ neural networks with desired…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Kanghong Shi , Ruigang Wang , Ian R. Manchester

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Nonlinear ordinary differential equations (ODEs) are powerful tools for modeling real-world dynamical systems. However, propagating initial state uncertainty through nonlinear dynamics, especially when the ODE is unknown and learned from…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Peter Amorese , Morteza Lahijanian

This paper introduces a new formulation for stochastic optimal control and stochastic dynamic optimization that ensures safety with respect to state and control constraints. The proposed methodology brings together concepts such as…

Systems and Control · Electrical Eng. & Systems 2021-02-19 Marcus Aloysius Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

A conventional approach to train neural ordinary differential equations (ODEs) is to fix an ODE solver and then learn the neural network's weights to optimize a target loss function. However, such an approach is tailored for a specific…

Machine Learning · Computer Science 2021-03-16 Julia Gusak , Alexandr Katrutsa , Talgat Daulbaev , Andrzej Cichocki , Ivan Oseledets

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

Machine Learning · Computer Science 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

Control problems frequently arise in scientific and industrial applications, where the objective is to steer a dynamical system from an initial state to a desired target state. Recent advances in deep learning and automatic differentiation…

Systems and Control · Electrical Eng. & Systems 2026-01-09 Lucas Böttcher

Neural ordinary differential equations (Neural ODEs) define continuous time dynamical systems with neural networks. The interest in their application for modelling has sparked recently, spanning hybrid system identification problems and…

Optimization and Control · Mathematics 2022-11-15 Ilya Orson Sandoval , Panagiotis Petsagkourakis , Ehecatl Antonio del Rio-Chanona

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

Numerical Analysis · Mathematics 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran