English
Related papers

Related papers: On the Forward Invariance of Neural ODEs

200 papers

Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time…

Machine Learning · Computer Science 2025-08-05 Haoran Li , Muhao Guo , Yang Weng , Hanghang Tong

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

We consider the problem of learning Neural Ordinary Differential Equations (neural ODEs) within the context of Linear Parameter-Varying (LPV) systems in continuous-time. LPV systems contain bilinear systems which are known to be universal…

Machine Learning · Computer Science 2023-07-10 Dániel Rácz , Mihály Petreczky , Bálint Daróczy

Reasoning over an instance composed of a set of vectors, like a point cloud, requires that one accounts for intra-set dependent features among elements. However, since such instances are unordered, the elements' features should remain…

Machine Learning · Computer Science 2020-08-07 Yang Li , Haidong Yi , Christopher M. Bender , Siyuan Shan , Junier B. Oliva

Neural Ordinary Differential Equations model dynamical systems with ODEs learned by neural networks. However, ODEs are fundamentally inadequate to model systems with long-range dependencies or discontinuities, which are common in…

Machine Learning · Computer Science 2022-06-15 Samuel Holt , Zhaozhi Qian , Mihaela van der Schaar

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

The solution of systems of non-autonomous linear ordinary differential equations is crucial in a variety of applications, such us nuclear magnetic resonance spectroscopy. A new method with spectral accuracy has been recently introduced in…

Numerical Analysis · Mathematics 2022-10-14 Stefano Pozza , Niel Van Buggenhout

We present a novel model Graph Neural Stochastic Differential Equations (Graph Neural SDEs). This technique enhances the Graph Neural Ordinary Differential Equations (Graph Neural ODEs) by embedding randomness into data representation using…

Machine Learning · Computer Science 2023-08-25 Richard Bergna , Felix Opolka , Pietro Liò , Jose Miguel Hernandez-Lobato

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

We present a parameter estimation method in Ordinary Differential Equation (ODE) models. Due to complex relationships between parameters and states the use of standard techniques such as nonlinear least squares can lead to the presence of…

Methodology · Statistics 2018-10-11 Quentin Clairon

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Neural ODEs are increasingly used as continuous-time models for scientific and sensor data, but unconstrained neural ODEs can drift and violate domain invariants (e.g., conservation laws), yielding physically implausible solutions. In turn,…

Machine Learning · Computer Science 2026-03-26 Fangzhou Yu , Yiqi Su , Ray Lee , Shenfeng Cheng , Naren Ramakrishnan

We present an approach for designing correct-by-construction neural networks (and other machine learning models) that are guaranteed to be consistent with a collection of input-output specifications before, during, and after algorithm…

Machine Learning · Computer Science 2020-01-31 Stephen Mell , Olivia Brown , Justin Goodwin , Sung-Hyun Son

Training dynamic models, such as neural ODEs, on long trajectories is a hard problem that requires using various tricks, such as trajectory splitting, to make model training work in practice. These methods are often heuristics with poor…

Machine Learning · Computer Science 2023-02-09 Valerii Iakovlev , Cagatay Yildiz , Markus Heinonen , Harri Lähdesmäki

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Machine Learning · Computer Science 2024-07-22 Jonas Beck , Nathanael Bosch , Michael Deistler , Kyra L. Kadhim , Jakob H. Macke , Philipp Hennig , Philipp Berens

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

We address the problem of optimal experimental design (OED) for Bayesian nonlinear inverse problems governed by PDEs. The goal is to find a placement of sensors, at which experimental data are collected, so as to minimize the uncertainty in…

Optimization and Control · Mathematics 2015-11-04 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on…

Methodology · Statistics 2023-10-25 Mingwei Xu , Samuel W. K. Wong , Peijun Sang

Neural Ordinary Differential Equations (ODEs) have been successful in various applications due to their continuous nature and parameter-sharing efficiency. However, these unique characteristics also introduce challenges in training,…

Machine Learning · Computer Science 2025-09-29 Tianxiang Gao , Siyuan Sun , Hailiang Liu , Hongyang Gao

Neural networks are powerful tools for data-driven modeling of complex dynamical systems, enhancing predictive capability for control applications. However, their inherent nonlinearity and black-box nature challenge control designs that…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Xiao Li , Tianhao Wei , Changliu Liu , Anouck Girard , Ilya Kolmanovsky