English
Related papers

Related papers: Towards Foundation Inference Models that Learn ODE…

200 papers

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Statistical regression models whose mean functions are represented by ordinary differential equations (ODEs) can be used to describe phenomenons dynamical in nature, which are abundant in areas such as biology, climatology and genetics. The…

Methodology · Statistics 2017-05-15 Kyoungjae Lee , Jaeyong Lee , Sarat C. Dass

Spurred by tremendous success in pattern matching and prediction tasks, researchers increasingly resort to machine learning to aid original scientific discovery. Given large amounts of observational data about a system, can we uncover the…

Machine Learning · Computer Science 2025-01-31 Hananeh Aliee , Fabian J. Theis , Niki Kilbertus

State-of-the-art methods for forecasting irregularly sampled time series with missing values predominantly rely on just four datasets and a few small toy examples for evaluation. While ordinary differential equations (ODE) are the prevalent…

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

Ordinary differential equations (ODEs) are the primary means to modelling dynamical systems in many natural and engineering sciences. The number of equations required to describe a system with high heterogeneity limits our capability of…

Mathematical Software · Computer Science 2017-07-17 Andrea Vandin

We introduce a method for inferring an explicit PDE from a data sample generated by previously unseen dynamics, based on a learned context. The training phase integrates knowledge of the form of the equation with a differential scheme,…

Machine Learning · Computer Science 2024-06-10 Ori Linial , Orly Avner , Dotan Di Castro

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

Machine Learning · Computer Science 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

Event-based cameras are novel, efficient sensors inspired by the human vision system, generating an asynchronous, pixel-wise stream of data. Learning from such data is generally performed through heavy preprocessing and event integration…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Giorgio Giannone , Asha Anoosheh , Alessio Quaglino , Pierluca D'Oro , Marco Gallieri , Jonathan Masci

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Irregularly sampled time series with missing values are often observed in multiple real-world applications such as healthcare, climate and astronomy. They pose a significant challenge to standard deep learning models that operate only on…

Machine Learning · Computer Science 2024-10-04 Christian Klötergens , Vijaya Krishna Yalavarthi , Maximilian Stubbemann , Lars Schmidt-Thieme

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

Mechanistic models with differential equations are a key component of scientific applications of machine learning. Inference in such models is usually computationally demanding, because it involves repeatedly solving the differential…

Machine Learning · Statistics 2022-07-06 Jonathan Schmidt , Nicholas Krämer , Philipp Hennig

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

Machine Learning · Computer Science 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

Identifying dynamical systems from experimental data is a notably difficult task. Prior knowledge generally helps, but the extent of this knowledge varies with the application, and customized models are often needed. Neural ordinary…

Systems and Control · Electrical Eng. & Systems 2023-01-13 Mona Buisson-Fenet , Valery Morgenthaler , Sebastian Trimpe , Florent Di Meglio

Neural Ordinary Differential Equations (Neural ODEs) represent a significant breakthrough in deep learning, promising to bridge the gap between machine learning and the rich theoretical frameworks developed in various mathematical fields…

Machine Learning · Computer Science 2024-09-24 Jaouad Dabounou

We develop a numerical method to reconstruct systems of ordinary differential equations (ODEs) from time series data without {\it a priori} knowledge of the underlying ODEs using sparse basis learning and sparse function reconstruction. We…

Data Analysis, Statistics and Probability · Physics 2016-05-19 Manuel Mai , Mark D. Shattuck , Corey S. O'Hern

In data-driven modeling of spatiotemporal phenomena careful consideration often needs to be made in capturing the dynamics of the high wavenumbers. This problem becomes especially challenging when the system of interest exhibits shocks or…

Machine Learning · Computer Science 2022-12-28 Alec J. Linot , Joshua W. Burby , Qi Tang , Prasanna Balaprakash , Michael D. Graham , Romit Maulik

Sparse regression has emerged as a popular technique for learning dynamical systems from temporal data, beginning with the SINDy (Sparse Identification of Nonlinear Dynamics) framework proposed by arXiv:1509.03580. Quantifying the…

Methodology · Statistics 2023-08-21 Sara Venkatraman , Sumanta Basu , Martin T. Wells