English
Related papers

Related papers: Capturing Actionable Dynamics with Structured Late…

200 papers

Effectively modeling phenomena present in highly nonlinear dynamical systems whilst also accurately quantifying uncertainty is a challenging task, which often requires problem-specific techniques. We present a novel, domain-agnostic…

Machine Learning · Statistics 2021-10-26 Thomas M. McDonald , Mauricio A. Álvarez

Irregularly sampled time series with missing values are often observed in multiple real-world applications such as healthcare, climate and astronomy. They pose a significant challenge to standard deep learning models that operate only on…

Machine Learning · Computer Science 2024-10-04 Christian Klötergens , Vijaya Krishna Yalavarthi , Maximilian Stubbemann , Lars Schmidt-Thieme

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

Machine Learning · Computer Science 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

Ordinary differential equations (ODEs) are the primary means to modelling dynamical systems in many natural and engineering sciences. The number of equations required to describe a system with high heterogeneity limits our capability of…

Mathematical Software · Computer Science 2017-07-17 Andrea Vandin

The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or…

Machine Learning · Computer Science 2022-12-01 Zhilu Lai , Wei Liu , Xudong Jian , Kiran Bacsa , Limin Sun , Eleni Chatzi

We study time uncertainty-aware modeling of continuous-time dynamics of interacting objects. We introduce a new model that decomposes independent dynamics of single objects accurately from their interactions. By employing latent Gaussian…

Machine Learning · Computer Science 2022-10-13 Çağatay Yıldız , Melih Kandemir , Barbara Rakitsch

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

This paper introduces novel deep dynamical models designed to represent continuous-time sequences. Our approach employs a neural emission model to generate each data point in the time series through a non-linear transformation of a latent…

Machine Learning · Computer Science 2025-02-06 Sheng Cheng , Deqian Kong , Jianwen Xie , Kookjin Lee , Ying Nian Wu , Yezhou Yang

Neural Ordinary Differential Equations (ODEs) was recently introduced as a new family of neural network models, which relies on black-box ODE solvers for inference and training. Some ODE solvers called adaptive can adapt their evaluation…

Machine Learning · Computer Science 2022-11-15 Alexandre Allauzen , Thiago Petrilli Maffei Dardis , Hannah Plath

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

To derive the hidden dynamics from observed data is one of the fundamental but also challenging problems in many different fields. In this study, we propose a new type of interpretable network called the ordinary differential equation…

Dynamical Systems · Mathematics 2020-10-19 Pipi Hu , Wuyue Yang , Yi Zhu , Liu Hong

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

Causal inference in continuous-time sequential decision problems is challenged by hidden confounders. We show that, in latent state-space models with time-varying interventions, observability of the latent dynamics from observed data is…

Machine Learning · Computer Science 2026-05-14 Jennifer Wendland , Nicolas Freitag , Maik Kschischo

Latent ODE models provide flexible descriptions of dynamic systems, but they can struggle with extrapolation and predicting complicated non-linear dynamics. The latent ODE approach implicitly relies on encoders to identify unknown system…

Machine Learning · Computer Science 2024-10-14 Matt L. Sampson , Peter Melchior

New technologies for recording the activity of large neural populations during complex behavior provide exciting opportunities for investigating the neural computations that underlie perception, cognition, and decision-making. Nonlinear…

Machine Learning · Statistics 2020-06-30 Yuan Zhao , Il Memming Park

In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Continuous deep learning architectures have recently re-emerged as Neural Ordinary Differential Equations (Neural ODEs). This infinite-depth approach theoretically bridges the gap between deep learning and dynamical systems, offering a…

Machine Learning · Computer Science 2021-01-12 Stefano Massaroli , Michael Poli , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Ordinary differential equations (ODEs) describe dynamical systems evolving deterministically in continuous time. Accurate data-driven modeling of systems as ODEs, a central problem across the natural sciences, remains challenging,…

Machine Learning · Computer Science 2025-10-15 Maximilian Mauel , Manuel Hinz , Patrick Seifner , David Berghaus , Ramses J. Sanchez

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi