English
Related papers

Related papers: When do neural ordinary differential equations gen…

200 papers

Data-driven modeling of dynamical systems often faces numerous data-related challenges. A fundamental requirement is the existence of a unique set of parameters for a chosen model structure, an issue commonly referred to as identifiability.…

Systems and Control · Electrical Eng. & Systems 2024-05-24 Arthur N. Montanari , François Lamoline , Robert Bereza , Jorge Gonçalves

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

Machine Learning · Computer Science 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

Accurately modelling the dynamics of complex systems and discovering their governing differential equations are critical tasks for accelerating scientific discovery. Using noisy, synthetic data from two damped oscillatory systems, we…

Machine Learning · Computer Science 2026-01-29 Panayiotis Ioannou , Pietro Liò , Pietro Cicuta

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

Neural ODE Processes approach the problem of meta-learning for dynamics using a latent variable model, which permits a flexible aggregation of contextual information. This flexibility is inherited from the Neural Process framework and…

Machine Learning · Computer Science 2021-04-30 Ben Day , Alexander Norcliffe , Jacob Moss , Pietro Liò

Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant…

Machine Learning · Computer Science 2025-05-28 Avik Pal , Alan Edelman , Christopher Rackauckas

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

Machine Learning · Computer Science 2024-09-30 Han Wang , Yixuan Li

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

In numerous robotics and mechanical engineering applications, among others, data is often constrained on smooth manifolds due to the presence of rotational degrees of freedom. Common datadriven and learning-based methods such as neural…

Optimization and Control · Mathematics 2023-05-16 Karthik Elamvazhuthi , Xuechen Zhang , Samet Oymak , Fabio Pasqualetti

In this paper, we implement Neural Ordinary Differential Equations in a Variational Autoencoder setting for generative time series modeling. An object-oriented approach to the code was taken to allow for easier development and research and…

Machine Learning · Computer Science 2022-01-14 M. L. Garsdal , V. Søgaard , S. M. Sørensen

Spatial-temporal forecasting has attracted tremendous attention in a wide range of applications, and traffic flow prediction is a canonical and typical example. The complex and long-range spatial-temporal correlations of traffic flow bring…

Machine Learning · Computer Science 2021-06-25 Zheng Fang , Qingqing Long , Guojie Song , Kunqing Xie

Deep neural networks (DNNs) have significantly advanced machine learning, with model depth playing a central role in their successes. The dynamical system modeling approach has recently emerged as a powerful framework, offering new…

Machine Learning · Computer Science 2026-02-25 Jinshu Huang , Mingfei Sun , Chunlin Wu

Understanding decentralized dynamics from collective behaviors in swarms is crucial for informing robot controller designs in artificial swarms and multiagent robotic systems. However, the complexity in agent-to-agent interactions and the…

Robotics · Computer Science 2024-10-28 Tom Z. Jiahao , Lishuo Pan , M. Ani Hsieh

We study the problem of graph structure identification, i.e., of recovering the graph of dependencies among time series. We model these time series data as components of the state of linear stochastic networked dynamical systems. We assume…

Machine Learning · Computer Science 2023-06-29 Sérgio Machado , Anirudh Sridhar , Paulo Gil , Jorge Henriques , José M. F. Moura , Augusto Santos

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

The well-known generalization problem hinders the application of artificial neural networks in continuous-time prediction tasks with varying latent dynamics. In sharp contrast, biological systems can neatly adapt to evolving environments…

Machine Learning · Computer Science 2025-03-10 Jindou Jia , Zihan Yang , Meng Wang , Kexin Guo , Jianfei Yang , Xiang Yu , Lei Guo

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Learning network dynamics from the empirical structure and spatio-temporal observation data is crucial to revealing the interaction mechanisms of complex networks in a wide range of domains. However, most existing methods only aim at…

Machine Learning · Computer Science 2024-11-22 Jiaxu Cui , Bingyi Sun , Jiming Liu , Bo Yang

Neural networks (NNs) that exploit strong inductive biases based on physical laws and symmetries have shown remarkable success in learning the dynamics of physical systems directly from their trajectory. However, these works focus only on…

Machine Learning · Computer Science 2023-06-21 Suresh Bishnoi , Jayadeva , Sayan Ranu , N. M. Anoop Krishnan