English
Related papers

Related papers: Augmented Neural Ordinary Differential Equations f…

200 papers

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Data-driven modelling and scientific machine learning have been responsible for significant advances in determining suitable models to describe data. Within dynamical systems, neural ordinary differential equations (ODEs), where the system…

Machine Learning · Computer Science 2024-05-08 Gevik Grigorian , Sandip V. George , Simon Arridge

Power system dynamics are generally modeled by high dimensional nonlinear differential-algebraic equations (DAEs) given a large number of components forming the network. These DAEs' complexity can grow exponentially due to the increasing…

Quantum Physics · Physics 2024-03-06 Huynh T. T. Tran , Hieu T. Nguyen , Long Thanh Vu , Samuel T. Ojetola

Power system dynamics are generally modeled by high dimensional nonlinear differential-algebraic equations (DAEs) given a large number of components forming the network. These DAEs' complexity can grow exponentially due to the increasing…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Huynh Trung Thanh Tran , Hieu T. Nguyen , Long T. Vu , Samuel T. Ojetola

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

Neural and Evolutionary Computing · Computer Science 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

This paper introduces novel deep dynamical models designed to represent continuous-time sequences. Our approach employs a neural emission model to generate each data point in the time series through a non-linear transformation of a latent…

Machine Learning · Computer Science 2025-02-06 Sheng Cheng , Deqian Kong , Jianwen Xie , Kookjin Lee , Ying Nian Wu , Yezhou Yang

This work proposes an extension of neural ordinary differential equations (NODEs) by introducing an additional set of ODE input parameters to NODEs. This extension allows NODEs to learn multiple dynamics specified by the input parameter…

Computational Physics · Physics 2021-11-17 Kookjin Lee , Eric J. Parish

Projection-based reduced order models are effective at approximating parameter-dependent differential equations that are parametrically separable. When parametric separability is not satisfied, which occurs in both linear and nonlinear…

Numerical Analysis · Mathematics 2021-10-22 Peter Sentz , Kristian Beckwith , Eric C. Cyr , Luke N. Olson , Ravi Patel

Recent works exploring deep learning application to dynamical systems modeling have demonstrated that embedding physical priors into neural networks can yield more effective, physically-realistic, and data-efficient models. However, in the…

Neural and Evolutionary Computing · Computer Science 2020-11-30 Elliott Skomski , Jan Drgona , Aaron Tuor

Time series anomaly detection has been recognized as of critical importance for the reliable and efficient operation of real-world systems. Many anomaly detection methods have been developed based on various assumptions on anomaly…

Machine Learning · Computer Science 2022-07-28 Jiuqi Elise Zhang , Di Wu , Benoit Boulet

Democratization of machine learning requires architectures that automatically adapt to new problems. Neural Differential Equations (NDEs) have emerged as a popular modeling framework by removing the need for ML practitioners to choose the…

Machine Learning · Computer Science 2022-02-08 Avik Pal , Yingbo Ma , Viral Shah , Christopher Rackauckas

In this study, we propose parameter-varying neural ordinary differential equations (NODEs) where the evolution of model parameters is represented by partition-of-unity networks (POUNets), a mixture of experts architecture. The proposed…

Machine Learning · Computer Science 2022-10-04 Kookjin Lee , Nathaniel Trask

Whilst the partial differential equations that govern the dynamics of our world have been studied in great depth for centuries, solving them for complex, high-dimensional conditions and domains still presents an incredibly large…

Machine Learning · Computer Science 2023-03-07 Edward Small

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such…

Machine Learning · Computer Science 2025-07-23 James Koch , Madelyn Shapiro , Himanshu Sharma , Draguna Vrabie , Jan Drgona

Linear differential equations are ubiquitous in science and engineering. Quantum computers can simulate quantum systems, which are described by a restricted type of linear differential equations. Here we extend quantum simulation algorithms…

Quantum Physics · Physics 2014-02-21 Dominic W. Berry

The data-driven modeling of dynamical systems has become an essential tool for the construction of accurate computational models from real-world data. In this process, the inherent differential structures underlying the considered physical…

Numerical Analysis · Mathematics 2025-06-04 Michael S. Ackermann , Ion Victor Gosea , Serkan Gugercin , Steffen W. R. Werner

Modern power systems require fast and accurate dynamic simulations for stability assessment, digital twins, and real-time control, but classical ODE solvers are often too slow for large-scale or online applications. We propose a…

Systems and Control · Electrical Eng. & Systems 2025-11-10 Ioannis Karampinis , Petros Ellinas , Johanna Vorwerk , Spyros Chatzivasileiadis

Automated mathematical reasoning is a challenging problem that requires an agent to learn algebraic patterns that contain long-range dependencies. Two particular tasks that test this type of reasoning are (1) mathematical equation…

Machine Learning · Computer Science 2021-04-08 Ankur Mali , Alexander Ororbia , Daniel Kifer , C. Lee Giles