English
Related papers

Related papers: Symmetry-regularized neural ordinary differential …

200 papers

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern

Augmenting mechanistic ordinary differential equation (ODE) models with machine-learnable structures is an novel approach to create highly accurate, low-dimensional models of engineering systems incorporating both expert knowledge and…

Dynamical Systems · Mathematics 2022-06-22 Sandor Beregi , David A. W. Barton , Djamel Rezgui , Simon A. Neild

Recent research in deep learning has shown that neural networks can learn differential equations governing dynamical systems. In this paper, we adapt this concept to Virtual Analog (VA) modeling to learn the ordinary differential equations…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Jan Wilczek , Alec Wright , Vesa Välimäki , Emanuël Habets

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection…

Machine Learning · Computer Science 2022-01-05 Qunxi Zhu , Yifei Shen , Dongsheng Li , Wei Lin

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

Machine Learning · Computer Science 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Continuous deep learning architectures have recently re-emerged as Neural Ordinary Differential Equations (Neural ODEs). This infinite-depth approach theoretically bridges the gap between deep learning and dynamical systems, offering a…

Machine Learning · Computer Science 2021-01-12 Stefano Massaroli , Michael Poli , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

The bulk kinematics and thermodynamics of hot supernovae-driven galactic winds is critically dependent on both the amount of swept up cool clouds and non-spherical collimated flow geometry. However, accurately parameterizing these physics…

Astrophysics of Galaxies · Physics 2023-06-27 Dustin D. Nguyen

Modeling the evolution of system with time-series data is a challenging and critical task in a wide range of fields, especially when the time-series data is regularly sampled and partially observable. Some methods have been proposed to…

Machine Learning · Computer Science 2024-12-03 Mengbang Zou , Weisi Guo

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every…

Machine Learning · Computer Science 2023-01-02 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

For partial differential equations (PDEs) that have $n\geq2$ independent variables and a symmetry algebra of dimension at least $n-1$, an explicit algorithmic method is presented for finding all symmetry-invariant conservation laws that…

Mathematical Physics · Physics 2024-07-02 Stephen C. Anco , Mariluz Gandarias

Solving systems of ordinary differential equations (ODEs) is essential when it comes to understanding the behavior of dynamical systems. Yet, automated solving remains challenging, in particular for nonlinear systems. Computer algebra…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Niklas Merk , Joachim Giesen

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Neural CDEs provide a natural way to process the temporal evolution of irregular time series. The number of function evaluations (NFE) is these systems' natural analog of depth (the number of layers in traditional neural networks). It is…

Machine Learning · Computer Science 2026-01-27 Ilya Kuleshov , Evgenia Romanenkova , Vladislav Zhuzhel , Galina Boeva , Evgeni Vorsin , Alexey Zaytsev

Forecasting system behaviour near and across bifurcations is crucial for identifying potential shifts in dynamical systems. While machine learning has recently been used to learn critical transitions and bifurcation structures from data,…

Machine Learning · Computer Science 2025-11-14 Eva van Tegelen , George van Voorn , Ioannis Athanasiadis , Peter van Heijster

This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Yiwei Fu , Samer Saab , Asok Ray , Michael Hauser

Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…

Machine Learning · Computer Science 2021-05-12 Patrick Kidger , James Foster , Xuechen Li , Harald Oberhauser , Terry Lyons

Neural controlled differential equations (Neural CDEs) are a continuous-time extension of recurrent neural networks (RNNs), achieving state-of-the-art (SOTA) performance at modelling functions of irregular time series. In order to interpret…

Machine Learning · Computer Science 2021-06-22 James Morrill , Patrick Kidger , Lingyi Yang , Terry Lyons

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such…

Machine Learning · Computer Science 2025-07-23 James Koch , Madelyn Shapiro , Himanshu Sharma , Draguna Vrabie , Jan Drgona