English
Related papers

Related papers: DeNOTS: Stable Deep Neural ODEs for Time Series

200 papers

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

Neural controlled differential equations (CDEs) are the continuous-time analogue of recurrent neural networks, as Neural ODEs are to residual networks, and offer a memory-efficient continuous-time way to model functions of potentially…

Machine Learning · Computer Science 2021-06-22 James Morrill , Cristopher Salvi , Patrick Kidger , James Foster , Terry Lyons

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Neural-ODE parameterize a differential equation using continuous depth neural network and solve it using numerical ODE-integrator. These models offer a constant memory cost compared to models with discrete sequence of hidden layers in which…

Machine Learning · Computer Science 2025-03-27 Sheikh Waqas Akhtar

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

Numerical Analysis · Mathematics 2025-06-18 Matteo Caldana , Jan S. Hesthaven

We propose Characteristic-Neural Ordinary Differential Equations (C-NODEs), a framework for extending Neural Ordinary Differential Equations (NODEs) beyond ODEs. While NODEs model the evolution of a latent variables as the solution to an…

Machine Learning · Computer Science 2022-11-10 Xingzi Xu , Ali Hasan , Khalil Elkhalil , Jie Ding , Vahid Tarokh

Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant…

Machine Learning · Computer Science 2025-05-28 Avik Pal , Alan Edelman , Christopher Rackauckas

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

Machine Learning · Computer Science 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

Neural ODEs (NODEs) have emerged as powerful tools for modeling time series data, offering the flexibility to adapt to varying input scales and capture complex dynamics. However, they face significant challenges: first, their reliance on…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Yang Weng

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

Machine Learning · Computer Science 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

Recurrent neural networks (RNNs) have brought a lot of advancements in sequence labeling tasks and sequence data. However, their effectiveness is limited when the observations in the sequence are irregularly sampled, where the observations…

Machine Learning · Computer Science 2022-12-29 Srinivas Anumasa , Geetakrishnasai Gunapati , P. K. Srijith
‹ Prev 1 2 3 10 Next ›