English
Related papers

Related papers: Neural Ordinary Differential Equation based Recurr…

200 papers

We propose Characteristic-Neural Ordinary Differential Equations (C-NODEs), a framework for extending Neural Ordinary Differential Equations (NODEs) beyond ODEs. While NODEs model the evolution of a latent variables as the solution to an…

Machine Learning · Computer Science 2022-11-10 Xingzi Xu , Ali Hasan , Khalil Elkhalil , Jie Ding , Vahid Tarokh

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

Machine Learning · Computer Science 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

In this work, we introduce and study a class of Deep Neural Networks (DNNs) in continuous-time. The proposed architecture stems from the combination of Neural Ordinary Differential Equations (Neural ODEs) with the model structure of…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Daniele Martinelli , Clara Lucía Galimberti , Ian R. Manchester , Luca Furieri , Giancarlo Ferrari-Trecate

The present project aims to use machine learning, specifically neural networks (NN), to learn the trajectories of a set of coupled ordinary differential equations (ODEs) and decrease compute times for obtaining ODE solutions by using this…

Machine Learning · Computer Science 2020-09-18 Camila Faccini de Lima , Juliano Ferrari Gianlupi , John Metzcar , Juliette Zerick

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art…

Machine Learning · Computer Science 2022-03-16 Aowabin Rahman , Ján Drgoňa , Aaron Tuor , Jan Strube

Residual neural networks can be viewed as the forward Euler discretization of an Ordinary Differential Equation (ODE) with a unit time step. This has recently motivated researchers to explore other discretization approaches and train ODE…

Machine Learning · Computer Science 2019-07-02 Amir Gholami , Kurt Keutzer , George Biros

We introduce the framework of continuous--depth graph neural networks (GNNs). Graph neural ordinary differential equations (GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations.…

Methodology · Statistics 2021-10-26 Xiaowu Dai , Lexin Li

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Discontinuities and delayed terms are encountered in the governing equations of a large class of problems ranging from physics and engineering to medicine and economics. These systems cannot be properly modelled and simulated with standard…

Artificial Intelligence · Computer Science 2024-09-27 Thibault Monsel , Onofrio Semeraro , Lionel Mathelin , Guillaume Charpiat

Ordinary Differential Equations (ODE) based models have become popular as foundation models for solving many time series problems. Combining neural ODEs with traditional RNN models has provided the best representation for irregular time…

Machine Learning · Computer Science 2024-08-06 Futoon M. Abushaqra , Hao Xue , Yongli Ren , Flora D. Salim

Recurrent neural networks have gained widespread use in modeling sequential data. Learning long-term dependencies using these models remains difficult though, due to exploding or vanishing gradients. In this paper, we draw connections…

Machine Learning · Statistics 2019-02-27 Bo Chang , Minmin Chen , Eldad Haber , Ed H. Chi

The unprecedented availability of large-scale datasets in neuroscience has spurred the exploration of artificial deep neural networks (DNNs) both as empirical tools and as models of natural neural systems. Their appeal lies in their ability…

Computational Engineering, Finance, and Science · Computer Science 2024-03-22 Ahmed ElGazzar , Marcel van Gerven

Poverty is a complex dynamic challenge that cannot be adequately captured using predefined differential equations. Nowadays, artificial machine learning (ML) methods have demonstrated significant potential in modelling real-world dynamical…

Dynamical Systems · Mathematics 2026-04-02 Sandeep Kumar Samota , Snehashish Chakraverty , Narayan Sethi

Incorporating neural networks for the solution of Ordinary Differential Equations (ODEs) represents a pivotal research direction within computational mathematics. Within neural network architectures, the integration of the intrinsic…

Dynamical Systems · Mathematics 2024-01-10 Shanshan Xiao , Jiawei Zhang , Yifa Tang

We present a comprehensive evaluation of the robustness and explainability of ResNet-like models in the context of Unintended Radiated Emission (URE) classification and suggest a new approach leveraging Neural Stochastic Differential…

Machine Learning · Computer Science 2023-09-28 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Alvaro Velasquez

Neural ordinary differential equations (NODEs) are an effective approach for data-driven modeling of dynamical systems arising from simulations and experiments. One of the major shortcomings of NODEs, especially when coupled with explicit…

Numerical Analysis · Mathematics 2025-12-30 Allen Alvarez Loya , Daniel A. Serino , J. W. Burby , Qi Tang

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

This paper studies the expressive and computational power of discrete Ordinary Differential Equations (ODEs), a.k.a. (Ordinary) Difference Equations. It presents a new framework using these equations as a central tool for computation and…

Logic in Computer Science · Computer Science 2022-09-27 Olivier Bournez , Arnaud Durand

Neural Ordinary Differential Equations (Neural ODEs) represent a significant breakthrough in deep learning, promising to bridge the gap between machine learning and the rich theoretical frameworks developed in various mathematical fields…

Machine Learning · Computer Science 2024-09-24 Jaouad Dabounou
‹ Prev 1 3 4 5 6 7 10 Next ›