English
Related papers

Related papers: Neural Ordinary Differential Equations for Modelin…

200 papers

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

We propose a novel second-order optimization framework for training the emerging deep continuous-time models, specifically the Neural Ordinary Differential Equations (Neural ODEs). Since their training already involves expensive gradient…

Machine Learning · Computer Science 2021-11-09 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

To derive the hidden dynamics from observed data is one of the fundamental but also challenging problems in many different fields. In this study, we propose a new type of interpretable network called the ordinary differential equation…

Dynamical Systems · Mathematics 2020-10-19 Pipi Hu , Wuyue Yang , Yi Zhu , Liu Hong

There has been a significant focus on modelling emotion ambiguity in recent years, with advancements made in representing emotions as distributions to capture ambiguity. However, there has been comparatively less effort devoted to the…

Artificial Intelligence · Computer Science 2024-08-01 Jingyao Wu , Ting Dang , Vidhyasaharan Sethu , Eliathamby Ambikairajah

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and…

Machine Learning · Computer Science 2020-09-10 Victor M. Martinez Alvarez , Rareş Roşca , Cristian G. Fălcuţescu

We analyze Neural Ordinary Differential Equations (NODEs) from a control theoretical perspective to address some of the main properties and paradigms of Deep Learning (DL), in particular, data classification and universal approximation.…

Optimization and Control · Mathematics 2021-04-13 Domènec Ruiz-Balet , Enrique Zuazua

Neural Ordinary Differential Equations (NeuralODEs) present an attractive way to extract dynamical laws from time series data, as they bridge neural networks with the differential equation-based modeling paradigm of the physical sciences.…

Machine Learning · Computer Science 2024-01-24 Joon-Hyuk Ko , Hankyul Koh , Nojun Park , Wonho Jhe

Forecasting time series and time-dependent data is a common problem in many applications. One typical example is solving ordinary differential equation (ODE) systems $\dot{x}=F(x)$. Oftentimes the right hand side function $F(x)$ is not…

Computational Physics · Physics 2019-10-14 Artem Chashchin , Mikhail Botchev , Ivan Oseledets , George Ovchinnikov

Neural differential equation models have garnered significant attention in recent years for their effectiveness in machine learning applications.Among these, fractional differential equations (FDEs) have emerged as a promising tool due to…

Machine Learning · Computer Science 2025-03-21 Wenjun Cui , Qiyu Kang , Xuhao Li , Kai Zhao , Wee Peng Tay , Weihua Deng , Yidong Li

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art…

Machine Learning · Computer Science 2022-03-16 Aowabin Rahman , Ján Drgoňa , Aaron Tuor , Jan Strube

We study the ability of neural networks to calculate feedback control signals that steer trajectories of continuous time non-linear dynamical systems on graphs, which we represent with neural ordinary differential equations (neural ODEs).…

Machine Learning · Computer Science 2022-06-22 Thomas Asikis , Lucas Böttcher , Nino Antulov-Fantulin

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

The identification of a mathematical dynamics model is a crucial step in the designing process of a controller. However, it is often very difficult to identify the system's governing equations, especially in complex environments that…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Tobias Nagel , Marco F. Huber

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical…

Machine Learning · Computer Science 2024-10-16 Dibyajyoti Chakraborty , Seung Whan Chung , Troy Arcomano , Romit Maulik

Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation…

Recent advances in deep learning have enabled the inference of urban socioeconomic characteristics from satellite imagery. However, models relying solely on urbanization traits often show weak correlations with poverty indicators, as…

Computers and Society · Computer Science 2025-09-08 Sungwon Park , Sumin Lee , Jihee Kim , Jae-Gil Lee , Meeyoung Cha , Jeasurk Yang , Donghyun Ahn

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

Recent works on optical flow estimation use neural networks to predict the flow field that maps positions of one image to positions of the other. These networks consist of a feature extractor, a correlation volume, and finally several…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Leyla Mirvakhabova , Hong Cai , Jisoo Jeong , Hanno Ackermann , Farhad Zanjani , Fatih Porikli

Neural ordinary differential equations (NODEs) treat computation of intermediate feature vectors as trajectories of ordinary differential equation parameterized by a neural network. In this paper, we propose a novel model, delay…

Machine Learning · Computer Science 2020-12-15 Srinivas Anumasa , P. K. Srijith