English
Related papers

Related papers: Semantic Segmentation using Neural Ordinary Differ…

200 papers

Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations.…

Methodology · Statistics 2021-10-26 Xiaowu Dai , Lexin Li

Neural ordinary differential equations (neural ODEs) have emerged as a novel network architecture that bridges dynamical systems and deep learning. However, the gradient obtained with the continuous adjoint method in the vanilla neural ODE…

Machine Learning · Computer Science 2023-06-12 Hong Zhang , Wenjun Zhao

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

Machine Learning · Computer Science 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Semantic segmentation consists of assigning a semantic label to each pixel according to predefined classes. This process facilitates the understanding of object appearance and spatial relationships, playing an important role in the global…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Mariana Dória Prata Lima , Gilson Antonio Giraldi , Jaime S. Cardoso

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art…

Machine Learning · Computer Science 2022-03-16 Aowabin Rahman , Ján Drgoňa , Aaron Tuor , Jan Strube

The time evolution of dynamical systems is frequently described by ordinary differential equations (ODEs), which must be solved for given initial conditions. Most standard approaches numerically integrate ODEs producing a single solution…

Machine Learning · Computer Science 2020-06-26 Cedric Flamant , Pavlos Protopapas , David Sondak

Accurately modelling the dynamics of complex systems and discovering their governing differential equations are critical tasks for accelerating scientific discovery. Using noisy, synthetic data from two damped oscillatory systems, we…

Machine Learning · Computer Science 2026-01-29 Panayiotis Ioannou , Pietro Liò , Pietro Cicuta

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

Deformable image registration (DIR) is crucial in medical image analysis, enabling the exploration of biological dynamics such as organ motions and longitudinal changes in imaging. Leveraging Neural Ordinary Differential Equations (ODE) for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yifan Wu , Mengjin Dong , Rohit Jena , Chen Qin , James C. Gee

Neural Ordinary Differential Equations (ODEs) are elegant reinterpretations of deep networks where continuous time can replace the discrete notion of depth, ODE solvers perform forward propagation, and the adjoint method enables efficient,…

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

We explore in detail a method to solve ordinary differential equations using feedforward neural networks. We prove a specific loss function, which does not require knowledge of the exact solution, to be a suitable standard metric to…

Computational Physics · Physics 2020-06-02 Liam L. H. Lau , Denis Werth

Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE methods. We first show that a residual block of layers in…

Computation and Language · Computer Science 2022-04-13 Bei Li , Quan Du , Tao Zhou , Yi Jing , Shuhan Zhou , Xin Zeng , Tong Xiao , JingBo Zhu , Xuebo Liu , Min Zhang

Residual networks (ResNets) are a deep learning architecture that substantially improved the state of the art performance in certain supervised learning tasks. Since then, they have received continuously growing attention. ResNets have a…

Machine Learning · Computer Science 2020-03-02 Johannes Müller

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

Machine Learning · Statistics 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng

The combination of ordinary differential equations and neural networks, i.e., neural ordinary differential equations (Neural ODE), has been widely studied from various angles. However, deciphering the numerical integration in Neural ODE is…

Machine Learning · Computer Science 2022-06-16 Aiqing Zhu , Pengzhan Jin , Beibei Zhu , Yifa Tang

Neural differential equation models have garnered significant attention in recent years for their effectiveness in machine learning applications.Among these, fractional differential equations (FDEs) have emerged as a promising tool due to…

Machine Learning · Computer Science 2025-03-21 Wenjun Cui , Qiyu Kang , Xuhao Li , Kai Zhao , Wee Peng Tay , Weihua Deng , Yidong Li