English
Related papers

Related papers: Continuous Forecasting via Neural Eigen Decomposit…

200 papers

Deformable image registration (DIR) is crucial in medical image analysis, enabling the exploration of biological dynamics such as organ motions and longitudinal changes in imaging. Leveraging Neural Ordinary Differential Equations (ODE) for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yifan Wu , Mengjin Dong , Rohit Jena , Chen Qin , James C. Gee

In complex physical systems, conventional differential equations often fall short in capturing non-local and memory effects, as they are limited to local dynamics and integer-order interactions. This study introduces a stepwise data-driven…

Computational Physics · Physics 2025-05-30 Xiangnan Yu , Hao Xu , Zhiping Mao , HongGuang Sun , Yong Zhang , Dongxiao Zhang , Yuntian Chen

In many scientific fields, the generation and evolution of data are governed by partial differential equations (PDEs) which are typically informed by established physical laws at the macroscopic level to describe general and predictable…

Methodology · Statistics 2025-07-01 Ziyuan Chen , Shunxing Yan , Fang Yao

We develop data-driven models to predict the dynamics of a freely settling sphere in a quiescent Newtonian fluid using experimentally obtained trajectories. Particle tracking velocimetry was used to obtain a comprehensive dataset of…

Deep learning inspired by differential equations is a recent research trend and has marked the state of the art performance for many machine learning tasks. Among them, time-series modeling with neural controlled differential equations…

Machine Learning · Computer Science 2022-09-22 Sheo Yon Jhin , Jaehoon Lee , Minju Jo , Seungji Kook , Jinsung Jeon , Jihyeon Hyeong , Jayoung Kim , Noseong Park

Neural ordinary differential equations (Neural ODEs) define continuous time dynamical systems with neural networks. The interest in their application for modelling has sparked recently, spanning hybrid system identification problems and…

Optimization and Control · Mathematics 2022-11-15 Ilya Orson Sandoval , Panagiotis Petsagkourakis , Ehecatl Antonio del Rio-Chanona

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Koopman spectral analysis has attracted attention for understanding nonlinear dynamical systems by which we can analyze nonlinear dynamics with a linear regime by lifting observations using a nonlinear function. For analysis, we need to…

Machine Learning · Statistics 2020-12-14 Tomoharu Iwata , Yoshinobu Kawahara

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Noise Contrastive Estimation (NCE) is a powerful parameter estimation method for log-linear models, which avoids calculation of the partition function or its derivatives at each training step, a computationally demanding step in many cases.…

Computation and Language · Computer Science 2018-09-07 Zhuang Ma , Michael Collins

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

This work proposes an extension of neural ordinary differential equations (NODEs) by introducing an additional set of ODE input parameters to NODEs. This extension allows NODEs to learn multiple dynamics specified by the input parameter…

Computational Physics · Physics 2021-11-17 Kookjin Lee , Eric J. Parish

Modelling the underlying mechanisms of neurodegenerative diseases demands methods that capture heterogeneous and spatially varying dynamics from sparse, high-dimensional neuroimaging data. Integrating partial differential equation (PDE)…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Sanduni Pinnawala , Annabelle Hartanto , Ivor J. A. Simpson , Peter A. Wijeratne

This paper presents the Standalone Neural ODE (sNODE), a continuous-depth neural ODE model capable of describing a full deep neural network. This uses a novel nonlinear conjugate gradient (NCG) descent optimization scheme for training,…

Machine Learning · Computer Science 2022-06-09 Rym Jaroudi , Lukáš Malý , Gabriel Eilertsen , B. Tomas Johansson , Jonas Unger , George Baravdish

The idea of neural Ordinary Differential Equations (ODE) is to approximate the derivative of a function (data model) instead of the function itself. In residual networks, instead of having a discrete sequence of hidden layers, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Seyedalireza Khoshsirat , Chandra Kambhamettu

We consider the control of semilinear stochastic partial differential equations (SPDEs) via deterministic controls. In the case of multiplicative noise, existence of optimal controls and necessary conditions for optimality are derived. In…

Optimization and Control · Mathematics 2021-10-28 Wilhelm Stannat , Lukas Wessels

Collective motion is an ubiquitous phenomenon in nature, inspiring engineers, physicists and mathematicians to develop mathematical models and bio-inspired designs. Collective motion at small to medium group sizes ($\sim$10-1000…

Machine Learning · Computer Science 2024-01-19 Utkarsh Pratiush , Arshed Nabeel , Vishwesha Guttal , Prathosh AP

The behavior of many dynamical systems follow complex, yet still unknown partial differential equations (PDEs). While several machine learning methods have been proposed to learn PDEs directly from data, previous methods are limited to…

Machine Learning · Computer Science 2021-02-01 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki