English
Related papers

Related papers: Learnable Path in Neural Controlled Differential E…

200 papers

This paper introduces a new approach to generating sample paths of unknown Markovian stochastic differential equations (SDEs) using diffusion models, a class of generative AI methods commonly employed in image and video applications. Unlike…

Machine Learning · Computer Science 2026-03-17 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

We propose a continuous neural network architecture, termed Explainable Tensorized Neural Ordinary Differential Equations (ETN-ODE), for multi-step time series prediction at arbitrary time points. Unlike the existing approaches, which…

Machine Learning · Computer Science 2022-07-13 Penglei Gao , Xi Yang , Rui Zhang , Kaizhu Huang

Deep learning (DL) in general and Recurrent neural networks (RNNs) in particular have seen high success levels in sequence based applications. This paper pertains to RNNs for time series modelling and forecasting. We propose a novel RNN…

Machine Learning · Computer Science 2022-07-12 Avinash Achar , Soumen Pachal

The neural ordinary differential equation (ODE) framework has emerged as a powerful tool for developing accelerated surrogate models of complex physical systems governed by partial differential equations (PDEs). A popular approach for PDE…

Fluid Dynamics · Physics 2025-03-26 Ashish S. Nair , Shivam Barwey , Pinaki Pal , Jonathan F. MacArt , Troy Arcomano , Romit Maulik

In this paper, we introduce a novel architecture to connecting adaptive learning and neural networks into an arbitrary machine's control system paradigm. Two consecutive Recurrent Neural Networks (RNNs) are used together to accurately model…

Machine Learning · Computer Science 2020-02-26 Srikanth Chandar , Harsha Sunder

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Signature, lying at the heart of rough path theory, is a central tool for analysing controlled differential equations driven by irregular paths. Recently it has also found extensive applications in machine learning and data science as a…

Machine Learning · Computer Science 2024-09-10 Hang Lou , Siran Li , Hao Ni

The Path-dependent Neural Jump ODE (PD-NJ-ODE) is a model for online prediction of generic (possibly non-Markovian) stochastic processes with irregular (in time) and potentially incomplete (with respect to coordinates) observations. It is a…

Machine Learning · Statistics 2024-07-29 Florian Krach , Josef Teichmann

Recurrent neural networks have gained widespread use in modeling sequential data. Learning long-term dependencies using these models remains difficult though, due to exploding or vanishing gradients. In this paper, we draw connections…

Machine Learning · Statistics 2019-02-27 Bo Chang , Minmin Chen , Eldad Haber , Ed H. Chi

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

Machine Learning · Computer Science 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

System identification through learning approaches is emerging as a promising strategy for understanding and simulating dynamical systems, which nevertheless faces considerable difficulty when confronted with power systems modeled by…

Systems and Control · Electrical Eng. & Systems 2023-12-14 Wenjie Mei , Muhammad Nadeem , MirSaleh Bahavarnia , Ahmad F. Taha

Although optimal control problems of dynamical systems can be formulated within the framework of variational calculus, their solution for complex systems is often analytically and computationally intractable. In this Letter we present a…

Machine Learning · Computer Science 2022-01-19 Lucas Böttcher , Nino Antulov-Fantulin , Thomas Asikis

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Deep learning has proven to be a suitable alternative to least-squares (LSQ) fitting for parameter estimation in various quantitative MRI (QMRI) models. However, current deep learning implementations are not robust to changes in MR…

Graph Neural Networks (GNNs) and differential equations (DEs) are two rapidly advancing areas of research that have shown remarkable synergy in recent years. GNNs have emerged as powerful tools for learning on graph-structured data, while…

Machine Learning · Computer Science 2025-06-30 Zewen Liu , Xiaoda Wang , Bohan Wang , Zijie Huang , Carl Yang , Wei Jin

In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Stochastic differential equations (SDEs) are well suited to modelling noisy and irregularly sampled time series found in finance, physics, and machine learning. Traditional approaches require costly numerical solvers to sample between…

Machine Learning · Computer Science 2025-10-30 Naoki Kiyohara , Edward Johns , Yingzhen Li

A concept of using Neural Ordinary Differential Equations(NODE) for Transfer Learning has been introduced. In this paper we use the EfficientNets to explore transfer learning on CIFAR-10 dataset. We use NODE for fine-tuning our model. Using…

Machine Learning · Computer Science 2020-01-22 Rajath S , Sumukh Aithal K , Natarajan Subramanyam

Time delays are ubiquitous in industry, and they must be accounted for when designing control strategies. However, numerical optimal control (NOC) of delay differential equations (DDEs) is challenging because it requires specialized…

Optimization and Control · Mathematics 2024-10-22 Tobias K. S. Ritschel , Søren Stange

Neural Differential Equations (NDEs) excel at modeling continuous-time dynamics, effectively handling challenges such as irregular observations, missing values, and noise. Despite their advantages, NDEs face a fundamental challenge in…

Machine Learning · Statistics 2025-11-19 Jonghun Lee , YongKyung Oh , Sungil Kim , Dong-Young Lim