English
Related papers

Related papers: Latent Time Neural Ordinary Differential Equations

200 papers

Latent ODE models provide flexible descriptions of dynamic systems, but they can struggle with extrapolation and predicting complicated non-linear dynamics. The latent ODE approach implicitly relies on encoders to identify unknown system…

Machine Learning · Computer Science 2024-10-14 Matt L. Sampson , Peter Melchior

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Under a smart grid paradigm, there has been an increase in sensor installations to enhance situational awareness. The measurements from these sensors can be leveraged for real-time monitoring, control, and protection. However, these…

Systems and Control · Electrical Eng. & Systems 2022-11-09 Shweta Dahale , Sai Munikoti , Balasubramaniam Natarajan , Rui Yang

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

Neural ordinary differential equations (NODEs) treat computation of intermediate feature vectors as trajectories of ordinary differential equation parameterized by a neural network. In this paper, we propose a novel model, delay…

Machine Learning · Computer Science 2020-12-15 Srinivas Anumasa , P. K. Srijith

Owing to the remarkable development of deep learning technology, there have been a series of efforts to build deep learning-based climate models. Whereas most of them utilize recurrent neural networks and/or graph neural networks, we design…

Machine Learning · Computer Science 2021-11-12 Jeehyun Hwang , Jeongwhan Choi , Hwangyong Choi , Kookjin Lee , Dongeun Lee , Noseong Park

This work proposes an extension of neural ordinary differential equations (NODEs) by introducing an additional set of ODE input parameters to NODEs. This extension allows NODEs to learn multiple dynamics specified by the input parameter…

Computational Physics · Physics 2021-11-17 Kookjin Lee , Eric J. Parish

Neural ODEs (NODEs) have emerged as powerful tools for modeling time series data, offering the flexibility to adapt to varying input scales and capture complex dynamics. However, they face significant challenges: first, their reliance on…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Yang Weng

Longitudinal analysis in medical imaging is crucial to investigate the progressive changes in anatomical structures or disease progression over time. In recent years, a novel class of algorithms has emerged with the goal of learning disease…

Inferring unbiased treatment effects has received widespread attention in the machine learning community. In recent years, our community has proposed numerous solutions in standard settings, high-dimensional treatment settings, and even…

Machine Learning · Computer Science 2024-03-19 Krzysztof Kacprzyk , Samuel Holt , Jeroen Berrevoets , Zhaozhi Qian , Mihaela van der Schaar

Pretraining methods gain increasing attraction recently for solving PDEs with neural operators. It alleviates the data scarcity problem encountered by neural operator learning when solving single PDE via training on large-scale datasets…

Machine Learning · Computer Science 2024-11-28 Tian Wang , Chuang Wang

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

We propose a continuous neural network architecture, termed Explainable Tensorized Neural Ordinary Differential Equations (ETN-ODE), for multi-step time series prediction at arbitrary time points. Unlike the existing approaches, which…

Machine Learning · Computer Science 2022-07-13 Penglei Gao , Xi Yang , Rui Zhang , Kaizhu Huang

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

Modeling dynamical systems is crucial for a wide range of tasks, but it remains challenging due to complex nonlinear dynamics, limited observations, or lack of prior knowledge. Recently, data-driven approaches such as Neural Ordinary…

We consider the neural ODE perspective of supervised learning and study the impact of the final time $T$ (which may indicate the depth of a corresponding ResNet) in training. For the classical $L^2$--regularized empirical risk minimization…

Optimization and Control · Mathematics 2021-03-31 Carlos Esteve , Borjan Geshkovski , Dario Pighin , Enrique Zuazua

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

Machine Learning · Computer Science 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing