English
Related papers

Related papers: Neural Ordinary Differential Equations for Interve…

200 papers

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Neural differential equations predict the derivative of a stochastic process. This allows irregular forecasting with arbitrary time-steps. However, the expressive temporal flexibility often comes with a high sensitivity to noise. In…

Machine Learning · Computer Science 2023-02-07 Stav Belogolovsky , Ido Greenberg , Danny Eitan , Shie Mannor

Neural ordinary differential equations (NODEs) presented a new paradigm to construct (continuous-time) neural networks. While showing several good characteristics in terms of the number of parameters and the flexibility in constructing…

Machine Learning · Computer Science 2021-06-01 Sheo Yon Jhin , Minju Jo , Taeyong Kong , Jinsung Jeon , Noseong Park

Estimating counterfactual outcomes over time has the potential to unlock personalized healthcare by assisting decision-makers to answer ''what-iF'' questions. Existing causal inference approaches typically consider regular, discrete-time…

Machine Learning · Computer Science 2022-06-17 Nabeel Seedat , Fergus Imrie , Alexis Bellot , Zhaozhi Qian , Mihaela van der Schaar

Ordinary differential equations (ODEs) are a mathematical model used in many application areas such as climatology, bioinformatics, and chemical engineering with its intuitive appeal to modeling. Despite ODE's wide usage in modeling, the…

Applications · Statistics 2021-08-10 Hyunjoo Yang , Jaeyong Lee

Classical neural ordinary differential equations (ODEs) are powerful tools for approximating the log-density functions in high-dimensional spaces along trajectories, where neural networks parameterize the velocity fields. This paper…

Optimization and Control · Mathematics 2025-01-30 Mo Zhou , Stanley Osher , Wuchen Li

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

We propose a continuous neural network architecture, termed Explainable Tensorized Neural Ordinary Differential Equations (ETN-ODE), for multi-step time series prediction at arbitrary time points. Unlike the existing approaches, which…

Machine Learning · Computer Science 2022-07-13 Penglei Gao , Xi Yang , Rui Zhang , Kaizhu Huang

Real-time dynamics of quantum observables provide direct access to excitation spectra and correlation functions in quantum many-body systems, but currently available quantum devices are limited to short evolution times due to decoherence.…

Quantum Physics · Physics 2026-03-17 Jinyang Li , Satoshi Iso , Shunji Matsuura , Lingxiao Wang , Xiaoyang Wang

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [arXiv:2104.13962], we explored the use of Neural Ordinary Differential Equations (NODE) as…

Machine Learning · Computer Science 2021-07-07 Sourav Dutta , Peter Rivera-Casillas , Orie M. Cecil , Matthew W. Farthing , Emma Perracchione , Mario Putti

Recent work by Xia et al. leveraged the continuous-limit of the classical momentum accelerated gradient descent and proposed heavy-ball neural ODEs. While this model offers computational efficiency and high utility over vanilla neural ODEs,…

Machine Learning · Computer Science 2022-07-14 Suneghyeon Cho , Sanghyun Hong , Kookjin Lee , Noseong Park

Forecasting time series and time-dependent data is a common problem in many applications. One typical example is solving ordinary differential equation (ODE) systems $\dot{x}=F(x)$. Oftentimes the right hand side function $F(x)$ is not…

Computational Physics · Physics 2019-10-14 Artem Chashchin , Mikhail Botchev , Ivan Oseledets , George Ovchinnikov

Neural differential equations offer a powerful approach for learning dynamics from data. However, they do not impose known constraints that should be obeyed by the learned model. It is well-known that enforcing constraints in surrogate…

1. Inferring ecological interactions is hard because we often lack suitable parametric representations to portray them. Neural ordinary differential equations (NODEs) provide a way of estimating interactions nonparametrically from time…

Populations and Evolution · Quantitative Biology 2022-09-14 Willem Bonnaffé , Tim Coulson

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

Deformable image registration (DIR), aiming to find spatial correspondence between images, is one of the most critical problems in the domain of medical image analysis. In this paper, we present a novel, generic, and accurate diffeomorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Yifan Wu , Tom Z. Jiahao , Jiancong Wang , Paul A. Yushkevich , M. Ani Hsieh , James C. Gee

The fast simulation of dynamical systems is a key challenge in many scientific and engineering applications, such as weather forecasting, disease control, and drug discovery. With the recent success of deep learning, there is increasing…

Machine Learning · Computer Science 2024-10-02 Zezheng Song , Jiaxin Yuan , Haizhao Yang

Hybrid models composing mechanistic ODE-based dynamics with flexible and expressive neural network components have grown rapidly in popularity, especially in scientific domains where such ODE-based modeling offers important interpretability…

Machine Learning · Computer Science 2026-02-02 Bob Junyi Zou , Matthew E. Levine , Dessi P. Zaharieva , Ramesh Johari , Emily B. Fox

This paper addresses imitation learning for motion prediction problem in autonomous driving, especially in multi-agent setting. Different from previous methods based on GAN, we present the conditional latent ordinary differential equation…

Robotics · Computer Science 2024-05-30 Khang Truong Giang , Yongjae Kim , Andrea Finazzi