English
Related papers

Related papers: Generative time series models using Neural ODE in …

200 papers

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [arXiv:2104.13962], we explored the use of Neural Ordinary Differential Equations (NODE) as…

Machine Learning · Computer Science 2021-07-07 Sourav Dutta , Peter Rivera-Casillas , Orie M. Cecil , Matthew W. Farthing , Emma Perracchione , Mario Putti

Irregular time series data are prevalent in the real world and are challenging to model with a simple recurrent neural network (RNN). Hence, a model that combines the use of ordinary differential equations (ODE) and RNN was proposed…

Machine Learning · Computer Science 2022-07-13 Ting Fung Lam , Yony Bresler , Ahmed Khorshid , Nathan Perlmutter

Natural laws are often described through differential equations yet finding a differential equation that describes the governing law underlying observed data is a challenging and still mostly manual task. In this paper we make a step…

Machine Learning · Computer Science 2022-11-08 Sören Becker , Michal Klein , Alexander Neitz , Giambattista Parascandolo , Niki Kilbertus

Recurrent neural networks (RNNs) with continuous-time hidden states are a natural fit for modeling irregularly-sampled time series. These models, however, face difficulties when the input data possess long-term dependencies. We prove that…

Machine Learning · Computer Science 2020-12-07 Mathias Lechner , Ramin Hasani

In several crucial applications, domain knowledge is encoded by a system of ordinary differential equations (ODE), often stemming from underlying physical and biological processes. A motivating example is intensive care unit patients: the…

Machine Learning · Statistics 2021-03-31 Ori Linial , Neta Ravid , Danny Eytan , Uri Shalit

We study the ability of neural networks to calculate feedback control signals that steer trajectories of continuous time non-linear dynamical systems on graphs, which we represent with neural ordinary differential equations (neural ODEs).…

Machine Learning · Computer Science 2022-06-22 Thomas Asikis , Lucas Böttcher , Nino Antulov-Fantulin

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

Machine Learning · Computer Science 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

In this paper we propose a model that combines the strengths of RNNs and SGVB: the Variational Recurrent Auto-Encoder (VRAE). Such a model can be used for efficient, large scale unsupervised learning on time series data, mapping the time…

Machine Learning · Statistics 2015-06-16 Otto Fabius , Joost R. van Amersfoort

Synthesizing tabular data is attracting much attention these days for various purposes. With sophisticate synthetic data, for instance, one can augment its training data. For the past couple of years, tabular data synthesis techniques have…

Machine Learning · Computer Science 2021-06-01 Jayoung Kim , Jinsung Jeon , Jaehoon Lee , Jihyeon Hyeong , Noseong Park

Clinical time series data from electronic health records and medical registries offer unprecedented opportunities to understand patient trajectories and inform medical decision-making. However, leveraging such data presents significant…

Machine Learning · Computer Science 2025-11-21 Muhammad Aslanimoghanloo , Ahmed ElGazzar , Marcel van Gerven

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Deep generative models have been wildly successful at learning coherent latent representations for continuous data such as video and audio. However, generative modeling of discrete data such as arithmetic expressions and molecular…

Machine Learning · Statistics 2017-03-07 Matt J. Kusner , Brooks Paige , José Miguel Hernández-Lobato

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every…

Machine Learning · Computer Science 2023-01-02 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

The present project aims to use machine learning, specifically neural networks (NN), to learn the trajectories of a set of coupled ordinary differential equations (ODEs) and decrease compute times for obtaining ODE solutions by using this…

Machine Learning · Computer Science 2020-09-18 Camila Faccini de Lima , Juliano Ferrari Gianlupi , John Metzcar , Juliette Zerick

In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

In data-driven modeling of spatiotemporal phenomena careful consideration often needs to be made in capturing the dynamics of the high wavenumbers. This problem becomes especially challenging when the system of interest exhibits shocks or…

Machine Learning · Computer Science 2022-12-28 Alec J. Linot , Joshua W. Burby , Qi Tang , Prasanna Balaprakash , Michael D. Graham , Romit Maulik

We develop a transformer-based sequence-to-sequence model that recovers scalar ordinary differential equations (ODEs) in symbolic form from irregularly sampled and noisy observations of a single solution trajectory. We demonstrate in…

Machine Learning · Computer Science 2023-07-25 Sören Becker , Michal Klein , Alexander Neitz , Giambattista Parascandolo , Niki Kilbertus