English
Related papers

Related papers: Learning Time Delay Systems with Neural Ordinary D…

200 papers

Making the most of multispectral image time-series is a promising but still relatively under-explored research direction because of the complexity of jointly analyzing spatial, spectral and temporal information. Capturing and characterizing…

Image and Video Processing · Electrical Eng. & Systems 2021-03-22 Joaquim Estopinan , Guillaume Tochon , Lucas Drumetz

Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve…

Optimization and Control · Mathematics 2021-06-18 Jiequn Han , Ruimeng Hu

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

Artificial Intelligence · Computer Science 2024-04-23 Cheng Chi

The behavior of many dynamical systems follow complex, yet still unknown partial differential equations (PDEs). While several machine learning methods have been proposed to learn PDEs directly from data, previous methods are limited to…

Machine Learning · Computer Science 2021-02-01 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

Neural ordinary differential equations (NODEs), one of the most influential works of the differential equation-based deep learning, are to continuously generalize residual networks and opened a new field. They are currently utilized for…

Machine Learning · Computer Science 2023-12-19 Woojin Cho , Seunghyeon Cho , Hyundong Jin , Jinsung Jeon , Kookjin Lee , Sanghyun Hong , Dongeun Lee , Jonghyun Choi , Noseong Park

Modeling sequential patterns from data is at the core of various time series forecasting tasks. Deep learning models have greatly outperformed many traditional models, but these black-box models generally lack explainability in prediction…

Machine Learning · Computer Science 2023-05-23 Yingtao Luo , Chang Xu , Yang Liu , Weiqing Liu , Shun Zheng , Jiang Bian

Differential equations (DE) constrained optimization plays a critical role in numerous scientific and engineering fields, including energy systems, aerospace engineering, ecology, and finance, where optimal configurations or control…

Machine Learning · Computer Science 2024-10-03 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and…

Machine Learning · Computer Science 2020-09-10 Victor M. Martinez Alvarez , Rareş Roşca , Cristian G. Fălcuţescu

Neural ordinary differential equations are an attractive option for modelling temporal dynamics. However, a fundamental issue is that the solution to an ordinary differential equation is determined by its initial condition, and there is no…

Machine Learning · Computer Science 2020-11-06 Patrick Kidger , James Morrill , James Foster , Terry Lyons

Delays in biological systems may be used to model events for which the underlying dynamics cannot be precisely observed. Mathematical modeling of biological systems with delays is usually based on Delay Differential Equations (DDEs), a kind…

Quantitative Methods · Quantitative Biology 2009-10-08 Roberto Barbuti , Giulio Caravagna , Paolo Milazzo , Andrea Maggiolo-Schettini

In scalable machine learning systems, model training is often parallelized over multiple nodes that run without tight synchronization. Most analysis results for the related asynchronous algorithms use an upper bound on the information…

Machine Learning · Computer Science 2022-04-12 Xuyang Wu , Sindri Magnusson , Hamid Reza Feyzmahdavian , Mikael Johansson

Time delays may cause dramatic changes to the dynamics of interacting oscillators. Coupled networks of interacting dynamical systems can behave unexpectedly when the signal between the vertices are time delayed. It has been shown for a very…

Chaotic Dynamics · Physics 2018-06-19 Alexandre Wagemakers , Miguel A. F. Sanjuán

We propose a unified framework for delay differential equations (DDEs) based on deep neural networks (DNNs) - the neural delay differential equations (NDDEs), aimed at solving the forward and inverse problems of delay differential…

Machine Learning · Computer Science 2024-08-27 Housen Wang , Yuxing Chen , Sirong Cao , Xiaoli Wang , Qiang Liu

Multiscale stochastic dynamical systems have been widely adopted to a variety of scientific and engineering problems due to their capability of depicting complex phenomena in many real world applications. This work is devoted to…

Machine Learning · Statistics 2024-01-02 Lingyu Feng , Ting Gao , Min Dai , Jinqiao Duan

Discovering the underlying relationships among variables from temporal observations has been a longstanding challenge in numerous scientific disciplines, including biology, finance, and climate science. The dynamics of such systems are…

Machine Learning · Computer Science 2024-05-07 Benjie Wang , Joel Jennings , Wenbo Gong

Identifying dynamical systems from experimental data is a notably difficult task. Prior knowledge generally helps, but the extent of this knowledge varies with the application, and customized models are often needed. Neural ordinary…

Systems and Control · Electrical Eng. & Systems 2023-01-13 Mona Buisson-Fenet , Valery Morgenthaler , Sebastian Trimpe , Florent Di Meglio

Neural Ordinary Differential Equations (NeuralODEs) present an attractive way to extract dynamical laws from time series data, as they bridge neural networks with the differential equation-based modeling paradigm of the physical sciences.…

Machine Learning · Computer Science 2024-01-24 Joon-Hyuk Ko , Hankyul Koh , Nojun Park , Wonho Jhe

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari