English
Related papers

Related papers: Learnable Path in Neural Controlled Differential E…

200 papers

Combinations of neural ODEs with recurrent neural networks (RNN), like GRU-ODE-Bayes or ODE-RNN are well suited to model irregularly observed time series. While those models outperform existing discrete-time approaches, no theoretical…

Machine Learning · Statistics 2021-05-11 Calypso Herrera , Florian Krach , Josef Teichmann

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve…

Optimization and Control · Mathematics 2021-06-18 Jiequn Han , Ruimeng Hu

Neural ordinary differential equations (NODEs) have been proven useful for learning non-linear dynamics of arbitrary trajectories. However, current NODE methods capture variations across trajectories only via the initial state value or by…

Machine Learning · Computer Science 2023-11-14 Ilze Amanda Auzina , Çağatay Yıldız , Sara Magliacane , Matthias Bethge , Efstratios Gavves

The idea of neural Ordinary Differential Equations (ODE) is to approximate the derivative of a function (data model) instead of the function itself. In residual networks, instead of having a discrete sequence of hidden layers, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Seyedalireza Khoshsirat , Chandra Kambhamettu

In this work, we study the feasibility of using neural ordinary differential equations (NODEs) to model systems with intrinsic privacy properties. Unlike conventional feedforward neural networks, which have unlimited expressivity and can…

Cryptography and Security · Computer Science 2025-06-24 Sanghyun Hong , Fan Wu , Anthony Gruber , Kookjin Lee

Nonlinear model predictive control (MPC) is a flexible and increasingly popular framework used to synthesize feedback control strategies that can satisfy both state and control input constraints. In this framework, an optimization problem,…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Kong Yao Chee , M. Ani Hsieh , Nikolai Matni

Partial differential equation (PDE) models and their associated variational energy formulations are often rotationally invariant by design. This ensures that a rotation of the input results in a corresponding rotation of the output, which…

Machine Learning · Computer Science 2022-03-21 Tobias Alt , Karl Schrader , Joachim Weickert , Pascal Peter , Matthias Augustin

Traffic forecasting is one of the most popular spatio-temporal tasks in the field of machine learning. A prevalent approach in the field is to combine graph convolutional networks and recurrent neural networks for the spatio-temporal…

Machine Learning · Computer Science 2023-06-07 Jeongwhan Choi , Noseong Park

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Despite their elegant formulation and lightweight memory cost, neural ordinary differential equations (NODEs) suffer from known representational limitations. In particular, the single flow learned by NODEs cannot express all homeomorphisms…

Machine Learning · Computer Science 2021-04-16 Mathieu Chalvidal , Matthew Ricci , Rufin VanRullen , Thomas Serre

Time-delay mappings constructed using neural networks have proven successful in performing nonlinear system identification; however, because of their discrete nature, their use in bifurcation analysis of continuous-time systems is limited.…

Partial differential equations (PDEs) are indispensable for modeling many physical phenomena and also commonly used for solving image processing tasks. In the latter area, PDE-based approaches interpret image data as discretizations of…

Machine Learning · Computer Science 2018-12-12 Lars Ruthotto , Eldad Haber

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

Neural and Evolutionary Computing · Computer Science 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

Long-term traffic flow forecasting plays a crucial role in intelligent transportation as it allows traffic managers to adjust their decisions in advance. However, the problem is challenging due to spatio-temporal correlations and complex…

Machine Learning · Computer Science 2024-08-14 Zibo Liu , Zhe Jiang , Shigang Chen

Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…

Machine Learning · Computer Science 2021-05-12 Patrick Kidger , James Foster , Xuechen Li , Harald Oberhauser , Terry Lyons

There has been an increasing interest in modeling continuous-time dynamics of temporal graph data. Previous methods encode time-evolving relational information into a low-dimensional representation by specifying discrete layers of neural…

Machine Learning · Computer Science 2022-06-01 Jin Guo , Zhen Han , Zhou Su , Jiliang Li , Volker Tresp , Yuyi Wang

Neural architectures such as Recurrent Neural Networks (RNNs), Transformers, and State-Space Models have shown great success in handling sequential data by learning temporal dependencies. Decision Trees (DTs), on the other hand, remain a…

Machine Learning · Computer Science 2025-02-07 Sascha Marton , Moritz Schneider

Although ordinary differential equations (ODEs) provide insights for designing network architectures, its relationship with the non-residual convolutional neural networks (CNNs) is still unclear. In this paper, we present a novel ODE model…

Machine Learning · Statistics 2020-08-18 Zonghan Yang , Yang Liu , Chenglong Bao , Zuoqiang Shi

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss