English
Related papers

Related papers: Neural Controlled Differential Equations for Onlin…

200 papers

Time delays are ubiquitous in industry, and they must be accounted for when designing control strategies. However, numerical optimal control (NOC) of delay differential equations (DDEs) is challenging because it requires specialized…

Optimization and Control · Mathematics 2024-10-22 Tobias K. S. Ritschel , Søren Stange

Automated mathematical reasoning is a challenging problem that requires an agent to learn algebraic patterns that contain long-range dependencies. Two particular tasks that test this type of reasoning are (1) mathematical equation…

Machine Learning · Computer Science 2021-04-08 Ankur Mali , Alexander Ororbia , Daniel Kifer , C. Lee Giles

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

A distributed model predictive control scheme is developed for tracking piecewise constant references where the terminal set is reconfigured online, whereas the terminal controller is computed offline. Unlike many standard existing schemes,…

Systems and Control · Electrical Eng. & Systems 2022-07-20 Ahmed Aboudonia , Goran Banjac , Annika Eichler , John Lygeros

In this article, we present an efficient deep learning method called coupled deep neural networks (CDNNs) for coupled physical problems. Our method compiles the interface conditions of the coupled PDEs into the networks properly and can be…

Numerical Analysis · Mathematics 2023-01-18 Jing Yue , Jian Li , Wen Zhang

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

We present a comprehensive evaluation of the robustness and explainability of ResNet-like models in the context of Unintended Radiated Emission (URE) classification and suggest a new approach leveraging Neural Stochastic Differential…

Machine Learning · Computer Science 2023-09-28 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Alvaro Velasquez

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Model Predictive Controllers (MPC) are widely used for controlling cyber-physical systems. It is an iterative process of optimizing the prediction of the future states of a robot over a fixed time horizon. MPCs are effective in practice,…

Robotics · Computer Science 2022-12-23 Aravindakumar Vijayasri Mohan Kumar

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

The unprecedented availability of large-scale datasets in neuroscience has spurred the exploration of artificial deep neural networks (DNNs) both as empirical tools and as models of natural neural systems. Their appeal lies in their ability…

Computational Engineering, Finance, and Science · Computer Science 2024-03-22 Ahmed ElGazzar , Marcel van Gerven

Recurrent Neural Networks (RNNs) are widely used for modelling neural activity, yet the mathematical interplay of core procedures is used to analyze them (temporal rescaling, discretization, and linearization) remain uncharacterized. This…

Neural and Evolutionary Computing · Computer Science 2025-04-08 Mariano Caruso , Cecilia Jarne

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

Machine Learning · Computer Science 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

Model predictive control (MPC) achieves stability and constraint satisfaction for general nonlinear systems, but requires computationally expensive online optimization. This paper studies approximations of such MPC controllers via neural…

Systems and Control · Electrical Eng. & Systems 2025-11-07 Henrik Hose , Johannes Köhler , Melanie N. Zeilinger , Sebastian Trimpe

We propose a framework based on Recurrent Neural Networks (RNNs) to determine an optimal control strategy for a discrete-time system that is required to satisfy specifications given as Signal Temporal Logic (STL) formulae. RNNs can store…

Systems and Control · Electrical Eng. & Systems 2020-09-25 Wenliang Liu , Noushin Mehdipour , Calin Belta

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters