English
Related papers

Related papers: Neural ODEs as Feedback Policies for Nonlinear Opt…

200 papers

A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online…

Optimization and Control · Mathematics 2025-01-30 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

Neural and Evolutionary Computing · Computer Science 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Synthesizing optimal controllers for dynamical systems often involves solving optimization problems with hard real-time constraints. These constraints determine the class of numerical methods that can be applied: computationally expensive…

Optimization and Control · Mathematics 2022-03-16 Federico Berto , Stefano Massaroli , Michael Poli , Jinkyoo Park

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Neural controlled differential equations (Neural CDEs) are a continuous-time extension of recurrent neural networks (RNNs), achieving state-of-the-art (SOTA) performance at modelling functions of irregular time series. In order to interpret…

Machine Learning · Computer Science 2021-06-22 James Morrill , Patrick Kidger , Lingyi Yang , Terry Lyons

This short, self-contained article seeks to introduce and survey continuous-time deep learning approaches that are based on neural ordinary differential equations (neural ODEs). It primarily targets readers familiar with ordinary and…

Machine Learning · Computer Science 2024-01-09 Lars Ruthotto

This paper presents an intrinsic approach for addressing control problems with systems governed by linear ordinary differential equations (ODEs). We use computer algebra to constrain a Gaussian Process on solutions of ODEs. We obtain…

Optimization and Control · Mathematics 2025-04-18 Andreas Besginow , Markus Lange-Hegermann , Jörn Tebbe

Real-world systems are often formulated as constrained optimization problems. Techniques to incorporate constraints into Neural Networks (NN), such as Neural Ordinary Differential Equations (Neural ODEs), have been used. However, these…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

The time evolution of dynamical systems is frequently described by ordinary differential equations (ODEs), which must be solved for given initial conditions. Most standard approaches numerically integrate ODEs producing a single solution…

Machine Learning · Computer Science 2020-06-26 Cedric Flamant , Pavlos Protopapas , David Sondak

Discontinuities and delayed terms are encountered in the governing equations of a large class of problems ranging from physics and engineering to medicine and economics. These systems cannot be properly modelled and simulated with standard…

Artificial Intelligence · Computer Science 2024-09-27 Thibault Monsel , Onofrio Semeraro , Lionel Mathelin , Guillaume Charpiat

Solving nonlinear optimal control problems is a challenging task, particularly for high-dimensional problems. We propose algorithms for model-based policy iterations to solve nonlinear optimal control problems with convergence guarantees.…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Yiming Meng , Ruikun Zhou , Amartya Mukherjee , Maxwell Fitzsimmons , Christopher Song , Jun Liu

This work is concerned with solving neural network-based feedback controllers efficiently for optimal control problems. We first conduct a comparative study of two prevalent approaches: offline supervised learning and online direct policy…

Optimization and Control · Mathematics 2024-04-10 Yue Zhao , Jiequn Han

The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or…

Machine Learning · Computer Science 2022-12-01 Zhilu Lai , Wei Liu , Xudong Jian , Kiran Bacsa , Limin Sun , Eleni Chatzi

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

The well-posedness of a class of optimal control problems is analysed, where the state equation couples a nonlinear degenerate Fokker-Planck equation with a system of Ordinary Differential Equations (ODEs). Such problems naturally arise as…

Optimization and Control · Mathematics 2024-11-01 Francesca Anceschi , Giacomo Ascione , Daniele Castorina , Francesco Solombrino

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

In recent years, deep learning has been connected with optimal control as a way to define a notion of a continuous underlying learning problem. In this view, neural networks can be interpreted as a discretization of a parametric Ordinary…

Optimization and Control · Mathematics 2020-07-07 Joubine Aghili , Olga Mula