English
Related papers

Related papers: On the Forward Invariance of Neural ODEs

200 papers

Neural operators, which emerge as implicit solution operators of hidden governing equations, have recently become popular tools for learning responses of complex real-world physical systems. Nevertheless, the majority of neural operator…

Machine Learning · Computer Science 2023-01-31 Ning Liu , Yue Yu , Huaiqian You , Neeraj Tatikola

Parameter estimation for ordinary differential equations (ODEs) plays a fundamental role in the analysis of dynamical systems. Generally lacking closed-form solutions, ODEs are traditionally approximated using deterministic solvers.…

Computation · Statistics 2025-06-30 Mohan Wu , Martin Lysy

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such…

Optimization and Control · Mathematics 2026-05-21 Alain Bensoussan , Minh-Binh Tran , Bangjie Wang

We present a method for the approximate propagation of mean and covariance of a probability distribution through ordinary differential equations (ODE) with discontinous right-hand side. For piecewise affine systems, a normalization of the…

Optimization and Control · Mathematics 2024-03-06 Florian Messerer , Katrin Baumgärtner , Armin Nurkanović , Moritz Diehl

The continuous dynamics of natural systems has been effectively modelled using Neural Ordinary Differential Equations (Neural ODEs). However, for accurate and meaningful predictions, it is crucial that the models follow the underlying rules…

Machine Learning · Computer Science 2024-03-06 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

We present a novel approach that redefines the traditional interpretation of explicit and implicit discretization methods for solving a general class of advection-diffusion equations (ADEs) featuring nonlinear advection, diffusion…

Analysis of PDEs · Mathematics 2025-06-10 Amin Jafarimoghaddam , Manuel Soler , Irene Ortiz

Inverse problem or parameter estimation of ordinary differential equations (ODEs), the iterative process of minimizing the mismatch between model-predicted and experimental states by tuning the parameter values within an optimization…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been largely ignored in the context of learning solution operators of…

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation…

The goal of Out-of-Distribution (OOD) generalization problem is to train a predictor that generalizes on all environments. Popular approaches in this field use the hypothesis that such a predictor shall be an \textit{invariant predictor}…

Machine Learning · Statistics 2021-11-29 Masanori Koyama , Shoichiro Yamaguchi

We introduce a novel approach to video modeling that leverages controlled differential equations (CDEs) to address key challenges in video tasks, notably video interpolation and mask propagation. We apply CDEs at varying resolutions leading…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Johnathan Chiu , Samuel Duffield , Max Hunter-Gordon , Kaelan Donatella , Max Aifer , Andi Gu

We present a review of methods for optimal experimental design (OED) for Bayesian inverse problems governed by partial differential equations with infinite-dimensional parameters. The focus is on problems where one seeks to optimize the…

Optimization and Control · Mathematics 2021-02-01 Alen Alexanderian

To characterize a physical system to behave as desired, either its underlying governing rules must be known a priori or the system itself be accurately measured. The complexity of full measurements of the system scales with its size. When…

Machine Learning · Computer Science 2021-10-27 Babak Rahmani , Demetri Psaltis , Christophe Moser

Due to their expressive power, neural networks (NNs) are promising templates for functional optimization problems, particularly for reach-avoid certificate generation for systems governed by stochastic differential equations (SDEs).…

Systems and Control · Electrical Eng. & Systems 2026-03-03 Chun-Wei Kong , Sebastian Escobar , Ibon Gracia , Jay McMahon , Morteza Lahijanian

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

This paper proposes a novel approach to improve the performance of distributed nonlinear control systems while preserving stability by leveraging Deep Neural Networks (DNNs). We build upon the Neural System Level Synthesis (Neur-SLS)…

Optimization and Control · Mathematics 2024-08-01 Danilo Saccani , Leonardo Massai , Luca Furieri , Giancarlo Ferrari-Trecate

In this work, we introduce and study a class of Deep Neural Networks (DNNs) in continuous-time. The proposed architecture stems from the combination of Neural Ordinary Differential Equations (Neural ODEs) with the model structure of…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Daniele Martinelli , Clara Lucía Galimberti , Ian R. Manchester , Luca Furieri , Giancarlo Ferrari-Trecate

Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent…

Optimization and Control · Mathematics 2022-10-28 Patrick L. Combettes , Jean-Christophe Pesquet , Audrey Repetti