中文
相关论文

相关论文: On the Forward Invariance of Neural ODEs

200 篇论文

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

机器学习 · 计算机科学 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

This paper addresses the training of Neural Ordinary Differential Equations (neural ODEs), and in particular explores the interplay between numerical integration techniques, stability regions, step size, and initialization techniques. It is…

机器学习 · 计算机科学 2024-08-07 Theodor Westny , Arman Mohammadi , Daniel Jung , Erik Frisk

In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms. As an expository contribution we demonstrate how to re-formulate a wide variety of challenges from deep neural networks, (stochastic)…

动力系统 · 数学 2025-07-08 Dennis Chemnitz , Maximilian Engel , Christian Kuehn , Sara-Viola Kuntz

We study the ability of neural networks to calculate feedback control signals that steer trajectories of continuous time non-linear dynamical systems on graphs, which we represent with neural ordinary differential equations (neural ODEs).…

机器学习 · 计算机科学 2022-06-22 Thomas Asikis , Lucas Böttcher , Nino Antulov-Fantulin

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

机器学习 · 计算机科学 2020-02-19 Andreas Look , Melih Kandemir

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

机器学习 · 计算机科学 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Random ordinary differential equations (RODEs), i.e. ODEs with random parameters, are often used to model complex dynamics. Most existing methods to identify unknown governing RODEs from observed data often rely on strong prior knowledge.…

数值分析 · 数学 2020-06-04 Junyu Liu , Zichao Long , Ranran Wang , Jie Sun , Bin Dong

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

机器学习 · 计算机科学 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

机器学习 · 计算机科学 2025-02-24 Mariia Shapovalova , Calvin Tsay

Stiff systems of ordinary differential equations (ODEs) are pervasive in many science and engineering fields, yet standard neural ODE approaches struggle to learn them. This limitation is the main barrier to the widespread adoption of…

数值分析 · 数学 2024-10-10 Colby Fronk , Linda Petzold

We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these…

机器学习 · 统计学 2019-10-29 Emilien Dupont , Arnaud Doucet , Yee Whye Teh

We propose a neural control method to provide guaranteed stabilization for mechanical systems using a novel negative imaginary neural ordinary differential equation (NINODE) controller. Specifically, we employ neural networks with desired…

系统与控制 · 电气工程与系统科学 2025-04-29 Kanghong Shi , Ruigang Wang , Ian R. Manchester

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

机器学习 · 计算机科学 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Nonlinear ordinary differential equations (ODEs) are powerful tools for modeling real-world dynamical systems. However, propagating initial state uncertainty through nonlinear dynamics, especially when the ODE is unknown and learned from…

系统与控制 · 电气工程与系统科学 2026-02-06 Peter Amorese , Morteza Lahijanian

This paper introduces a new formulation for stochastic optimal control and stochastic dynamic optimization that ensures safety with respect to state and control constraints. The proposed methodology brings together concepts such as…

系统与控制 · 电气工程与系统科学 2021-02-19 Marcus Aloysius Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

A conventional approach to train neural ordinary differential equations (ODEs) is to fix an ODE solver and then learn the neural network's weights to optimize a target loss function. However, such an approach is tailored for a specific…

机器学习 · 计算机科学 2021-03-16 Julia Gusak , Alexandr Katrutsa , Talgat Daulbaev , Andrzej Cichocki , Ivan Oseledets

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

机器学习 · 计算机科学 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

Control problems frequently arise in scientific and industrial applications, where the objective is to steer a dynamical system from an initial state to a desired target state. Recent advances in deep learning and automatic differentiation…

系统与控制 · 电气工程与系统科学 2026-01-09 Lucas Böttcher

Neural ordinary differential equations (Neural ODEs) define continuous time dynamical systems with neural networks. The interest in their application for modelling has sparked recently, spanning hybrid system identification problems and…

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

数值分析 · 数学 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran