English
Related papers

Related papers: LyaNet: A Lyapunov Framework for Training Neural O…

200 papers

This paper presents L-Learning, a novel data-driven control framework for robotics that integrates Lyapunov stability theory with Lagrangian mechanics to enhance trajectory tracking performance. While traditional control methods often…

Robotics · Computer Science 2026-05-27 Quan Quan , Hao Li

This paper presents a theoretical overview of a Neural Contraction Metric (NCM): a neural network model of an optimal contraction metric and corresponding differential Lyapunov function, the existence of which is a necessary and sufficient…

Machine Learning · Computer Science 2021-10-05 Hiroyasu Tsukamoto , Soon-Jo Chung , Jean-Jacques Slotine , Chuchu Fan

In this work, we propose a novel layerwise adaptive construction method for neural network architectures. Our approach is based on a goal--oriented dual-weighted residual technique for the optimal control of neural differential equations.…

Optimization and Control · Mathematics 2026-01-13 Michael Hintermüller , Michael Hinze , Denis Korolev

Brains need to predict how the body reacts to motor commands. It is an open question how networks of spiking neurons can learn to reproduce the non-linear body dynamics caused by motor commands, using local, online and stable learning…

Neurons and Cognition · Quantitative Biology 2017-11-30 Aditya Gilra , Wulfram Gerstner

In chaotic dynamical systems such as the weather, prediction errors grow faster in some situations than in others. Real-time knowledge about the error growth could enable strategies to adjust the modelling and forecasting infrastructure…

Computational Physics · Physics 2023-04-26 Daniel Ayers , Jack Lau , Javier Amezcua , Alberto Carrassi , Varun Ojha

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where…

Machine Learning · Computer Science 2024-05-21 Liqun Zhao , Keyan Miao , Konstantinos Gatsis , Antonis Papachristodoulou

We present a technique for learning control Lyapunov-like functions, which are used in turn to synthesize controllers for nonlinear dynamical systems that can stabilize the system, or satisfy specifications such as remaining inside a safe…

Systems and Control · Computer Science 2019-06-06 Hadi Ravanbakhsh , Sriram Sankaranarayanan

This paper considers a wide class of smooth continuous dynamic nonlinear systems (control objects) with a measurable vector of state. The problem is to find a special function (Lyapunov function), which in the framework of the second…

Systems and Control · Electrical Eng. & Systems 2023-07-07 A. M. Zenkin , A. A. Peregudin , A. A. Bobtsov

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are…

Machine Learning · Computer Science 2019-06-07 Xuanqing Liu , Tesi Xiao , Si Si , Qin Cao , Sanjiv Kumar , Cho-Jui Hsieh

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

We present a unified convergence theory for gradient-based training of neural network methods for partial differential equations (PDEs), covering both physics-informed neural networks (PINNs) and the Deep Ritz method. For linear PDEs, we…

Numerical Analysis · Mathematics 2025-10-09 Wei Zhao , Tao Luo

We propose a composite Lyapunov framework for nonlinear autonomous systems that ensures strict decay through a pair of differential inequalities. The approach yields integral estimates, quantitative convergence rates, vanishing of…

Optimization and Control · Mathematics 2025-10-10 Hassan Saoud

Neural Ordinary Differential Equations (Neural ODEs) are the continuous analog of Residual Neural Networks (ResNets). We investigate whether the discrete dynamics defined by a ResNet are close to the continuous one of a Neural ODE. We first…

Machine Learning · Computer Science 2022-09-16 Michael E. Sander , Pierre Ablin , Gabriel Peyré

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise,…

Machine Learning · Computer Science 2021-03-23 Sifan Wang , Hanwen Wang , Paris Perdikaris

We propose a method to enhance the stability of a neural ordinary differential equation (neural ODE) by reducing the maximum error growth subsequent to a perturbation of the initial value. Since the stability depends on the logarithmic norm…

Numerical Analysis · Mathematics 2025-08-13 Arturo De Marinis , Nicola Guglielmi , Stefano Sicilia , Francesco Tudisco

This paper considers the problem of characterizing the stability region of a large-scale networked system comprised of dissipative nonlinear subsystems, in a distributed and computationally tractable way. One standard approach to estimate…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Amit Jena , Tong Huang , S. Sivaranjani , Dileep Kalathil , Le Xie

Robots capable of learning from demonstration (LfD) must exhibit stability while executing learned motion skills. To be effective in the real world, they should also remember multiple skills over time -- a capability lacking in current…

We propose a new method to ensure neural ordinary differential equations (ODEs) satisfy output specifications by using invariance set propagation. Our approach uses a class of control barrier functions to transform output specifications…

Machine Learning · Computer Science 2023-06-01 Wei Xiao , Tsun-Hsuan Wang , Ramin Hasani , Mathias Lechner , Yutong Ban , Chuang Gan , Daniela Rus