English
Related papers

Related papers: LyaNet: A Lyapunov Framework for Training Neural O…

200 papers

Most existing deep neural networks are static, which means they can only do inference at a fixed complexity. But the resource budget can vary substantially across different devices. Even on a single device, the affordable budget can change…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Taojiannan Yang , Sijie Zhu , Matias Mendieta , Pu Wang , Ravikumar Balakrishnan , Minwoo Lee , Tao Han , Mubarak Shah , Chen Chen

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

This paper investigates online identification and prediction for nonlinear stochastic dynamical systems. In contrast to offline learning methods, we develop online algorithms that learn unknown parameters from a single trajectory. A key…

Systems and Control · Electrical Eng. & Systems 2025-04-07 Lantian Zhang , Silun Zhang

In recent years, nonlinear dynamic system identification using artificial neural networks has garnered attention due to its broad potential applications across science and engineering. However, purely data-driven approaches often struggle…

Machine Learning · Computer Science 2025-11-06 Fabian J. Roth , Dominik K. Klein , Maximilian Kannapinn , Jan Peters , Oliver Weeger

Residual neural networks can be viewed as the forward Euler discretization of an Ordinary Differential Equation (ODE) with a unit time step. This has recently motivated researchers to explore other discretization approaches and train ODE…

Machine Learning · Computer Science 2019-07-02 Amir Gholami , Kurt Keutzer , George Biros

We provide Lyapunov-like characterizations of boundedness and convergence of non-trivial solutions for a class of systems with unstable invariant sets. Examples of systems to which the results may apply include interconnections of stable…

Dynamical Systems · Mathematics 2013-06-12 A. Gorban , I. Tyukin , E. Steur , H. Nijmeijer

This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Zhenyi Yuan , Changhong Zhao , Jorge Cortes

We present a data-driven framework based on Lyapunov theory to provide stability guarantees for a family of hybrid systems. In particular, we are interested in the asymptotic stability of switching linear systems whose switching sequence is…

Systems and Control · Electrical Eng. & Systems 2023-02-13 Adrien Banse , Zheming Wang , Raphaël M. Jungers

This paper presents an Euler--Lagrange system for a continuous-time model of the accelerated gradient methods in smooth convex optimization and proposes an associated Lyapunov-function-based convergence analysis framework. Recently,…

Optimization and Control · Mathematics 2024-04-05 Mitsuru Toyoda , Akatsuki Nishioka , Mirai Tanaka

The robust tracking and model following problem of linear discrete-time systems is investigated in this paper. An approach to design robust tracking controllers is proposed. The system is controlled to track dynamic inputs generated from a…

Systems and Control · Computer Science 2016-07-12 Omar Zakary , Mostafa Rachik

Recent advancements in artificial intelligence, particularly deep neural networks, have pushed the boundaries of what is achievable in complex tasks. Traditional methods for training neural networks in classification problems often rely on…

Machine Learning · Computer Science 2024-09-10 Jaouad Dabounou

Deep neural networks (DNN) have shown great capacity of modeling a dynamical system; nevertheless, they usually do not obey physics constraints such as conservation laws. This paper proposes a new learning framework named ConCerNet to…

Machine Learning · Computer Science 2023-07-20 Wang Zhang , Tsui-Wei Weng , Subhro Das , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

This paper presents a novel scalable framework to solve the optimization of a nonlinear system with differential algebraic equation (DAE) constraints that enforce the asymptotic stability of the underlying dynamic model with respect to…

Optimization and Control · Mathematics 2018-10-11 Qifeng Li , Konstantin Turitsyn

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Determination of stability and instability of singular points in nonlinear dynamical systems is an important issue that has attracted considerable attention in different fields of engineering and science. So far, different well-defined…

Systems and Control · Electrical Eng. & Systems 2021-11-02 A. R. Tavakolpour-Saleh

Neural ordinary differential equations (neural ODEs) have emerged as a novel network architecture that bridges dynamical systems and deep learning. However, the gradient obtained with the continuous adjoint method in the vanilla neural ODE…

Machine Learning · Computer Science 2023-06-12 Hong Zhang , Wenjun Zhao

Inverse parallel schemes remain indispensable tools for computing the roots of nonlinear systems, yet their dynamical behavior can be unexpectedly rich, ranging from strong contraction to oscillatory or chaotic transients depending on the…

Numerical Analysis · Mathematics 2026-01-21 Mudassir Shams , Andrei Velichko , Bruno Carpentieri

In this work, we present a machine learning approach for reducing the error when numerically solving time-dependent partial differential equations (PDE). We use a fully convolutional LSTM network to exploit the spatiotemporal dynamics of…

Machine Learning · Computer Science 2020-02-11 Ben Stevens , Tim Colonius