English
Related papers

Related papers: Lyapunov-Stable Deep Equilibrium Models

200 papers

A retrovirus dynamic model is proposed. We pay attention to the case when viral pathogenicity is low and the infected cells are able to reproduce. Using Lyapunov function method we study stability properties of an inner equilibrium of the…

Dynamical Systems · Mathematics 2019-01-01 Andrei Korobeinikov , Alexander Rezounenko

When neural networks are used to model dynamics, properties such as stability of the dynamics are generally not guaranteed. In contrast, there is a recent method for learning the dynamics of autonomous systems that guarantees global…

Machine Learning · Computer Science 2022-03-21 Kenji Kashima , Ryota Yoshiuchi , Yu Kawano

A deep equilibrium model (DEQ) is implicitly defined through an equilibrium point of an infinite-depth weight-tied model with an input-injection. Instead of infinite computations, it solves an equilibrium point directly with root-finding…

Machine Learning · Computer Science 2023-03-30 Zenan Ling , Xingyu Xie , Qiuhao Wang , Zongpeng Zhang , Zhouchen Lin

In this paper, we introduce a novel class of neural differential equation, which are intrinsically Lyapunov stable, exponentially stable or passive. We take a recently proposed Polyak Lojasiewicz network (PLNet) as an Lyapunov function and…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Jing Cheng , Ruigang Wang , Ian R. Manchester

Many tasks in deep learning involve optimizing over the \emph{inputs} to a network to minimize or maximize some objective; examples include optimization over latent spaces in a generative model to match a target image, or adversarially…

Machine Learning · Computer Science 2021-11-29 Swaminathan Gurumurthy , Shaojie Bai , Zachary Manchester , J. Zico Kolter

The paper is devoted to the study of stability of equilibrium solutions of a delay differential equation that models leukemia. The equation was previously studied in [5] and [6], where the emphasis is put on the numerical study of periodic…

Dynamical Systems · Mathematics 2010-01-27 Anca Veronica Ion

In this paper, we present a framework for Stability Analysis of Systems of Coupled Linear Partial-Differential Equations. The class of PDE systems considered in this paper includes parabolic, elliptic and hyperbolic systems with Dirichelet,…

Optimization and Control · Mathematics 2018-03-28 Matthew M. Peet

Equivariant imaging (EI) enables training signal reconstruction models without requiring ground truth data by leveraging signal symmetries. Deep equilibrium models (DEQs) are a powerful class of neural networks where the output is a fixed…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Alexander Mehta , Ruangrawee Kitichotkul , Vivek K Goyal , Julián Tachella

While ensuring stability for linear systems is well understood, it remains a major challenge for nonlinear systems. A general approach in such cases is to compute a combination of a Lyapunov function and an associated control policy.…

Machine Learning · Computer Science 2023-12-27 Junlin Wu , Andrew Clark , Yiannis Kantaros , Yevgeniy Vorobeychik

Hyperexponential stability is investigated for dynamical systems with the use of both, explicit and implicit, Lyapunov function methods. A nonlinear hyperexponential control is designed for stabilizing linear systems. The tuning procedure…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Konstantin Zimenko , Denis Efimov , Andrey Polyakov

Deep equilibrium models (DEQs) have recently emerged as a powerful paradigm for training infinitely deep weight-tied neural networks that achieve state of the art performance across many modern machine learning tasks. Despite their…

Machine Learning · Computer Science 2026-01-13 Sanjit Dandapanthula , Aaditya Ramdas

Implicit-depth models such as Deep Equilibrium Networks have recently been shown to match or exceed the performance of traditional deep networks while being much more memory efficient. However, these models suffer from unstable convergence…

Machine Learning · Computer Science 2021-05-05 Ezra Winston , J. Zico Kolter

The robust tracking and model following problem of linear discrete-time systems is investigated in this paper. An approach to design robust tracking controllers is proposed. The system is controlled to track dynamic inputs generated from a…

Systems and Control · Computer Science 2016-07-12 Omar Zakary , Mostafa Rachik

Human posture control models are used to analyse neurological experiments and control of humanoid robots. This work focuses on a well-known nonlinear posture control model, the DEC (Disturbance estimate and Compensation). In order to…

Systems and Control · Electrical Eng. & Systems 2021-03-08 Vittorio Lippi , Fabio Molinari

The Lyapunov inequality is an indispensable tool for stability analysis in linear control theory. It provides a necessary and sufficient condition for the stability of an autonomous linear-time invariant system in terms of the existence of…

Optimization and Control · Mathematics 2025-12-24 Avinash Kumar

This thesis addresses the question of stability of systems defined by differential equations which contain nonlinearity and delay. In particular, we analyze the stability of a well-known delayed nonlinear implementation of a certain…

Dynamical Systems · Mathematics 2007-05-23 Matthew M. Peet

Stability analysis plays a crucial role in studying the behavior of dynamical systems with theoretical and engineering applications. Among various kinds of stability, the stability of equilibrium points is of the greatest importance which…

Dynamical Systems · Mathematics 2019-01-25 Arash Mehrjou , Bernhard Schölkopf

This paper considers the stability problem of a linear time invariant system in feedback with a string equation. A new Lyapunov functional candidate is proposed based on the use of augmented states which enriches and encompasses the…

Analysis of PDEs · Mathematics 2019-04-25 Matthieu Barreau , Alexandre Seuret , Frédéric Gouaisbaut , Lucie Baudouin

Implicit models such as Deep Equilibrium Models (DEQs) have garnered significant attention in the community for their ability to train infinite layer models with elegant solution-finding procedures and constant memory footprint. However,…

Machine Learning · Computer Science 2023-10-23 Haobo Song , Soumajit Majumder , Tao Lin

Deep neural networks (DNNs) are vulnerable to subtle adversarial perturbations applied to the input. These adversarial perturbations, though imperceptible, can easily mislead the DNN. In this work, we take a control theoretic approach to…

Machine Learning · Computer Science 2019-11-13 Arash Rahnama , Andre T. Nguyen , Edward Raff