English
Related papers

Related papers: Perturbed Gradient Descent Algorithms are Small-Di…

200 papers

This paper presents a unification and a generalization of the small-gain theory subsuming a wide range of existing small-gain theorems. In particular, we introduce small-gain conditions that are necessary and sufficient to ensure…

Optimization and Control · Mathematics 2017-08-22 Navid Noroozi , Roman Geiselhart , Lars Grüne , Björn S. Rüffer , Fabian R. Wirth

When the state of a system may remain bounded even if both the input amplitude and energy are unbounded, then the state bounds given by the standard input-to-state stability (ISS) and integral-ISS (iISS) properties may provide no useful…

Systems and Control · Electrical Eng. & Systems 2025-06-02 Hernan Haimovich , Shenyu Liu , Antonio Russo , Jose L. Mancilla-Aguilar

In this paper ISS small-gain theorems for discrete-time systems are stated, which do not require input-to-state stability (ISS) of each subsystem. This approach weakens conservatism in ISS small-gain theory, and for the class of…

Dynamical Systems · Mathematics 2015-11-25 Roman Geiselhart , Fabian R. Wirth

An influential line of recent work has focused on the generalization properties of unregularized gradient-based learning procedures applied to separable linear classification with exponentially-tailed loss functions. The ability of such…

Machine Learning · Computer Science 2022-06-24 Matan Schliserman , Tomer Koren

This paper develops a neural network based control framework that ensures system safety and input-to-state stability (ISS) for general nonlinear switched systems with unknown dynamics. Leveraging the concept of dwell time, we derive…

Systems and Control · Electrical Eng. & Systems 2026-01-22 Bhabani Shankar Dey , Ahan Basu , Pushpak Jagtap

Solutions of optimization problems, including policy optimization in reinforcement learning, typically rely upon some variant of gradient descent. There has been much recent work in the machine learning, control, and optimization…

Machine Learning · Computer Science 2025-07-17 Eduardo D. Sontag

The present work provides two alternatives to formulate time-discounted incremental input/output-to-state stability (i-IOSS) as a suitable detectability notion for general nonlinear systems with non-additive disturbances. Both formulations…

Systems and Control · Electrical Eng. & Systems 2020-05-01 Sven Knuefer , Matthias A. Mueller

This paper addresses the robust stability of a boundary controlled system coupling two partial differential equations (PDEs), namely beam and string equations, in the presence of boundary and in-domain disturbances under the framework of…

Analysis of PDEs · Mathematics 2018-11-19 Jun Zheng , Hugo Lhachemi , Guchuan Zhu , David Saussi

Incremental input-to-state stability (delta-ISS) offers a robust framework to ensure that small input variations result in proportionally minor deviations in the state of a nonlinear system. This property is essential in practical…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Mahdieh Zaker , David Angeli , Abolfazl Lavaei

The main aim of this paper is to provide an analysis of gradient descent (GD) algorithms with gradient errors that do not necessarily vanish, asymptotically. In particular, sufficient conditions are presented for both stability (almost sure…

Systems and Control · Computer Science 2017-09-19 Arunselvan Ramaswamy , Shalabh Bhatnagar

This paper addresses input-to-state stability (ISS) properties with respect to boundary and in-domain disturbances for a class of semi-linear partial differential equations (PDEs) subject to Dirichlet boundary conditions. The developed…

Optimization and Control · Mathematics 2024-10-30 Jun Zheng , Guchuan Zhu

We develop a Lyapunov-based small-gain theorem for establishing fixed-time input-to-state stability (FxT-ISS) guarantees in interconnected nonlinear dynamical systems. The proposed framework considers interconnections in which each…

Systems and Control · Electrical Eng. & Systems 2025-12-25 Michael Tang , Miroslav Krstic , Jorge Poveda

This paper provides a Lyapunov-based small-gain theorem for input-to-state stability (ISS) of networks composed of infinitely many finite-dimensional systems. We model these networks on infinite-dimensional $\ell_{\infty}$-type spaces. A…

Optimization and Control · Mathematics 2021-03-15 Andrii Mironchenko , Navid Noroozi , Christoph Kawan , Majid Zamani

Input-to-state stability (ISS) allows estimating the impact of inputs and initial conditions on both the intermediate values and the asymptotic bound on the solutions. ISS has unified the input-output and Lyapunov stability theories and is…

Optimization and Control · Mathematics 2023-02-02 Andrii Mironchenko

This paper deals with the establishment of Input-to-State Stability (ISS) estimates for infinite dimensional systems with respect to both boundary and distributed disturbances. First, a new approach is developed for the establishment of ISS…

Optimization and Control · Mathematics 2019-08-07 Hugo Lhachemi , Robert Shorten

We prove that impulsive systems, which possess an ISS Lyapunov function, are ISS for time sequences satisfying the fixed dwell-time condition. If an ISS Lyapunov function is the exponential one, we provide a stronger result, which…

Dynamical Systems · Mathematics 2012-12-24 Sergey Dashkovskiy , Andrii Mironchenko

This paper addresses the input-to-state stability (ISS) and integral input-to-state stability (iISS) for a class of nonlinear higher dimensional parabolic partial differential equations (PDEs) with different types of boundary disturbances…

Analysis of PDEs · Mathematics 2020-06-24 Jun Zheng , Guchuan Zhu

We establish novel generalization bounds for learning algorithms that converge to global minima. We do so by deriving black-box stability results that only depend on the convergence of a learning algorithm and the geometry around the…

Machine Learning · Statistics 2017-10-25 Zachary Charles , Dimitris Papailiopoulos

This note establishes the Exponential Input-to-State Stability (EISS) property for a clamped-free damped string with respect to distributed and boundary disturbances. While efficient methods for establishing ISS properties for distributed…

Optimization and Control · Mathematics 2021-08-18 Hugo Lhachemi , David Saussié , Guchuan Zhu , Robert Shorten

The stochastic gradient descent (SGD) algorithm is the algorithm we use to train neural networks. However, it remains poorly understood how the SGD navigates the highly nonlinear and degenerate loss landscape of a neural network. In this…

Machine Learning · Computer Science 2025-06-13 Liu Ziyin , Hongchao Li , Masahito Ueda