English
Related papers

Related papers: An incremental input-to-state stability condition …

200 papers

Predictive models in acute care settings must be able to immediately recognize precipitous changes in a patient's status when presented with data reflecting such changes. Recurrent neural networks (RNNs) have become common for training and…

Machine Learning · Computer Science 2020-07-30 David Ledbetter , Eugene Laksana , Melissa Aczon , Randall Wetzel

This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability…

Machine Learning · Computer Science 2024-03-04 Igor Pontes Duff , Pawan Goyal , Peter Benner

This work proposes Recurrent Neural Network (RNN) models to predict structured 'image situations' -- actions and noun entities fulfilling semantic roles related to the action. In contrast to prior work relying on Conditional Random Fields…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Arun Mallya , Svetlana Lazebnik

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

We study the control of networked systems with the goal of optimizing both transient and steady-state performances while providing stability guarantees. Linear proportional-integral (PI) controllers are almost always used in practice, but…

Systems and Control · Electrical Eng. & Systems 2023-06-01 Wenqi Cui , Yan Jiang , Baosen Zhang , Yuanyuan Shi

This paper is concerned with the stability analysis of the recurrent neural networks (RNNs) by means of the integral quadratic constraint (IQC) framework. The rectified linear unit (ReLU) is typically employed as the activation function of…

Optimization and Control · Mathematics 2022-02-10 Yoshio Ebihara , Hayato Waki , Victor Magron , Ngoc Hoang Anh Mai , Dimitri Peaucelle , Sophie Tarbouriech

In this work we present a novel recurrent neural network architecture designed to model systems characterized by multiple characteristic timescales in their dynamics. The proposed network is composed by several recurrent groups of neurons…

Neural and Evolutionary Computing · Computer Science 2017-01-19 Filippo Maria Bianchi , Michael Kampffmeyer , Enrico Maiorino , Robert Jenssen

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Zhenyi Yuan , Changhong Zhao , Jorge Cortes

Recent advancements in artificial intelligence, particularly deep neural networks, have pushed the boundaries of what is achievable in complex tasks. Traditional methods for training neural networks in classification problems often rely on…

Machine Learning · Computer Science 2024-09-10 Jaouad Dabounou

A method is presented to learn neural network (NN) controllers with stability and safety guarantees through imitation learning (IL). Convex stability and safety conditions are derived for linear time-invariant plant dynamics with NN…

Systems and Control · Electrical Eng. & Systems 2021-04-08 He Yin , Peter Seiler , Ming Jin , Murat Arcak

Input-to-state stability (ISS) and $\mathcal{L}_2$-gain are well-known robust stability properties that continue to find wide application in the analysis and control of nonlinear dynamical systems and their interconnections. We investigate…

Optimization and Control · Mathematics 2014-05-02 Christopher M. Kellett , Peter M. Dower

Recurrent neural networks (RNNs) are the state of the art in sequence modeling for natural language. However, it remains poorly understood what grammatical characteristics of natural language they implicitly learn and represent as a…

Computation and Language · Computer Science 2018-09-06 Richard Futrell , Ethan Wilcox , Takashi Morita , Roger Levy

Recurrent neural networks (RNNs) are complex dynamical systems, capable of ongoing activity without any driving input. The long-term behavior of free-running RNNs, described by periodic, chaotic and fixed point attractors, is controlled by…

Neurons and Cognition · Quantitative Biology 2021-08-06 Claus Metzner , Patrick Krauss

The study proposes new results on the set input-to-state stability (ISS) subject to a small input time delay for compact, invariant sets that contains the origin. First, using the nonlinear small-gain theory, we prove a Razumikhin-type…

Systems and Control · Electrical Eng. & Systems 2022-11-24 Pallavi Sinha , Irinel-Constantin Morărescu , Sukumar Srikant

The paper proposes the use of structured neural networks for reinforcement learning based nonlinear adaptive control. The focus is on partially observable systems, with separate neural networks for the state and feedforward observer and the…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattson , Torbjörn Wigren

Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate the condition number of the weight matrix as a regularizing…

Machine Learning · Computer Science 2024-10-02 Rossen Nenov , Daniel Haider , Peter Balazs

Hierarchically gated linear RNN (HGRN, \citealt{HGRN}) has demonstrated competitive training speed and performance in language modeling while offering efficient inference. However, the recurrent state size of HGRN remains relatively small,…

Computation and Language · Computer Science 2024-08-20 Zhen Qin , Songlin Yang , Weixuan Sun , Xuyang Shen , Dong Li , Weigao Sun , Yiran Zhong

We propose a time-discounted integral variant of incremental input/output-to-state stability (i-iIOSS) together with an equivalent Lyapunov function characterization. Continuity of the i-iIOSS Lyapunov function is ensured if the system…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Julian D. Schiller , Matthias A. Müller

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear…

Machine Learning · Computer Science 2020-12-16 Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus , Radu Grosu