English
Related papers

Related papers: Recurrent Equilibrium Networks: Flexible Dynamic M…

200 papers

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

Recurrent stochastic configuration networks (RSCNs) have shown great potential in modelling nonlinear dynamic systems with uncertainties. This paper presents an RSCN with hybrid regularization to enhance both the learning capacity and…

Machine Learning · Computer Science 2024-12-03 Gang Dang , Dianhui Wang

This paper aims to discuss and analyze the potentialities of Recurrent Neural Networks (RNN) in control design applications. The main families of RNN are considered, namely Neural Nonlinear AutoRegressive eXogenous, (NNARX), Echo State…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Fabio Bonassi , Marcello Farina , Jing Xie , Riccardo Scattolini

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear…

Machine Learning · Computer Science 2020-12-16 Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus , Radu Grosu

Recurrent neural networks (RNNs) are nonlinear dynamical models commonly used in the machine learning and dynamical systems literature to represent complex dynamical or sequential relationships between variables. More recently, as deep…

Methodology · Statistics 2018-02-08 Patrick L. McDermott , Christopher K. Wikle

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

It is widely accepted that the complex dynamics characteristic of recurrent neural circuits contributes in a fundamental manner to brain function. Progress has been slow in understanding and exploiting the computational power of recurrent…

Chaotic Dynamics · Physics 2013-07-18 Rodrigo Laje , Dean V. Buonomano

In this study, we investigate the continuous time dynamics of Recurrent Neural Networks (RNNs), focusing on systems with nonlinear activation functions. The objective of this work is to identify conditions under which RNNs exhibit perpetual…

Machine Learning · Computer Science 2025-04-22 Michele Casoni , Tommaso Guidi , Alessandro Betti , Stefano Melacci , Marco Gori

We study parameterizations of stabilizing nonlinear policies for learning-based control. We propose a structure based on a nonlinear version of the Youla-Kucera parameterization combined with robust neural networks such as the recurrent…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Nicholas H. Barbara , Ruigang Wang , Alexandre Megretski , Ian R. Manchester

This paper proposes a Recurrent Neural Network (RNN) controller for lane-keeping systems, effectively handling model uncertainties and disturbances. First, quadratic constraints cover the nonlinearities brought by the RNN controller, and…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Ying Shuai Quan , Jin Sung Kim , Chung Choo Chung

We propose a parameterization of a nonlinear dynamic controller based on the recurrent equilibrium network, a generalization of the recurrent neural network. We derive constraints on the parameterization under which the controller…

Systems and Control · Electrical Eng. & Systems 2024-04-15 Neelay Junnarkar , He Yin , Fangda Gu , Murat Arcak , Peter Seiler

Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic…

Machine Learning · Computer Science 2024-10-29 Gang Dang , Dianhui Wang

Regression neural networks (NNs) are most commonly trained by minimizing the mean squared prediction error, which is highly sensitive to outliers and data contamination. Existing robust training methods for regression NNs are often limited…

Machine Learning · Statistics 2026-02-10 Abhik Ghosh , Suryasis Jana

Computational efficiency and robustness are essential in process modeling, optimization, and control for real-world engineering applications. While neural network-based approaches have gained significant attention in recent years,…

Machine Learning · Computer Science 2026-03-17 Zihao Wang , Yuhan Li , Yao Shi , Zhe Wu

For a given stable recurrent neural network (RNN) that is trained to perform a classification task using sequential inputs, we quantify explicit robustness bounds as a function of trainable weight matrices. The sequential inputs can be…

Machine Learning · Computer Science 2022-03-11 Guangyi Liu , Arash Amini , Martin Takac , Nader Motee

This paper proposes a novel sufficient condition for the incremental input-to-state stability of a generic class of recurrent neural networks (RNNs). The established condition is compared with others available in the literature, showing to…

Systems and Control · Electrical Eng. & Systems 2023-11-08 William D'Amico , Alessio La Bella , Marcello Farina

Recurrent Neural Cascades (RNCs) are the recurrent neural networks with no cyclic dependencies among recurrent neurons. This class of recurrent networks has received a lot of attention in practice. Besides training methods for a fixed…

Machine Learning · Computer Science 2024-09-09 Nadezda Alexandrovna Knorozova , Alessandro Ronca

In this paper, we focus on recovery control of nonlinear systems from attacks or failures. The main challenges of this problem lie in (1) learning the unknown dynamics caused by attacks or failures with formal guarantees, and (2) finding…

Systems and Control · Electrical Eng. & Systems 2025-11-07 Zihao Song , Shirantha Welikala , Panos J. Antsaklis , Hai Lin

Quantum neural networks have emerged as promising quantum machine learning models, leveraging the properties of quantum systems and classical optimization to solve complex problems in physics and beyond. However, previous studies have…

Quantum Physics · Physics 2025-06-17 Mingrui Jing , Erdong Huang , Xiao Shi , Shengyu Zhang , Xin Wang