English
Related papers

Related papers: Contracting Implicit Recurrent Neural Networks: St…

200 papers

A method is presented to learn neural network (NN) controllers with stability and safety guarantees through imitation learning (IL). Convex stability and safety conditions are derived for linear time-invariant plant dynamics with NN…

Systems and Control · Electrical Eng. & Systems 2021-04-08 He Yin , Peter Seiler , Ming Jin , Murat Arcak

Important classes of active matter systems can be modeled using kinetic theories. However, kinetic theories can be high dimensional and challenging to simulate. Reduced-order representations based on tracking only low-order moments of the…

Computational Physics · Physics 2023-08-15 Suryanarayana Maddu , Scott Weady , Michael J. Shelley

We investigate the incremental stability properties of It\^o stochastic dynamical systems. Specifically, we derive a stochastic version of nonlinear contraction theory that provides a bound on the mean square distance between any two…

Optimization and Control · Mathematics 2011-11-09 Q. -C. Pham , N. Tabareau , J. -J. Slotine

The goal of this paper is to provide sufficient conditions for guaranteeing the Input-to-State Stability (ISS) and the Incremental Input-to-State Stability ({\delta}ISS) of Gated Recurrent Units (GRUs) neural networks. These conditions,…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Fabio Bonassi , Marcello Farina , Riccardo Scattolini

This paper presents a parameterization of nonlinear controllers for uncertain systems building on a recently developed neural network architecture, called the recurrent equilibrium network (REN), and a nonlinear version of the Youla…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Ruigang Wang , Ian R. Manchester

Positive systems describing networks with inherently non-negative states and inputs arise naturally in routing, logistics, and compartmental modelling. We consider problems modelled as positive linear systems in incidence form with linear…

Optimization and Control · Mathematics 2026-05-28 Roland Schurig , David Ohlin , Anders Rantzer , Emma Tegling , Rolf Findeisen

Instability of trained models, i.e., the dependence of individual node predictions on random factors, can affect reproducibility, reliability, and trust in machine learning systems. In this paper, we systematically assess the prediction…

Machine Learning · Computer Science 2022-05-23 Max Klabunde , Florian Lemmerich

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications…

Machine Learning · Computer Science 2021-03-30 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , Johan U. Backström , R. Bhushan Gopaluni

This paper presents the input convex neural network architecture. These are scalar-valued (potentially deep) neural networks with constraints on the network parameters such that the output of the network is a convex function of (some of)…

Machine Learning · Computer Science 2017-06-15 Brandon Amos , Lei Xu , J. Zico Kolter

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong

This paper addresses the problems of stabilization, robust control, and observer design for nonlinear systems. We build upon recently a proposed method based on contraction theory and convex optimization, extending the class of systems to…

Optimization and Control · Mathematics 2014-09-29 Ian R. Manchester , Jean-Jacques E. Slotine

In recent years, new regularization methods based on (deep) neural networks have shown very promising empirical performance for the numerical solution of ill-posed problems, e.g., in medical imaging and imaging science. Due to the…

Numerical Analysis · Mathematics 2024-06-07 Tim Jahn , Bangti Jin

Stability in recurrent neural models poses a significant challenge, particularly in developing biologically plausible neurodynamical models that can be seamlessly trained. Traditional cortical circuit models are notoriously difficult to…

Neurons and Cognition · Quantitative Biology 2025-01-16 Shivang Rawat , David J. Heeger , Stefano Martiniani

Making AI safe and dependable requires the generation of dependable models and dependable execution of those models. We propose redundant execution as a well-known technique that can be used to ensure reliable execution of the AI model.…

Artificial Intelligence · Computer Science 2024-05-10 Hans Dermot Doran , Suzana Veljanovska

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

This paper proposes a Fast Graph Convolutional Neural Network (FGRNN) architecture to predict sequences with an underlying graph structure. The proposed architecture addresses the limitations of the standard recurrent neural network (RNN),…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Sai Kiran Kadambari , Sundeep Prabhakar Chepuri

Recurrent neural networks have shown excellent performance in many applications, however they require increased complexity in hardware or software based implementations. The hardware complexity can be much lowered by minimizing the…

Machine Learning · Computer Science 2016-09-28 Sungho Shin , Kyuyeon Hwang , Wonyong Sung

Recent progress in style transfer on images has focused on improving the quality of stylized images and speed of methods. However, real-time methods are highly unstable resulting in visible flickering when applied to videos. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2017-05-08 Agrim Gupta , Justin Johnson , Alexandre Alahi , Li Fei-Fei