English
Related papers

Related papers: Integral Quadratic Constraints for Repeated ReLU

200 papers

In the existing literature, there are two approaches to estimate tighter bounds of the exponential convergence rate of stable Lure systems. On one hand, the classical integral quadratic constraint (IQC) framework can be applied under…

Optimization and Control · Mathematics 2019-02-26 Jingfan Zhang , Peter Seiler , Joaquin Carrasco

In this work, we propose a tube-based MPC scheme for state- and input-constrained linear systems subject to dynamic uncertainties characterized by dynamic integral quadratic constraints (IQCs). In particular, we extend the framework of…

Optimization and Control · Mathematics 2022-05-03 Lukas Schwenkel , Johannes Köhler , Matthias A. Müller , Frank Allgöwer

Deep neural networks, particularly those employing Rectified Linear Units (ReLU), are often perceived as complex, high-dimensional, non-linear systems. This complexity poses a significant challenge to understanding their internal learning…

Machine Learning · Computer Science 2025-11-11 Longqing Ye

We present an ideal mixed-integer programming (MIP) formulation for a rectified linear unit (ReLU) appearing in a trained neural network. Our formulation requires a single binary variable and no additional continuous variables beyond the…

Optimization and Control · Mathematics 2019-03-04 Ross Anderson , Joey Huchette , Christian Tjandraatmadja , Juan Pablo Vielma

Iterative learning control (ILC) is a powerful technique for high performance tracking in the presence of modeling errors for optimal control applications. There is extensive prior work showing its empirical effectiveness in applications…

Robotics · Computer Science 2021-12-10 Anirudh Vemula , Wen Sun , Maxim Likhachev , J. Andrew Bagnell

This brief addresses the design of a Nonlinear Model Predictive Control (NMPC) strategy for exponentially incremental Input-to-State Stable (ISS) systems. In particular, a novel formulation is devised, which does not necessitate the onerous…

Systems and Control · Electrical Eng. & Systems 2023-11-02 Fabio Bonassi , Alessio La Bella , Marcello Farina , Riccardo Scattolini

Autonomous spacecraft inspection and docking missions require controllers that can guarantee safety under thrust constraints and uncertainty. Input-constrained control barrier functions (ICCBFs) provide a framework for safety certification…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Minduli C. Wijayatunga , Richard Linares , Roberto Armellin

In order to obviate the requirement of drift dynamics in adaptive dynamic programming (ADP), integral reinforcement learning (IRL) has been proposed as an alternate formulation of Bellman equation.However control coupling dynamics is still…

Systems and Control · Electrical Eng. & Systems 2020-05-11 Amardeep Mishra , Satadal Ghosh

This paper studies data-driven approaches to the continuous-time linear quadratic regulator (LQR) problem based on two existing parameterizations, namely a closed-loop (CL) parameterization from behavioral system theory and an integral…

Optimization and Control · Mathematics 2026-05-01 Armin Gießler , Felix Thömmes , Sören Hohmann

We propose a novel framework to solve risk-sensitive reinforcement learning (RL) problems where the agent optimises time-consistent dynamic spectral risk measures. Based on the notion of conditional elicitability, our methodology constructs…

Machine Learning · Computer Science 2023-05-02 Anthony Coache , Sebastian Jaimungal , Álvaro Cartea

This paper proposes a robust control strategy that integrates Iterative Learning Control (ILC) with a simple lateral neural network to enhance the trajectory tracking performance of a linear Lorentz force actuator under friction and model…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Ali Mashhadireza , Ali Sadighi

A significant limitation of Deep Reinforcement Learning (DRL) is the stochastic uncertainty in actions generated during exploration-exploitation, which poses substantial safety risks during both training and deployment. In industrial…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Runze Lin , Ziqi Zhuo , Junghui Chen , Lei Xie , Hongye Su

Inspired by REINFORCE, we introduce a novel receding-horizon algorithm for the Linear Quadratic Regulator (LQR) problem with unknown dynamics. Unlike prior methods, our algorithm avoids reliance on two-point gradient estimates while…

Optimization and Control · Mathematics 2025-10-07 Amirreza Neshaei Moghaddam , Alex Olshevsky , Bahman Gharesifard

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

In this paper, we analyze the stability of feedback interconnections of a linear time-invariant system with a neural network nonlinearity in discrete time. Our analysis is based on abstracting neural networks using integral quadratic…

Systems and Control · Electrical Eng. & Systems 2021-10-01 Patricia Pauli , Dennis Gramlich , Julian Berberich , Frank Allgöwer

This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Sayak Mukherjee , Thanh Long Vu

Iterative linear-quadratic (ILQ) methods are widely used in the nonlinear optimal control community. Recent work has applied similar methodology in the setting of multiplayer general-sum differential games. Here, ILQ methods are capable of…

Systems and Control · Electrical Eng. & Systems 2020-03-20 David Fridovich-Keil , Vicenc Rubies-Royo , Claire J. Tomlin

Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's…

Machine Learning · Computer Science 2020-12-04 Wonseok Jeon , Chen-Yang Su , Paul Barde , Thang Doan , Derek Nowrouzezahrai , Joelle Pineau

This paper presents iterative Sequential Action Control (iSAC), a receding horizon approach for control of nonlinear systems. The iSAC method has a closed-form open-loop solution, which is iteratively updated between time steps by…

Robotics · Computer Science 2018-11-01 Emmanouil Tzorakoleftherakis , Todd Murphey

Contraction properties of the Riccati operator are studied within the context of non-stationary linear-quadratic optimal control. A lifting approach is used to obtain a bound on the rate of strict contraction, with respect to the Riemannian…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Jintao Sun , Michael Cantoni