English
Related papers

Related papers: Integral Quadratic Constraints for Repeated ReLU

200 papers

We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption,…

Machine Learning · Computer Science 2020-06-26 Bhaskar Mukhoty , Govind Gopakumar , Prateek Jain , Purushottam Kar

In this study, we investigate the continuous time dynamics of Recurrent Neural Networks (RNNs), focusing on systems with nonlinear activation functions. The objective of this work is to identify conditions under which RNNs exhibit perpetual…

Machine Learning · Computer Science 2025-04-22 Michele Casoni , Tommaso Guidi , Alessandro Betti , Stefano Melacci , Marco Gori

We study cooperative control dynamics with gradient based forcing terms. As a specific example, we focus on source-seeking dynamics with vehicles embedded in an unknown scalar field with a subset of agents having gradient information. As…

Optimization and Control · Mathematics 2023-05-30 Adwait Datar , Christian Hespe , Herbert Werner

Iteration limited model predictive control (MPC) can stabilize a feedback control system under sufficient conditions; this work explores combining a low iteration limit MPC with a high iteration limit MPC for mixed-integer quadratic…

Optimization and Control · Mathematics 2026-02-11 Luke Fina , Christopher Petersen

This paper studies an infinite horizon optimal control problem for discrete-time linear systems and quadratic criteria, both with random parameters which are independent and identically distributed with respect to time. A classical approach…

Optimization and Control · Mathematics 2020-11-11 Kai Du , Qingxin Meng , Fu Zhang

This paper applies a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where drift and diffusion terms in the dynamics may depend on both the state and control. Based on…

Optimization and Control · Mathematics 2021-09-17 Na Li , Xun Li , Jing Peng , Zuo Quan Xu

A robust Learning Model Predictive Controller (LMPC) for uncertain systems performing iterative tasks is presented. At each iteration of the control task the closed-loop state, input and cost are stored and used in the controller design.…

Systems and Control · Electrical Eng. & Systems 2021-07-06 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

The paper presents a novel approach to synthesize robust controllers for nonlinear systems along perturbed trajectories. The approach linearizes the system with respect to a reference trajectory. In contrast to existing methods rooted in…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Felix Biertümpfel , Peter Seiler , Harald Pfifer

The increasing penetration of converter-based renewable generation has resulted in faster frequency dynamics, and low and variable inertia. As a result, there is a need for frequency control methods that are able to stabilize a disturbance…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Jie Feng , Manasa Muralidharan , Rodrigo Henriquez-Auba , Patricia Hidalgo-Gonzalez , Yuanyuan Shi

Robust Model Predictive Control (MPC) for nonlinear systems is a problem that poses significant challenges as highlighted by the diversity of approaches proposed in the last decades. Often compromises with respect to computational load,…

Systems and Control · Electrical Eng. & Systems 2024-02-21 Daniel D. Leister , Justin P. Koeln

This article focuses on making discrete-time Adaptive Iterative Learning Control (ILC) more effective using multiple estimation models. Existing strategies use the tracking error to adjust the parametric estimates. Our strategy uses the…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ram Padmanabhan , Rajini Makam , Koshy George

We present a continuous-time equivalent to the well-known iterative linear-quadratic algorithm including an implementation of a backtracking line-search policy and a novel regularization approach based on the necessary conditions in the…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Juraj Lieskovský , Jaroslav Bušek , Tomáš Vyhlídal

It is commonly recognized that the expressiveness of deep neural networks is contingent upon a range of factors, encompassing their depth, width, and other relevant considerations. Currently, the practical performance of the majority of…

Machine Learning · Computer Science 2023-11-08 Xuan Qi , Yi Wei

In recent times, a variety of Reinforcement Learning (RL) algorithms have been proposed for optimal tracking problem of continuous time nonlinear systems with input constraints. Most of these algorithms are based on the notion of uniform…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Amardeep Mishra , Satadal Ghosh

Active screening is a common approach in controlling the spread of recurring infectious diseases such as tuberculosis and influenza. In this approach, health workers periodically select a subset of population for screening. However, given…

Machine Learning · Computer Science 2021-04-20 Han-Ching Ou , Haipeng Chen , Shahin Jabbari , Milind Tambe

Rectified Linear Units (ReLUs) have been shown to ameliorate the vanishing gradient problem, allow for efficient backpropagation, and empirically promote sparsity in the learned parameters. They have led to state-of-the-art results in a…

Machine Learning · Computer Science 2016-05-30 Xingyuan Pan , Vivek Srikumar

In this paper we investigate the performance of different types of rectified activation functions in convolutional neural network: standard rectified linear unit (ReLU), leaky rectified linear unit (Leaky ReLU), parametric rectified linear…

Machine Learning · Computer Science 2015-11-30 Bing Xu , Naiyan Wang , Tianqi Chen , Mu Li

We present an efficient algorithm to compute the induced norms of finite-horizon Linear Time-Varying (LTV) systems. The formulation includes both induced $\mathcal{L}_2$ and terminal Euclidean norm penalties. Existing computational…

Systems and Control · Electrical Eng. & Systems 2020-11-03 Jyot Buch , Murat Arcak , Peter Seiler

Implicit Neural Representations (INRs) have revolutionized signal processing and computer vision by modeling signals as continuous, differentiable functions parameterized by neural networks. However, INRs are prone to the spectral bias…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Haider , Muhammad Salman Ali , Maryam Qamar , Tahir Khalil , Soo Ye Kim , Jihyong Oh , Enzo Tartaglione , Sung-Ho Bae

This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major limitations of…

Machine Learning · Computer Science 2025-05-16 Yutao Yang , Jie Zhou , Junsong Li , Qianjun Pan , Bihao Zhan , Qin Chen , Xipeng Qiu , Liang He
‹ Prev 1 8 9 10 Next ›