English
Related papers

Related papers: Stabilizing reinforcement learning control: A modu…

200 papers

Reinforcement learning methods often produce brittle policies -- policies that perform well during training, but generalize poorly beyond their direct training experience, thus becoming unstable under small disturbances. To address this…

Robotics · Computer Science 2023-02-14 Sergey Pankov

In this work, we investigate the problem of simultaneously learning and controlling a system subject to adversarial choices of disturbances and system parameters. We study the problem for a scalar system with $l_\infty$-norm bounded…

Optimization and Control · Mathematics 2018-12-31 Dimitar Ho , Nikolai Matni , John C. Doyle

Recent studies suggest that context-aware low-rank approximation is a useful tool for compression and fine-tuning of modern large-scale neural networks. In this type of approximation, a norm is weighted by a matrix of input activations,…

Machine Learning · Computer Science 2026-03-26 Uliana Parkina , Maxim Rakhuba

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

This paper deals with data-driven stability analysis and feedback stabillization of linear input-output systems in autoregressive (AR) form. We assume that noisy input-output data on a finite time-interval have been obtained from some…

Optimization and Control · Mathematics 2022-06-20 Henk J. van Waarde , Jaap Eising , M. Kanat Camlibel , Harry L. Trentelman

Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters…

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional…

Systems and Control · Electrical Eng. & Systems 2022-04-05 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

Deep reinforcement learning approaches are becoming appealing for the design of nonlinear controllers for voltage control problems, but the lack of stability guarantees hinders their deployment in real-world scenarios. This paper constructs…

Systems and Control · Electrical Eng. & Systems 2023-08-31 Jie Feng , Wenqi Cui , Jorge Cortés , Yuanyuan Shi

In this paper, a novel online, output-feedback, critic-only, model-based reinforcement learning framework is developed for safety-critical control systems operating in complex environments. The developed framework ensures system stability…

Systems and Control · Electrical Eng. & Systems 2024-06-28 Tochukwu Elijah Ogri , Muzaffar Qureshi , Zachary I. Bell , Rushikesh Kamalapurkar

The paper proposes the use of structured neural networks for reinforcement learning based nonlinear adaptive control. The focus is on partially observable systems, with separate neural networks for the state and feedforward observer and the…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattson , Torbjörn Wigren

Finding a control Lyapunov function (CLF) in a dynamical system with a controller is an effective way to guarantee stability, which is a crucial issue in safety-concerned applications. Recently, deep learning models representing CLFs have…

Machine Learning · Computer Science 2025-11-04 Yupu Lu , Shijie Lin , Hao Xu , Zeqing Zhang , Jia Pan

Continual learning requires models to integrate new classes or domains over time while preserving previously acquired knowledge. Within this paradigm, foundation models often achieve strong performance, but they still remain subject to the…

Machine Learning · Computer Science 2026-02-20 Murat Onur Yildirim , Elif Ceren Gok Yildirim , Joaquin Vanschoren

In this paper, we directly design a state feedback controller that stabilizes a class of uncertain nonlinear systems solely based on input-state data collected from a finite-length experiment. Necessary and sufficient conditions are derived…

Systems and Control · Electrical Eng. & Systems 2021-03-30 Alessandro Luppi , Claudio De Persis , Pietro Tesi

Inverter-based distributed energy resources provide the possibility for fast time-scale voltage control by quickly adjusting their reactive power. The power-electronic interfaces allow these resources to realize almost arbitrary control…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Wenqi Cui , Jiayi Li , Baosen Zhang

This paper introduces new model parameterizations for learning discrete-time dynamical systems from data via the Koopman operator and studies their properties. Whereas most existing works on Koopman learning do not take into account the…

Systems and Control · Electrical Eng. & Systems 2025-05-09 Fletcher Fan , Bowen Yi , David Rye , Guodong Shi , Ian R. Manchester

This survey paper deals with the stabilization of nonlinear systems by analyzing the controlling method in terms of state feedback and output feedback. A brief overview of some literature on how the feedback controller of some dynamic…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Demelash Abiye Deguale

This paper addresses reinforcement learning based, direct signal tracking control with an objective of developing mathematically suitable and practically useful design approaches. Specifically, we aim to provide reliable and easy to…

Systems and Control · Electrical Eng. & Systems 2021-04-01 Zhikai Yao , Jennie Si , Ruofan Wu , Jianyong Yao

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key idea is to develop a new control-theoretic regularizer for dynamics fitting rooted in the notion of…

Systems and Control · Computer Science 2018-11-13 Sumeet Singh , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone