English
Related papers

Related papers: A modular framework for stabilizing deep reinforce…

200 papers

Model-free RL-based recommender systems have recently received increasing research attention due to their capability to handle partial feedback and long-term rewards. However, most existing research has ignored a critical feature in…

Machine Learning · Computer Science 2023-08-28 Tianchi Cai , Shenliao Bao , Jiyan Jiang , Shiji Zhou , Wenpeng Zhang , Lihong Gu , Jinjie Gu , Guannan Zhang

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and…

Computational Physics · Physics 2020-12-09 Suraj Pawar , Romit Maulik

When neural networks are used to model dynamics, properties such as stability of the dynamics are generally not guaranteed. In contrast, there is a recent method for learning the dynamics of autonomous systems that guarantees global…

Machine Learning · Computer Science 2022-03-21 Kenji Kashima , Ryota Yoshiuchi , Yu Kawano

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Reference tracking systems involve a plant that is stabilized by a local feedback controller and a command center that indicates the reference set-point the plant should follow. Typically, these systems are subject to limitations such as…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Maria Angelica Arroyo , Luis Felipe Giraldo

This paper presents a numerically robust approach to multi-band disturbance rejection using an iterative Youla-Kucera parameterization technique. The proposed method offers precise control over shaping the frequency response of a feedback…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Xiaohai Hu , Jason Laks , Guoxiao Guo , Xu Chen

We generalize a standard benchmark of reinforcement learning, the classical cartpole balancing problem, to the quantum regime by stabilizing a particle in an unstable potential through measurement and feedback. We use state-of-the-art deep…

Quantum Physics · Physics 2020-09-08 Zhikang T. Wang , Yuto Ashida , Masahito Ueda

This work provides a framework for nonlinear model-free control of systems with unknown input-output dynamics, but outputs that can be controlled by the inputs. This framework leads to real-time control of the system such that a feasible…

Systems and Control · Electrical Eng. & Systems 2019-08-13 Amit K. Sanyal

Deep learning methods have demonstrated significant potential for addressing complex nonlinear control problems. For real-world safety-critical tasks, however, it is crucial to provide formal stability guarantees for the designed…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Han Wang , Keyan Miao , Diego Madeira , Antonis Papachristodoulou

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

In this paper, we propose a deep learning based control synthesis framework for fast and online computation of controllers that guarantees the safety of general nonlinear control systems with unknown dynamics in the presence of input…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Vrushabh Zinage , Rohan Chandra , Efstathios Bakolas

Reinforcement learning is a model-free optimal control method that optimizes a control policy through direct interaction with the environment. For reaching tasks that end in regulation, popular discrete-action methods are not well suited…

Robotics · Computer Science 2021-06-23 Wouter Caarls

Feedback-based control is the de-facto standard when it comes to controlling classical stochastic systems and processes. However, standard feedback-based control methods are challenged by quantum systems due to measurement induced…

Quantum Physics · Physics 2024-05-14 Kai Meinerz , Simon Trebst , Mark Rudner , Evert van Nieuwenburg

A strategy is proposed for adaptive stabilization of linear systems, depending on an uncertain parameter. Offline, the Riccati stabilizing feedback input control operators, corresponding to parameters in a finite training set of chosen…

Optimization and Control · Mathematics 2023-07-27 Philipp A. Guth , Karl Kunisch , Sérgio S. Rodrigues

In this paper, we present a safe deep reinforcement learning system for automated driving. The proposed framework leverages merits of both rule-based and learning-based approaches for safety assurance. Our safety system consists of two…

Systems and Control · Electrical Eng. & Systems 2020-04-24 Ali Baheri , Subramanya Nageshrao , H. Eric Tseng , Ilya Kolmanovsky , Anouck Girard , Dimitar Filev

This paper studies the data-driven control of unknown linear-threshold network dynamics to stabilize the state to a reference value. We consider two types of controllers: (i) a state feedback controller with feed-forward reference input and…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Xuan Wang , Duy Duong-Tran , Jorge Cortés

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

Deep reinforcement learning approaches are becoming appealing for the design of nonlinear controllers for voltage control problems, but the lack of stability guarantees hinders their deployment in real-world scenarios. This paper constructs…

Systems and Control · Electrical Eng. & Systems 2023-08-31 Jie Feng , Wenqi Cui , Jorge Cortés , Yuanyuan Shi

Neural network controllers have shown potential in achieving superior performance in feedback control systems. Although a neural network can be trained efficiently using deep and reinforcement learning methods, providing formal guarantees…

Optimization and Control · Mathematics 2024-01-10 Han Wang , Zuxun Xiong , Liqun Zhao , Antonis Papachristodoulou