English
Related papers

Related papers: Improving a Proportional Integral Controller with …

200 papers

A linear flow control strategy designed for weak disturbances may not remain effective in sequences of strong disturbances due to nonlinear interactions, but it is sensible to leverage it for developing a better strategy. In the present…

Fluid Dynamics · Physics 2025-11-11 Zhecheng Liu , Jeff D. Eldredge

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

Electric motors are crucial in many applications, but traditional control methods struggle with nonlinearities, parameter uncertainties, and external disturbances. Reinforcement Learning (RL) offers a promising solution as a data-driven…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Danial Kazemikia

Purpose: This study aims to address the challenges of controlling unstable and nonlinear systems by proposing an adaptive PID controller based on predictive reinforcement learning (PRL-PID), where the PRL-PID combines the advantages of both…

Systems and Control · Electrical Eng. & Systems 2025-06-11 Chaoqun Ma , Zhiyong Zhang

We develop data-driven reinforcement learning (RL) control designs for input-affine nonlinear systems. We use Carleman linearization to express the state-space representation of the nonlinear dynamical model in the Carleman space, and…

Systems and Control · Electrical Eng. & Systems 2024-08-09 Jishnudeep Kar , He Bai , Aranya Chakrabortty

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

Reinforcement learning (RL) is a control approach that can handle nonlinear stochastic optimal control problems. However, despite the promise exhibited, RL has yet to see marked translation to industrial practice primarily due to its…

Machine Learning · Computer Science 2021-04-15 Elton Pan , Panagiotis Petsagkourakis , Max Mowbray , Dongda Zhang , Antonio del Rio-Chanona

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN)…

Machine Learning · Computer Science 2022-04-05 Jan de Priester , Ricardo G. Sanfelice , Nathan van de Wouw

Over the last few years, sampling-based stochastic optimal control (SOC) frameworks have shown impressive performances in reinforcement learning (RL) with applications in robotics. However, such approaches require a large amount of samples…

Systems and Control · Computer Science 2014-12-10 Yunpeng Pan , Evangelos A. Theodorou , Michail Kontitsis

In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Abdel Gafoor Haddad , Igor Boiko , Yahya Zweiri

This paper presents a model-based reinforcement learning (RL) framework for optimal closed-loop control of nonlinear robotic systems. The proposed approach learns linear lifted dynamics through Koopman operator theory and integrates the…

Robotics · Computer Science 2026-04-23 Wenjian Hao , Yuxuan Fang , Zehui Lu , Shaoshuai Mou

There has recently been an increased interest in reinforcement learning for nonlinear control problems. However standard reinforcement learning algorithms can often struggle even on seemingly simple set-point control problems. This paper…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

The paper introduces an interactive machine learning mechanism to process the measurements of an uncertain, nonlinear dynamic process and hence advise an actuation strategy in real-time. For concept demonstration, a trajectory-following…

Systems and Control · Electrical Eng. & Systems 2023-03-16 Mohammed Abouheaf , Derek Boase , Wail Gueaieb , Davide Spinello , Salah Al-Sharhan

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

The aim of the project is to investigate and assess opportunities for applying reinforcement learning (RL) for power system control. As a proof of concept (PoC), voltage control of thermostatically controlled loads (TCLs) for power…

Machine Learning · Computer Science 2020-05-12 Oleh Lukianykhin , Tetiana Bogodorova