English
Related papers

Related papers: Partially Observable Residual Reinforcement Learni…

200 papers

This paper presents a novel deep reinforcement learning (DRL)-based control strategy for achieving precise and robust output voltage regulation in LCC-S resonant converters, specifically designed for wireless power transfer applications.…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Reza Safari , Mohsen Hamzeh , Nima Mahdian Dehkordi

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

This paper develops a reinforcement learning (RL)approach to solve a cooperative, multi-agent Volt-Var Control (VVC) problem for high solar penetration distribution systems. The ingenuity of our RL method lies in a novel two-stage…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Si Zhang , Mingzhi Zhang , Rongxing Hu , David Lubkeman , Yunan Liu , Ning Lu

The high penetration of renewable energy and power electronic equipment bring significant challenges to the efficient construction of adaptive emergency control strategies against various presumed contingencies in today's power systems.…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Congbo Bi , Lipeng Zhu , Di Liu , Chao Lu

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn…

Machine Learning · Computer Science 2021-06-16 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Sayak Mukherjee , Thanh Long Vu

Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Yanrong Li , Juan Du , Wei Jiang

Power system emergency control is generally regarded as the last safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived "worst" case scenario or a few…

Machine Learning · Computer Science 2019-04-23 Qiuhua Huang , Renke Huang , Weituo Hao , Jie Tan , Rui Fan , Zhenyu Huang

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

Optimization and Control · Mathematics 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Power grid operation is becoming increasingly complex due to the rising integration of renewable energy sources and the need for more adaptive control strategies. Reinforcement Learning (RL) has emerged as a promising approach to power…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Erica van der Sar , Alessandro Zocca , Sandjai Bhulai

While classic control theory offers state of the art solutions in many problem scenarios, it is often desired to improve beyond the structure of such solutions and surpass their limitations. To this end, residual policy learning (RPL)…

Robotics · Computer Science 2021-08-09 Alireza Ranjbar , Ngo Anh Vien , Hanna Ziesche , Joschka Boedecker , Gerhard Neumann

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

In partially observable (PO) environments, deep reinforcement learning (RL) agents often suffer from unsatisfactory performance, since two problems need to be tackled together: how to extract information from the raw observations to solve…

Machine Learning · Computer Science 2019-12-25 Dongqi Han , Kenji Doya , Jun Tani

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

Dynamic distribution network reconfiguration (DNR) algorithms perform hourly status changes of remotely controllable switches to improve distribution system performance. The problem is typically solved by physical model-based control…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Yuanqi Gao , Wei Wang , Jie Shi , Nanpeng Yu

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

Machine Learning · Computer Science 2026-02-13 Mehrdad Moghimi , Hyejin Ku