English
Related papers

Related papers: Reducing Learning Difficulties: One-Step Two-Criti…

200 papers

Deep Actor-Critic algorithms, which combine Actor-Critic with deep neural network (DNN), have been among the most prevalent reinforcement learning algorithms for decision-making problems in simulated environments. However, the existing deep…

Machine Learning · Computer Science 2024-09-19 Kexuan Wang , An Liu , Baishuo Lin

The deep reinforcement learning (DRL) based Volt-VAR optimization (VVO) methods have been widely studied for active distribution networks (ADNs). However, most of them lack safety guarantees in terms of power injection uncertainties due to…

Systems and Control · Electrical Eng. & Systems 2024-09-30 Zhengrong Chen , Siyao Cai , A. P. Sakis Meliopoulos

Integrated sensing and communication (ISAC) technology is essential for supporting vehicular networks. However, the communication channel in this scenario exhibits time variations, and the potential targets may move rapidly, resulting in…

Signal Processing · Electrical Eng. & Systems 2024-08-26 Zonghui Yang , Shijian Gao , Xiang Cheng

Distributional reinforcement learning (RL) aims to learn a value-network that predicts the full distribution of the returns for a given state, often modeled via a quantile-based critic. This approach has been successfully integrated into…

Machine Learning · Computer Science 2022-02-08 Michael Teng , Michiel van de Panne , Frank Wood

This study presents the first experimental implementation of deep reinforcement learning (DRL) for the active real-time suppression of flow-induced vibrations in simultaneously vibrating tandem cylinders using rotary actuation, considering…

Fluid Dynamics · Physics 2026-05-21 Hussam Sababha , Mohammed Daqaq

This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shuvangkar Chandra Das , Tuyen Vu , Deepak Ramasubramanian , Evangelos Farantatos , Jianhua Zhang , Thomas Ortmeyer

Exploiting unmanned aerial vehicles (UAVs) to execute tasks is gaining growing popularity recently. To solve the underlying task scheduling problem, the deep reinforcement learning (DRL) based methods demonstrate notable advantage over the…

Machine Learning · Computer Science 2023-06-07 Xiao Mao , Zhiguang Cao , Mingfeng Fan , Guohua Wu , Witold Pedrycz

This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (MADRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in unbalanced distribution…

Systems and Control · Electrical Eng. & Systems 2020-04-21 Ying Zhang , Xinan Wang , Jianhui Wang , Yingchen Zhang

Deep Reinforcement Learning (DRL) has made considerable advances in simulated and physical robot control tasks, especially when problems admit a fully observed Markov Decision Process (MDP) formulation. When observations only partially…

Robotics · Computer Science 2026-03-24 Lingheng Meng , Rob Gorbet , Michael Burke , Dana Kulić

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Traditional reinforcement learning (RL) methods typically employ a fixed control loop, where each cycle corresponds to an action. This rigidity poses challenges in practical applications, as the optimal control frequency is task-dependent.…

Machine Learning · Computer Science 2024-06-04 Dong Wang , Giovanni Beltrame

Integrated Sensing and Communication (ISAC) is a key enabler in 6G networks, where sensing and communication capabilities are designed to complement and enhance each other. One of the main challenges in ISAC lies in resource allocation,…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Duc Nguyen Dao , André B. J. Kokkeler , Haibin Zhang , Yang Miao

Considering grant-free transmissions in low-power IoT networks with unknown time-frequency distribution of interference, we address the problem of Dynamic Resource Configuration (DRC), which amounts to a Markov decision process.…

Information Theory · Computer Science 2021-06-08 Yang Huang , Caiyong Hao , Yijie Mao , Fuhui Zhou

Power system optimal dispatch with transient security constraints is commonly represented as Transient Security-Constrained Optimal Power Flow (TSC-OPF). Deep Reinforcement Learning (DRL)-based TSC-OPF trains efficient decision-making…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Tannan Xiao , Ying Chen , Han Diao , Shaowei Huang , Chen Shen

In this paper, a new Volt/Var Control (VVC) scheme is proposed to facilitate the coordination between the conventional VVC devices and the new smart PV inverters to provide an effective voltage control on a system with high PV penetration.…

Signal Processing · Electrical Eng. & Systems 2019-01-01 Yue Shi , Mesut Baran

Deep reinforcement learning (DRL) algorithms have been demonstrated to be effective in a wide range of challenging decision making and control tasks. However, these methods typically suffer from severe action oscillations in particular in…

Machine Learning · Computer Science 2021-03-04 Chen Chen , Hongyao Tang , Jianye Hao , Wulong Liu , Zhaopeng Meng

Deep reinforcement learning (DRL) algorithms have successfully been demonstrated on a range of challenging decision making and control tasks. One dominant component of recent deep reinforcement learning algorithms is the target network…

Machine Learning · Computer Science 2020-11-12 Lin Shao , Yifan You , Mengyuan Yan , Qingyun Sun , Jeannette Bohg

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

Machine Learning · Computer Science 2026-02-13 Mehrdad Moghimi , Hyejin Ku

This paper proposes a data-driven distributed voltage control approach based on the spectrum clustering and the enhanced multi-agent deep reinforcement learning (MADRL) algorithm. Via the unsupervised clustering, the whole distribution…

Systems and Control · Electrical Eng. & Systems 2020-06-02 Di Cao , Junbo Zhao , Weihao Hu , Fei Ding , Qi Huang , Zhe Chen

Reinforcement learning (RL) has shown remarkable success in solving complex decision-making and control tasks. However, many model-free RL algorithms experience performance degradation due to inaccurate value estimation, particularly the…

Machine Learning · Computer Science 2025-08-07 Jingliang Duan , Wenxuan Wang , Liming Xiao , Jiaxin Gao , Shengbo Eben Li , Chang Liu , Ya-Qin Zhang , Bo Cheng , Keqiang Li