English
Related papers

Related papers: On Training Effective Reinforcement Learning Agent…

200 papers

The increasing integration of renewable energy sources (RESs) is transforming traditional power grid networks, which require new approaches for managing decentralized energy production and consumption. Microgrids (MGs) provide a promising…

Machine Learning · Computer Science 2025-11-19 Davide Salaorni , Federico Bianchi , Francesco Trovò , Marcello Restelli

This work demonstrates the potential of deep reinforcement learning techniques for transmit power control in wireless networks. Existing techniques typically find near-optimal power allocations by solving a challenging optimization problem.…

Signal Processing · Electrical Eng. & Systems 2020-09-15 Yasar Sinan Nasir , Dongning Guo

The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling…

Artificial Intelligence · Computer Science 2023-03-14 Shaohuai Liu , Jinbo Liu , Weirui Ye , Nan Yang , Guanglun Zhang , Haiwang Zhong , Chongqing Kang , Qirong Jiang , Xuri Song , Fangchun Di , Yang Gao

This paper describes how domain knowledge of power system operators can be integrated into reinforcement learning (RL) frameworks to effectively learn agents that control the grid's topology to prevent thermal cascading. Typical RL-based…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Amarsagar Reddy Ramapuram Matavalam , Kishan Prudhvi Guddanti , Yang Weng , Venkataramana Ajjarapu

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

Machine Learning · Computer Science 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power…

Systems and Control · Electrical Eng. & Systems 2019-10-31 Qiuling Yang , Alireza Sadeghi , Gang Wang , Georgios B. Giannakis , Jian Sun

Deploying reinforcement learning in the real world remains challenging due to sample inefficiency, sparse rewards, and noisy visual observations. Prior work leverages demonstrations and human feedback to improve learning efficiency and…

Artificial Intelligence · Computer Science 2026-01-23 Xiefeng Wu , Mingyu Hu , Shu Zhang

Reinforcement learning (RL) offers a promising approach for adaptive wind farm flow control, yet its practical deployment is hindered by slow training convergence and poor initial performance, factors that could translate to years of…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Marcus Binder Nilsen , Julian Quick , Tuhfe Göçmen , Nikolay Dimitrov , Pierre-Elouan Réthoré

Next-generation networks utilize the Open Radio Access Network (O-RAN) architecture to enable dynamic resource management, facilitated by the RAN Intelligent Controller (RIC). While deep reinforcement learning (DRL) models show promise in…

Artificial Intelligence · Computer Science 2025-11-20 Fatemeh Lotfi , Hossein Rajoli , Fatemeh Afghah

Systems for heating, ventilation and air-conditioning (HVAC) of buildings are traditionally controlled by a rule-based approach. In order to reduce the energy consumption and the environmental impact of HVAC systems more advanced control…

Multiagent Systems · Computer Science 2023-09-14 Daniel Bayer , Marco Pruckner

The increase of renewable energy generation towards the zero-emission target is making the problem of controlling power grids more and more challenging. The recent series of competitions Learning To Run a Power Network (L2RPN) have…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Gianvito Losapio , Davide Beretta , Marco Mussi , Alberto Maria Metelli , Marcello Restelli

We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. While…

Machine Learning · Computer Science 2022-08-24 Joash Lee , Wenbo Wang , Dusit Niyato

Building capable household and industrial robots requires mastering the control of versatile, high-degree-of-freedom (DoF) systems such as mobile manipulators. While reinforcement learning (RL) holds promise for autonomously acquiring robot…

Robotics · Computer Science 2025-08-19 Jiaheng Hu , Peter Stone , Roberto Martín-Martín

Recent works have validated the possibility of improving energy efficiency in radio access networks (RANs), achieved by dynamically turning on/off some base stations (BSs). In this paper, we extend the research over BS switching operations,…

Networking and Internet Architecture · Computer Science 2014-04-07 Rongpeng Li , Zhifeng Zhao , Xianfu Chen , Jacques Palicot , Honggang Zhang

Increasing amounts of distributed generation in distribution networks can provide both challenges and opportunities for voltage regulation across the network. Intelligent control of smart inverters and other smart building energy management…

Multiagent Systems · Computer Science 2021-10-14 Aisling Pigott , Constance Crozier , Kyri Baker , Zoltan Nagy

The necessary integration of renewable energy sources, combined with the expanding scale of power networks, presents significant challenges in controlling modern power grids. Traditional control systems, which are human and…

Machine Learning · Computer Science 2025-09-04 Carlo Fabrizio , Gianvito Losapio , Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Soft actor-critic (SAC) is a popular algorithm for max-entropy reinforcement learning. In practice, the energy-based policies in SAC are often approximated using simple policy classes for efficiency, sacrificing the expressiveness and…

Machine Learning · Computer Science 2026-01-01 Yuyang Zhang , Yang Hu , Bo Dai , Na Li

The paper explores the application of a continuous action space soft actor-critic (SAC) reinforcement learning model to the area of automated market-making. The reinforcement learning agent receives a simulated flow of client trades, thus…

Pricing of Securities · Quantitative Finance 2020-08-28 Alexey Bakshaev

Reinforcement learning (RL) can provide adaptive and scalable controllers essential for power grid decarbonization. However, RL methods struggle with power grids' complex dynamics, long-horizon goals, and hard physical constraints. For…