English
Related papers

Related papers: Offline Reinforcement-Learning-Based Power Control…

200 papers

Combining offline and online reinforcement learning (RL) is crucial for efficient and safe learning. However, previous approaches treat offline and online learning as separate procedures, resulting in redundant designs and limited…

Machine Learning · Computer Science 2024-03-19 Kun Lei , Zhengmao He , Chenhao Lu , Kaizhe Hu , Yang Gao , Huazhe Xu

District cooling energy plants (DCEPs) consisting of chillers, cooling towers, and thermal energy storage (TES) systems consume a considerable amount of electricity. Optimizing the scheduling of the TES and chillers to take advantage of…

Systems and Control · Electrical Eng. & Systems 2022-03-16 Zhong Guo , Austin R. Coffman , Prabir Barooah

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Optimizing the energy management within a smart grids scenario presents significant challenges, primarily due to the complexity of real-world systems and the intricate interactions among various components. Reinforcement Learning (RL) is…

Machine Learning · Computer Science 2025-10-21 Julen Cestero , Carmine Delle Femine , Kenji S. Muro , Marco Quartulli , Marcello Restelli

Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the…

Machine Learning · Computer Science 2023-01-31 Dmitriy Akimov , Vladislav Kurenkov , Alexander Nikulin , Denis Tarasov , Sergey Kolesnikov

This study presents a novel approach to addressing offline reinforcement learning (RL) problems by reframing them as regression tasks that can be effectively solved using Decision Trees. Mainly, we introduce two distinct frameworks:…

Machine Learning · Computer Science 2024-10-16 Prajwal Koirala , Cody Fleming

Offline reinforcement learning (RL) aims to find an optimal policy for Markov decision processes (MDPs) using a pre-collected dataset. In this work, we revisit the linear programming (LP) reformulation of Markov decision processes for…

Machine Learning · Computer Science 2024-12-11 Asuman Ozdaglar , Sarath Pattathil , Jiawei Zhang , Kaiqing Zhang

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load inefficiently.…

Machine Learning · Computer Science 2021-12-06 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Huang

Offline-to-online reinforcement learning (RL) improves sample efficiency by leveraging pre-collected datasets prior to online interaction. A key challenge, however, is learning an accurate critic in large state--action spaces with limited…

Artificial Intelligence · Computer Science 2026-05-21 Andrew Choi , Wei Xu

The goal of offline reinforcement learning is to learn a policy from a fixed dataset, without further interactions with the environment. This setting will be an increasingly more important paradigm for real-world applications of…

Robotics · Computer Science 2020-11-17 Wenxuan Zhou , Sujay Bajracharya , David Held

Offline reinforcement learning (RL) presents a promising approach for learning reinforced policies from offline datasets without the need for costly or unsafe interactions with the environment. However, datasets collected by humans in…

Machine Learning · Computer Science 2024-03-12 Rui Yang , Han Zhong , Jiawei Xu , Amy Zhang , Chongjie Zhang , Lei Han , Tong Zhang

We propose a new adversarial training approach for injecting robustness when designing controllers for upcoming cyber-physical power systems. Previous approaches relying deeply on simulations are not able to cope with the rising complexity…

Machine Learning · Statistics 2021-04-19 Loïc Omnes , Antoine Marot , Benjamin Donnot

Online reinforcement learning (RL) is increasingly used for realizing adaptive systems in the presence of design time uncertainty. Online RL facilitates learning from actual operational data and thereby leverages feedback only available at…

Software Engineering · Computer Science 2023-07-11 Andreas Metzger , Jan Laufer , Felix Feit , Klaus Pohl

The Job Shop Scheduling Problem (JSSP) is a complex combinatorial optimization problem. While online Reinforcement Learning (RL) has shown promise by quickly finding acceptable solutions for JSSP, it faces key limitations: it requires…

Machine Learning · Computer Science 2025-07-04 Jesse van Remmerden , Zaharah Bukhsh , Yingqian Zhang

Deep brain stimulation (DBS) has shown great promise toward treating motor symptoms caused by Parkinson's disease (PD), by delivering electrical pulses to the Basal Ganglia (BG) region of the brain. However, DBS devices approved by the U.S.…

To solve the optimal power flow (OPF) problem, reinforcement learning (RL) emerges as a promising new approach. However, the RL-OPF literature is strongly divided regarding the exact formulation of the OPF problem as an RL environment. In…

Machine Learning · Computer Science 2024-03-27 Thomas Wolgast , Astrid Nieße

Offline-to-online (O2O) reinforcement learning (RL) provides an effective means of leveraging an offline pre-trained policy as initialization to improve performance rapidly with limited online interactions. Recent studies often design…

Machine Learning · Computer Science 2024-12-30 Qin-Wen Luo , Ming-Kun Xie , Ye-Wen Wang , Sheng-Jun Huang

Offline reinforcement learning (RL) defines a sample-efficient learning paradigm, where a policy is learned from static and previously collected datasets without additional interaction with the environment. The major obstacle to offline RL…

Machine Learning · Computer Science 2022-11-16 Yunfan Zhou , Xijun Li , Qingyu Qu

With deep reinforcement learning (RL) methods achieving results that exceed human capabilities in games, robotics, and simulated environments, continued scaling of RL training is crucial to its deployment in solving complex real-world…

Machine Learning · Computer Science 2020-12-09 Ahmet Inci , Evgeny Bolotin , Yaosheng Fu , Gal Dalal , Shie Mannor , David Nellans , Diana Marculescu

The rapid growth of heterogeneous and massive wireless connectivity in 6G networks demands intelligent solutions to ensure scalability, reliability, privacy, ultra-low latency, and effective control. Although artificial intelligence (AI)…

Machine Learning · Computer Science 2025-04-08 Eslam Eldeeb , Hirley Alves