English
Related papers

Related papers: District Cooling System Control for Providing Oper…

200 papers

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

Demand flexibility plays a vital role in maintaining grid balance, reducing peak demand, and saving customers' energy bills. Given their highly shiftable load and significant contribution to a building's energy consumption, Heating,…

Systems and Control · Electrical Eng. & Systems 2023-06-30 Ruohong Liu , Yuxin Pan , Yize Chen

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi

The global energy landscape is undergoing a transformation towards decarbonization, sustainability, and cost-efficiency. In this transition, microgrid systems integrated with renewable energy sources (RES) and energy storage systems (ESS)…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Fulong Yao , Wanqing Zhao , Matthew Forshaw , Yang Song

The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle…

Fluid Dynamics · Physics 2024-10-21 Giorgio Maria Cavallazzi , Luca Guastoni , Ricardo Vinuesa , Alfredo Pinelli

Bipedal locomotion skills are challenging to develop. Control strategies often use local linearization of the dynamics in conjunction with reduced-order abstractions to yield tractable solutions. In these model-based control strategies, the…

Robotics · Computer Science 2018-07-30 Zhaoming Xie , Glen Berseth , Patrick Clary , Jonathan Hurst , Michiel van de Panne

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active…

Optimization and Control · Mathematics 2019-09-02 Jiajun Duan , Haifeng Li , Xiaohu Zhang , Ruisheng Diao , Bei Zhang , Di Shi , Xiao Lu , Zhiwei Wang , Siqi Wang

Heating, Ventilation, and Air Conditioning (HVAC) is extremely energy-consuming, accounting for 40% of total building energy consumption. Therefore, it is crucial to design some energy-efficient building thermal control policies which can…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Guanyu Gao , Jie Li , Yonggang Wen

Operational constraint violations may occur when deep reinforcement learning (DRL) agents interact with real-world active distribution systems to learn their optimal policies during training. This letter presents a universal…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Hoang Tien Nguyen , Dae-Hyun Choi

The carbon-capturing process with the aid of CO2 removal technology (CDRT) has been recognised as an alternative and a prominent approach to deep decarbonisation. However, the main hindrance is the enormous energy demand and the economic…

Systems and Control · Electrical Eng. & Systems 2023-01-20 Tobi Michael Alabi , Nathan P. Lawrence , Lin Lu , Zaiyue Yang , R. Bhushan Gopaluni

We address the problem of temperature regulation and optimal energy sharing in district heating systems (DHSs) where the demand and system parameters are unknown. We propose a temperature regulation scheme that employs data-driven on-policy…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Xinyi Yi , Ioannis Lestas

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control…

This paper studies the automated control method for regulating air conditioner (AC) loads in incentive-based residential demand response (DR). The critical challenge is that the customer responses to load adjustment are uncertain and…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Xin Chen , Yingying Li , Jun Shimada , Na Li

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning…

Machine Learning · Computer Science 2020-10-19 Brandon L. Thayer , Thomas J. Overbye

The building sector consumes the largest energy in the world, and there have been considerable research interests in energy consumption and comfort management of buildings. Inspired by recent advances in reinforcement learning (RL), this…

Artificial Intelligence · Computer Science 2021-03-16 Donghwan Lee , Niao He , Seungjae Lee , Panagiota Karava , Jianghai Hu

Passively cooled base stations (PCBSs) have emerged to deliver better cost and energy efficiency. However, passive cooling necessitates intelligent thermal control via traffic management, i.e., the instantaneous data traffic or throughput…

Networking and Internet Architecture · Computer Science 2024-10-14 Zhanwei Yu , Yi Zhao , Xiaoli Chu , Di Yuan

Deep reinforcement learning (DRL) has recently emerged as a promising tool for Dynamic Algorithm Configuration (DAC), enabling evolutionary algorithms to adapt their parameters online rather than relying on static tuned configurations.…

Optimization and Control · Mathematics 2026-04-03 Andrea Mencaroni , Robbert Reijnen , Yingqian Zhang , Dieter Claeys