English
Related papers

Related papers: Deep Reinforcement Learning for Heat Pump Control

200 papers

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

Classical methods to control heating systems are often marred by suboptimal performance, inability to adapt to dynamic conditions and unreasonable assumptions e.g. existence of building models. This paper presents a novel deep reinforcement…

Applications · Statistics 2018-05-11 Adam Nagy , Hussain Kazmi , Farah Cheaib , Johan Driesen

Global buildings account for about 30% of the total energy consumption and carbon emission, raising severe energy and environmental concerns. Therefore, it is significant and urgent to develop novel smart building energy management (SBEM)…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Liang Yu , Shuqi Qin , Meng Zhang , Chao Shen , Tao Jiang , Xiaohong Guan

Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning…

Machine Learning · Computer Science 2020-10-19 Brandon L. Thayer , Thomas J. Overbye

Increasing penetration of renewable energy sources (RES) and electrification of energy systems necessitates the engagement of demand-side management (DSM) to help alleviate congestion in electricity grid. Heat pump and thermal energy…

Systems and Control · Electrical Eng. & Systems 2025-07-24 Weihong Tang , Yun Li , Shalika Walker , Tamas Keviczky

We consider the problem of optimal control of district cooling energy plants (DCEPs) consisting of multiple chillers, a cooling tower, and a thermal energy storage (TES), in the presence of time-varying electricity price. A straightforward…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Zhong Guo , Aditya Chaudhari , Austin R. Coffman , Prabir Barooah

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

At high latitudes, many cities adopt a centralized heating system to improve the energy generation efficiency and to reduce pollution. In multi-tier systems, so-called district heating, there are a few efficient approaches for the flow rate…

Systems and Control · Electrical Eng. & Systems 2019-12-12 Tinghao Zhang , Jing Luo , Ping Chen , Jie Liu

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

Air free-cooled data centers (DCs) have not existed in the tropical zone due to the unique challenges of year-round high ambient temperature and relative humidity (RH). The increasing availability of servers that can tolerate higher…

Systems and Control · Electrical Eng. & Systems 2020-12-15 Duc Van Le , Rongrong Wang , Yingbo Liu , Rui Tan , Yew-Wah Wong , Yonggang Wen

Heat pump and thermal energy storage (HPTES) systems, which are widely utilized in modern buildings for providing domestic hot water, contribute to a large share of household electricity consumption. With the increasing integration of…

Systems and Control · Electrical Eng. & Systems 2024-02-26 Weihong Tang , Yun Li , Shalika Walker , Tamas Keviczky

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, optimising system…

Machine Learning · Computer Science 2024-12-02 Anaïs Berkes

The Organic Rankine Cycle (ORC) is widely used in industrial waste heat recovery due to its simple structure and easy maintenance. However, in the context of smart manufacturing in the process industry, traditional model-based optimization…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Runze Lin , Yangyang Luo , Xialai Wu , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

Decarbonization plans promote the transition to heat pumps (HPs), creating new opportunities for their energy flexibility in demand response programs, solar photovoltaic integration and optimization of distribution networks. This paper…

Systems and Control · Electrical Eng. & Systems 2025-02-21 Gustavo L. Aschidamini , Mina Pavlovic , Bradley A. Reinholz , Malcolm S. Metcalfe , Taco Niet , Mariana Resener

Common approaches to control a data-center cooling system rely on approximated system/environment models that are built upon the knowledge of mechanical cooling and electrical and thermal management. These models are difficult to design and…

Systems and Control · Computer Science 2018-08-31 Takao Moriyama , Giovanni De Magistris , Michiaki Tatsubori , Tu-Hoa Pham , Asim Munawar , Ryuki Tachibana

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

Model predictive control (MPC) strategies allow residential water heaters to shift load in response to dynamic price signals. Crucially, the performance of such strategies is sensitive to various algorithm design choices. In this work, we…

Systems and Control · Electrical Eng. & Systems 2024-08-07 Elizabeth Buechler , Aaron Goldin , Ram Rajagopal

Advanced building control methods such as model predictive control (MPC) offer significant potential benefits to both consumers and grid operators, but the high computational requirements have acted as barriers to more widespread adoption.…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Zachary E. Lee , K. Max Zhang

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi

Buildings account for approximately 40% of global energy consumption, and with the growing share of intermittent renewable energy sources, enabling demand-side flexibility, particularly in heating, ventilation and air conditioning systems,…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Colin Jüni , Mina Montazeri , Yi Guo , Federica Bellizio , Giovanni Sansavini , Philipp Heer