English
Related papers

Related papers: Towards Optimal District Heating Temperature Contr…

200 papers

This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently…

Deep Reinforcement Learning (DRL) solutions are becoming pervasive at the edge of the network as they enable autonomous decision-making in a dynamic environment. However, to be able to adapt to the ever-changing environment, the DRL…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ivana Dusparic

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

The potential of artificial upwelling (AU) as a means of lifting nutrient-rich bottom water to the surface, stimulating seaweed growth, and consequently enhancing ocean carbon sequestration, has been gaining increasing attention in recent…

Machine Learning · Computer Science 2024-05-01 Yiyuan Zhang , Wei Fan

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

Machine Learning · Computer Science 2025-09-23 Aohan Li , Miyu Tsuzuki

The widespread adoption of photovoltaic (PV), electric vehicles (EVs), and stationary energy storage systems (ESS) in households increases system complexity while simultaneously offering new opportunities for energy regulation. However,…

Systems and Control · Electrical Eng. & Systems 2026-02-05 Meng Yuan , Ye Wang , Xinghuo Yu , Torsten Wik , Changfu Zou

Global buildings account for about 30% of the total energy consumption and carbon emission, raising severe energy and environmental concerns. Therefore, it is significant and urgent to develop novel smart building energy management (SBEM)…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Liang Yu , Shuqi Qin , Meng Zhang , Chao Shen , Tao Jiang , Xiaohong Guan

We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on…

Artificial Intelligence · Computer Science 2024-03-04 Jinyang Jiang , Xiaotian Liu , Tao Ren , Qinghao Wang , Yi Zheng , Yufu Du , Yijie Peng , Cheng Zhang

Thermal dynamics modeling has been a critical issue in building heating, ventilation, and air-conditioning (HVAC) systems, which can significantly affect the control and maintenance strategies. Due to the uniqueness of each specific…

Machine Learning · Statistics 2019-11-11 Zhanhong Jiang , Young M. Lee

In building management, usually static thermal setpoints are used to maintain the inside temperature of a building at a comfortable level irrespective of its occupancy. This strategy can cause a massive amount of energy wastage and…

Machine Learning · Computer Science 2022-01-20 Rakshitha Godahewa , Chang Deng , Arnaud Prouzeau , Christoph Bergmeir

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

Integrating artificial intelligence (AI) into wireless networks has drawn significant interest in both industry and academia. A common solution is to replace partial or even all modules in the conventional systems, which is often lack of…

Information Theory · Computer Science 2019-07-24 Jian Wang , Chen Xu , Yourui Huangfu , Rong Li , Yiqun Ge , Jun Wang

The increasing integration of renewable energy sources (RESs) is transforming traditional power grid networks, which require new approaches for managing decentralized energy production and consumption. Microgrids (MGs) provide a promising…

Machine Learning · Computer Science 2025-11-19 Davide Salaorni , Federico Bianchi , Francesco Trovò , Marcello Restelli

Generating stable magnetic skyrmions is essential for the practical application of skyrmion-based spintronic devices in thermally agitating environments. Recent advancements have enabled the creation of skyrmions by controlling stripe…

Mesoscale and Nanoscale Physics · Physics 2026-03-26 Ji Seok Song , Se Kwon Kim , Kyoung-Min Kim

Next-generation wireless systems, already widely deployed, are expected to become even more prevalent in the future, representing challenges in both environmental and economic terms. This paper focuses on improving the energy efficiency of…

Networking and Internet Architecture · Computer Science 2024-10-21 Matteo Bordin , Andrea Lacava , Michele Polese , Sai Satish , Manoj AnanthaSwamy Nittoor , Rajarajan Sivaraj , Francesca Cuomo , Tommaso Melodia

We consider the problem of optimal control of district cooling energy plants (DCEPs) consisting of multiple chillers, a cooling tower, and a thermal energy storage (TES), in the presence of time-varying electricity price. A straightforward…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Zhong Guo , Aditya Chaudhari , Austin R. Coffman , Prabir Barooah

This paper considers a demand response agent that must find a near-optimal sequence of decisions based on sparse observations of its environment. Extracting a relevant set of features from these observations is a challenging task and may…

Machine Learning · Computer Science 2020-01-28 Frederik Ruelens , Bert J. Claessens , Peter Vrancx , Fred Spiessens , Geert Deconinck

The market for domestic robots made to perform household chores is growing as these robots relieve people of everyday responsibilities. Domestic robots are generally welcomed for their role in easing human labor, in contrast to industrial…

Robotics · Computer Science 2024-05-30 Arpita Soni , Sujatha Alla , Suresh Dodda , Hemanth Volikatla

Deep reinforcement learning (DRL) is a booming area of artificial intelligence. Many practical applications of DRL naturally involve more than one collaborative learners, making it important to study DRL in a multi-agent context. Previous…

Machine Learning · Computer Science 2019-10-22 Gang Chen

Data centers are increasingly using more energy due to the rise in Artificial Intelligence (AI) workloads, which negatively impacts the environment and raises operational costs. Reducing operating expenses and carbon emissions while…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-03 Ninad Hogade , Sudeep Pasricha