English
Related papers

Related papers: One for Many: Transfer Learning for Building HVAC …

200 papers

The large thermal capacity of buildings enables heating, ventilating, and air-conditioning (HVAC) systems to be exploited as demand response (DR) resources. Optimal DR of HVAC units is challenging, particularly for multi-zone buildings,…

Machine Learning · Computer Science 2019-05-01 Youngjin Kim

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

Optimizing the operation of heating, ventilation, and air-conditioning (HVAC) systems is a challenging task, requiring the modeling of complex nonlinear relationships among HVAC load, indoor temperatures, and outdoor environments. This…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Youngjin Kim

With more than 32% of the global energy used by commercial and residential buildings, there is an urgent need to revisit traditional approaches to Building Energy Management (BEM). With HVAC systems accounting for about 40% of the total…

Systems and Control · Electrical Eng. & Systems 2023-11-16 Hao Wang , Xiwen Chen , Natan Vital , Edward. Duffy , Abolfazl Razi

The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimise the geometry of any airfoil based on concomitant aerodynamic and structural integrity…

Machine Learning · Computer Science 2025-08-04 David Ramos , Lucas Lacasa , Eusebio Valero , Gonzalo Rubio

As opposed to conventional training methods tailored to minimize a given statistical metric or task-agnostic loss (e.g., mean squared error), Decision-Focused Learning (DFL) trains machine learning models for optimal performance in…

Systems and Control · Electrical Eng. & Systems 2025-01-27 Pietro Favaro , Jean-François Toubeau , François Vallée , Yury Dvorkin

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problem-solving capabilities of deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2022-12-14 Hao Chen , Gang Guo , Bangbei Tang , Guo Hu , Xiaolin Tang , Teng Liu

Deep Reinforcement Learning (DRL) emerges as a prime solution for Unmanned Aerial Vehicle (UAV) trajectory planning, offering proficiency in navigating high-dimensional spaces, adaptability to dynamic environments, and making sequential…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Chenrui Sun , Gianluca Fontanesi , Swarna Bindu Chetty , Xuanyu Liang , Berk Canberk , Hamed Ahmadi

The exponential growth of digital services has positioned data centers among the most energy-intensive infrastructures in the modern economy, raising critical concerns regarding operational costs, carbon emissions, and the sustainable…

Machine Learning · Computer Science 2026-05-05 Abderaouf Bahi , Amel Ourici , Hasan Dincer , Serhat Yuksel , Akila Djebbar

Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully…

Artificial Intelligence · Computer Science 2023-10-13 Judah Goldfeder , John Sipple

Deep Reinforcement Learning (DRL) is employed to develop autonomously optimized and custom-designed heat-treatment processes that are both, microstructure-sensitive and energy efficient. Different from conventional supervised machine…

Materials Science · Physics 2022-09-26 Jaber R. Mianroodi , Nima H. Siboni , Dierk Raabe

Deep reinforcement learning (DRL) has been increasingly employed to handle the dynamic and complex resource management in network slicing. The deployment of DRL policies in real networks, however, is complicated by heterogeneous cell…

Networking and Internet Architecture · Computer Science 2023-06-26 Tianlun Hu , Qi Liao , Qiang Liu , Georg Carle

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

In this paper, we conduct a set of experiments to analyze the limitations of current MBRL-based HVAC control methods, in terms of model uncertainty and controller effectiveness. Using the lessons learned, we develop MB2C, a novel MBRL-based…

Systems and Control · Electrical Eng. & Systems 2023-02-03 Xianzhong Ding , Alberto Cerpa , Wan Du

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

The rising demand for electricity and its essential nature in today's world calls for intelligent home energy management (HEM) systems that can reduce energy usage. This involves scheduling of loads from peak hours of the day when energy…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Alwyn Mathew , Abhijit Roy , Jimson Mathew