English
Related papers

Related papers: Laxity-Aware Scalable Reinforcement Learning for H…

200 papers

Energy storage devices, such as batteries, thermal energy storages, and hydrogen systems, can help mitigate climate change by ensuring a more stable and sustainable power supply. To maximize the effectiveness of such energy storage,…

Machine Learning · Computer Science 2024-05-21 Jaeik Jeong , Tai-Yeon Ku , Wan-Ki Park

The building thermodynamics model, which predicts real-time indoor temperature changes under potential HVAC (Heating, Ventilation, and Air Conditioning) control operations, is crucial for optimizing HVAC control in buildings. While…

Artificial Intelligence · Computer Science 2025-10-24 Yang Deng , Yaohui Liu , Rui Liang , Dafang Zhao , Donghua Xie , Ittetsu Taniguchi , Dan Wang

Grid-interactive building control is a challenging and important problem for reducing carbon emissions, increasing energy efficiency, and supporting the electric power grid. Currently researchers and practitioners are confronted with a…

Systems and Control · Electrical Eng. & Systems 2022-10-20 David Biagioni , Xiangyu Zhang , Christiane Adcock , Michael Sinner , Peter Graf , Jennifer King

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, optimising system…

Machine Learning · Computer Science 2024-12-02 Anaïs Berkes

A large body of simulation research suggests that model predictive control (MPC) and reinforcement learning (RL) for heating, ventilation, and air-conditioning (HVAC) in residential and commercial buildings could reduce energy costs,…

The design of building heating, ventilation, and air conditioning (HVAC) system is critically important, as it accounts for around half of building energy consumption and directly affects occupant comfort, productivity, and health.…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Shichao Xu , Yixuan Wang , Yanzhi Wang , Zheng O'Neill , Qi Zhu

This study explores the interaction between aggregators and building occupants in activating flexibility through Demand Response (DR) programs, with a focus on reinforcing the resilience of the energy system considering the uncertainties…

Systems and Control · Electrical Eng. & Systems 2025-01-13 Costas Mylonas , Donata Boric , Leila Luttenberger Maric , Alexandros Tsitsanis , Eleftheria Petrianou , Magda Foti

Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant…

Systems and Control · Electrical Eng. & Systems 2020-04-22 Ali Hassan , Deepjyoti Deka , Michael Chertkov , Yury Dvorkin

Achieving the flexibility from house heating, cooling, and ventilation systems (HVAC) has the potential to enable large-scale demand response by aggregating HVAC load adjustments across many homes. This demand response strategy helps…

Systems and Control · Electrical Eng. & Systems 2025-10-27 Kunal Shankar , Ninad Gaikwad , Anamika Dubey

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

The heating, ventilation and air-conditioning (HVAC) system dominates building's energy consumption and meanwhile exhibits substantial operational flexibility that can be exploited for providing grid services. However, the goal is largely…

Systems and Control · Electrical Eng. & Systems 2025-12-29 Qi Zhu , Yu Yang , Liang Yu , Qing-Shan Jia , Costas J. Spanos , Xiaohong Guan

The flexible power consumption feature of thermostatically controlled loads (TCLs) such as heating, ventilation, and air-conditioning (HVAC) systems makes them attractive targets for demand response (DR). TCLs possess a brief period where…

Systems and Control · Electrical Eng. & Systems 2021-10-26 Praveen Dhanasekar , Cunzhi Zhao , Xingpeng Li

With the ongoing energy transition, demand-side flexibility has become an important aspect of the modern power grid for providing grid support and allowing further integration of sustainable energy sources. Besides traditional sources, the…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Gargya Gokhale , Bert Claessens , Chris Develder

This paper demonstrates a data-driven control approach for demand response in real-life residential buildings. The objective is to optimally schedule the heating cycles of the Domestic Hot Water (DHW) buffer to maximize the self-consumption…

Systems and Control · Computer Science 2017-03-17 Oscar De Somer , Ana Soares , Tristan Kuijpers , Koen Vossen , Koen Vanthournout , Fred Spiessens

This paper presents a capacity-constrained incentive-based demand response approach for residential smart grids. It aims to maintain electricity grid capacity limits and prevent congestion by financially incentivising end users to reduce or…

Machine Learning · Computer Science 2026-02-19 Shafagh Abband Pashaki , Sepehr Maleki , Amir Badiee

We study the joint operation and sizing of cooling infrastructure for commercial HVAC systems using reinforcement learning, with the objective of minimizing life-cycle cost over a 30-year horizon. The cooling system consists of a…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Tanay Raghunandan Srinivasa , Vivek Deulkar , Aviruch Bhatia , Vishal Garg

The increasing integration of renewable energy into the power grid has highlighted the critical importance of demand-side flexibility. Among flexible loads, heating, ventilation, and air-conditioning (HVAC) systems are particularly…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Xinlei Zhou , Han Du , Emily W. Yap , Wanbin Dou , Mingyang Huang , Zhenjun Ma

Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully…

Artificial Intelligence · Computer Science 2023-10-13 Judah Goldfeder , John Sipple

Demand flexibility is increasingly important for power grids, in light of growing penetration of renewable generation. Careful coordination of thermostatically controlled loads (TCLs) can potentially modulate energy demand, decrease…

Systems and Control · Electrical Eng. & Systems 2020-10-07 Bingqing Chen , Weiran Yao , Jonathan Francis , Mario Bergés

This paper deals with the problem of cost-optimal operation of smart buildings that integrate a centralized HVAC system, photovoltaic generation and both thermal and electrical storage devices. Building participation in a Demand-Response…

Systems and Control · Computer Science 2019-02-19 Gianni Bianchini , Marco Casini , Daniele Pepe , Antonio Vicino , Giovanni Gino Zanvettor