English
Related papers

Related papers: A Safe and Data-efficient Model-based Reinforcemen…

200 papers

Heating, ventilation, and air conditioning (HVAC) systems are well proved to be capable to provide operating reserve for power systems. As a type of large-capacity and energy-efficient HVAC system (up to 100 MW), district cooling system…

Systems and Control · Electrical Eng. & Systems 2021-12-22 Peipei Yu , Hongxun Hui , Hongcai Zhang , Ge Chen , Yonghua Song

Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant…

Systems and Control · Electrical Eng. & Systems 2020-04-22 Ali Hassan , Deepjyoti Deka , Michael Chertkov , Yury Dvorkin

Reinforcement learning (RL) is a promising approach for optimizing HVAC control. RL offers a framework for improving system performance, reducing energy consumption, and enhancing cost efficiency. We benchmark two popular classical and deep…

Machine Learning · Computer Science 2023-08-11 Marshall Wang , John Willes , Thomas Jiralerspong , Matin Moezzi

Greenhouse climate control is concerned with maximizing performance in terms of crop yield and resource efficiency. One promising approach is model predictive control (MPC), which leverages a model of the system to optimize the control…

Systems and Control · Electrical Eng. & Systems 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Congcong Sun , Bart De Schutter

This letter presents contact-safe Model-based Reinforcement Learning (MBRL) for robot applications that achieves contact-safe behaviors in the learning process. In typical MBRL, we cannot expect the data-driven model to generate accurate…

Robotics · Computer Science 2021-03-10 Cheng-Yu Kuo , Andreas Schaarschmidt , Yunduan Cui , Tamim Asfour , Takamitsu Matsubara

The large thermal capacity of buildings enables heating, ventilating, and air-conditioning (HVAC) systems to be exploited as demand response (DR) resources. Optimal DR of HVAC units is challenging, particularly for multi-zone buildings,…

Machine Learning · Computer Science 2019-05-01 Youngjin Kim

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Heating, Ventilation, and Air Conditioning (HVAC) is a major electricity end-use with a substantial potential for providing grid services, such as demand response. Harnessing this flexibility requires accurate modeling of the thermal…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Pietro Favaro , Jean-François Toubeau , François Vallée , Yury Dvorkin

The rapid growth of machine learning (ML) has led to an increased demand for computational power, resulting in larger data centers (DCs) and higher energy consumption. To address this issue and reduce carbon emissions, intelligent design…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-18 Soumyendu Sarkar , Avisek Naug , Antonio Guillen , Ricardo Luna , Vineet Gundecha , Ashwin Ramesh Babu , Sajad Mousavi

In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses…

Machine Learning · Computer Science 2023-01-30 Xianzhong Ding , Alberto Cerpa , Wan Du

High energy consumption remains a key challenge in high-performance computing (HPC) systems, which often feature hundreds or thousands of nodes drawing substantial power even in idle or standby modes. Although powering down unused nodes can…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-23 Thomas Budiarjo , Santana Yuda Pradata , Kadek Gemilang Santiyuda , Muhammad Alfian Amrizal , Reza Pulungan , Hiroyuki Takizawa

Reinforcement learning (RL) techniques have been increasingly investigated for dynamic HVAC control in buildings. However, most studies focus on exploring solutions in online or off-policy scenarios without discussing in detail the…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Linyan Li , Qi Liu , Yu Yang

Heating, ventilation, and air conditioning (HVAC) systems account for a substantial share of building energy consumption. Environmental uncertainty and dynamic occupancy behavior bring challenges in decarbonized HVAC control. Reinforcement…

Systems and Control · Electrical Eng. & Systems 2026-03-30 Dianyu Zhong , Tian Xing , Kailai Sun , Xu Yang , Heye Huang , Irfan Qaisar , Tinggang Jia , Shaobo Wang , Qianchuan Zhao

Heating, Ventilation, and Air Conditioning (HVAC) is extremely energy-consuming, accounting for 40% of total building energy consumption. Therefore, it is crucial to design some energy-efficient building thermal control policies which can…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Guanyu Gao , Jie Li , Yonggang Wen

Reinforcement learning (RL) techniques have been developed to optimize industrial cooling systems, offering substantial energy savings compared to traditional heuristic policies. A major challenge in industrial control involves learning…

Machine Learning · Computer Science 2022-09-20 William Wong , Praneet Dutta , Octavian Voicu , Yuri Chervonyi , Cosmin Paduraru , Jerry Luo

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

Grid-interactive building control is a challenging and important problem for reducing carbon emissions, increasing energy efficiency, and supporting the electric power grid. Currently researchers and practitioners are confronted with a…

Systems and Control · Electrical Eng. & Systems 2022-10-20 David Biagioni , Xiangyu Zhang , Christiane Adcock , Michael Sinner , Peter Graf , Jennifer King

Heating and cooling systems in buildings account for 31\% of global energy use, much of which are regulated by Rule Based Controllers (RBCs) that neither maximise energy efficiency nor minimise emissions by interacting optimally with the…

Machine Learning · Computer Science 2022-08-17 Scott R. Jeen , Alessandro Abate , Jonathan M. Cullen

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

Heating and cooling systems in buildings account for 31% of global energy use, much of which are regulated by Rule Based Controllers (RBCs) that neither maximise energy efficiency nor minimise emissions by interacting optimally with the…

Machine Learning · Computer Science 2023-10-12 Scott R. Jeen , Alessandro Abate , Jonathan M. Cullen