English
Related papers

Related papers: Counter-Dyna: Data-Efficient RL-Based HVAC Control…

200 papers

It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the thermal comfort of…

Machine Learning · Computer Science 2021-10-27 Vinay Hanumaiah , Sahika Genc

Model-based Reinforcement Learning (MBRL) holds promise for data-efficiency by planning with model-generated experience in addition to learning with experience from the environment. However, in complex or changing environments, models in…

Machine Learning · Computer Science 2022-05-24 Esra'a Saleh , John D. Martin , Anna Koop , Arash Pourzarabi , Michael Bowling

Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully…

Artificial Intelligence · Computer Science 2023-10-13 Judah Goldfeder , John Sipple

The large amount of data collected in buildings makes energy management smarter and more energy efficient. This study proposes a design and implementation methodology of data-driven heating, ventilation, and air conditioning (HVAC) control.…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Yuki Ozawa , Dafang Zhao , Daichi Watari , Ittetsu Taniguchi , Toshihiro Suzuki , Yoshiyuki Shimoda , Takao Onoye

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, optimising system…

Machine Learning · Computer Science 2024-12-02 Anaïs Berkes

Reinforcement learning (RL) is a promising approach for optimizing HVAC control. RL offers a framework for improving system performance, reducing energy consumption, and enhancing cost efficiency. We benchmark two popular classical and deep…

Machine Learning · Computer Science 2023-08-11 Marshall Wang , John Willes , Thomas Jiralerspong , Matin Moezzi

Recent research has shown the potential of Model-based Reinforcement Learning (MBRL) to enhance energy efficiency of Heating, Ventilation, and Air Conditioning (HVAC) systems. However, existing methods rely on black-box thermal dynamics…

Systems and Control · Electrical Eng. & Systems 2024-03-04 Zhiyu An , Xianzhong Ding , Wan Du

We study how a Reinforcement Learning (RL) system can remain sample-efficient when learning from an imperfect model of the environment. This is particularly challenging when the learning system is resource-constrained and in continual…

Machine Learning · Computer Science 2024-07-01 Bradley Burega , John D. Martin , Luke Kapeluck , Michael Bowling

Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as…

Robotics · Computer Science 2023-05-24 Jun Lv , Yunhai Feng , Cheng Zhang , Shuang Zhao , Lin Shao , Cewu Lu

Deep reinforcement learning (DRL) has shown significant promise for uncovering sophisticated control policies that interact in complex environments, such as stabilizing a tokamak fusion reactor or minimizing the drag force on an object in a…

Machine Learning · Computer Science 2025-08-26 Nicholas Zolman , Christian Lagemann , Urban Fasel , J. Nathan Kutz , Steven L. Brunton

This work presents a fully data-driven, black-box pipeline to obtain an optimal control policy for a multi-loop building control problem based on historical building and weather data, thus without the need for complex physics-based…

Machine Learning · Computer Science 2021-11-11 B. Svetozarevic , C. Baumann , S. Muntwiler , L. Di Natale , M. Zeilinger , P. Heer

With more than 32% of the global energy used by commercial and residential buildings, there is an urgent need to revisit traditional approaches to Building Energy Management (BEM). With HVAC systems accounting for about 40% of the total…

Systems and Control · Electrical Eng. & Systems 2023-11-16 Hao Wang , Xiwen Chen , Natan Vital , Edward. Duffy , Abolfazl Razi

This study presents a deep learning model-based reinforcement learning (DL-MBRL) approach for active control of two-dimensional (2D) wake flow past a square cylinder using antiphase jets. The DL-MBRL framework alternates between interacting…

Fluid Dynamics · Physics 2024-08-27 Meng Zhang , Mustafa Z. Yousif , Minze Xu , Haifeng Zhou , Linqi Yu , HeeChang Lim

In this letter, we investigate learning forward dynamics models and multi-step prediction of state variables (long-term prediction) for contact-rich manipulation. The problems are formulated in the context of model-based reinforcement…

Robotics · Computer Science 2020-09-29 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Model-based reinforcement learning (MBRL) is sample-efficient but depends on the accuracy of the learned dynamics, which are often modeled using black-box methods that do not adhere to physical laws. Those methods tend to produce inaccurate…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Shreya Das , Kundan Kumar , Muhammad Iqbal , Outi Savolainen , Dominik Baumann , Laura Ruotsalainen , Simo Särkkä

In the last few years, energy efficiency has become a challenge. Not only mitigating environmental impact but reducing energy waste can lead to financial advantages. Buildings play an important role in this: they are among the biggest…

Systems and Control · Electrical Eng. & Systems 2026-01-30 B. da Costa Paulo , N. Aginako , J. Ugartemendia , I. Landa del Barrio , M. Quartulli , H. Camblong

Deep Reinforcement Learning (DRL) is employed to develop autonomously optimized and custom-designed heat-treatment processes that are both, microstructure-sensitive and energy efficient. Different from conventional supervised machine…

Materials Science · Physics 2022-09-26 Jaber R. Mianroodi , Nima H. Siboni , Dierk Raabe

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas