English
Related papers

Related papers: Towards Machine Learning-based Model Predictive Co…

200 papers

Developing personalised thermal comfort models to inform occupant-centric controls (OCC) in buildings requires collecting large amounts of real-time occupant preference data. This process can be highly intrusive and labour-intensive for…

Machine Learning · Computer Science 2023-09-19 Zeynep Duygu Tekler , Yue Lei , Xilei Dai , Adrian Chong

A key strategy in societal adaptation to climate change is using alert systems to prompt preventative action and reduce the adverse health impacts of extreme heat events. This paper implements and evaluates reinforcement learning (RL) as a…

Machine Learning · Computer Science 2025-04-15 Ellen M. Considine , Rachel C. Nethery , Gregory A. Wellenius , Francesca Dominici , Mauricio Tec

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Multi-band operation in wireless networks can improve data rates by leveraging the benefits of propagation in different frequency ranges. Distinctive beam management procedures in different bands complicate band assignment because they…

Signal Processing · Electrical Eng. & Systems 2023-08-28 Dohyun Kim , Miguel R. Castellanos , Robert W. Heath

Learning in high-dimensional action spaces is a key challenge in applying reinforcement learning (RL) to real-world systems. In this paper, we study the possibility of controlling power networks using RL methods. Power networks are critical…

Machine Learning · Computer Science 2023-11-07 Blazej Manczak , Jan Viebahn , Herke van Hoof

Owing to the call for energy efficiency, the need to optimize the energy consumption of commercial buildings-- responsible for over 40% of US energy consumption--has recently gained significant attention. Moreover, the ability to…

Systems and Control · Computer Science 2019-06-04 Mohammad Ostadijafari , Anamika Dubey , Yang Liu , Jie Shi , Nanpeng Yu

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

This paper proposes a learning-based model predictive control (MPC) approach for the thermal control of a four-zone smart building. The objectives are to minimize energy consumption and maintain the residents' comfort. The proposed control…

Systems and Control · Electrical Eng. & Systems 2019-09-13 Roja Eini , Sherif Abdelwahed

In building management, usually static thermal setpoints are used to maintain the inside temperature of a building at a comfortable level irrespective of its occupancy. This strategy can cause a massive amount of energy wastage and…

Machine Learning · Computer Science 2022-01-20 Rakshitha Godahewa , Chang Deng , Arnaud Prouzeau , Christoph Bergmeir

Controlling Heating, Ventilation and Air Conditioning (HVAC) system to maintain occupant's indoor thermal comfort is important to energy-efficient buildings and the development of smart cities. In this paper, we formulate a model predictive…

Optimization and Control · Mathematics 2020-03-24 Runxin He , Humberto Gonzalez

Model predictive control (MPC) can provide significant energy cost savings in building operations in the form of energy-efficient control with better occupant comfort, lower peak demand charges, and risk-free participation in demand…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Achin Jain , Francesco Smarra , Enrico Reticcioli , Alessandro D'Innocenzo , Manfred Morari

This work presents a case study of optimal energy management of a large Heating Ventilation and Cooling (HVAC) system within a university campus in Australia using Reinforcement Learning (RL). The HVAC system supplies to nine university…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Laura Musgrave , Arnab Bhattacharjee , Tapan Kumar Saha

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

Machine Learning · Computer Science 2025-09-09 Yang Yu

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Building energy modeling plays a vital role in optimizing the operation of building energy systems by providing accurate predictions of the building's real-world conditions. In this context, various techniques have been explored, ranging…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Leandro Von Krannichfeldt , Kristina Orehounig , Olga Fink

Advanced building control methods such as model predictive control (MPC) offer significant potential benefits to both consumers and grid operators, but the high computational requirements have acted as barriers to more widespread adoption.…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Zachary E. Lee , K. Max Zhang

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

The inter-temporal consumption flexibility of commercial buildings can be harnessed to improve the energy efficiency of buildings, or to provide ancillary service to the power grid. To do so, a predictive model of the building's thermal…

Systems and Control · Computer Science 2016-03-23 Qie Hu , Frauke Oldewurtel , Maximilian Balandat , Evangelos Vrettos , Datong Zhou , Claire J. Tomlin

Heating, Ventilation, and Air Conditioning (HVAC) is a major electricity end-use with a substantial potential for providing grid services, such as demand response. Harnessing this flexibility requires accurate modeling of the thermal…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Pietro Favaro , Jean-François Toubeau , François Vallée , Yury Dvorkin