English
Related papers

Related papers: Deep Reinforcement Learning for Heat Pump Control

200 papers

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

The future transportation system will be a multi-agent network where connected AI agents can work together to address the grand challenges in our age, e.g., mitigation of real-world driving energy consumption. Distinguished from the…

Machine Learning · Computer Science 2022-11-29 Min Hua , Zhi Li , Quan Zhou

The economic feasibility of nuclear microreactors will depend on minimizing operating costs through advancements in autonomous control, especially when these microreactors are operating alongside other types of energy systems (e.g.,…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Leo Tunkle , Kamal Abdulraheem , Linyu Lin , Majdi I. Radaideh

With the ongoing energy transition, demand-side flexibility has become an important aspect of the modern power grid for providing grid support and allowing further integration of sustainable energy sources. Besides traditional sources, the…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Gargya Gokhale , Bert Claessens , Chris Develder

Deep reinforcement learning has been recognized as an efficient technique to design optimal strategies for different complex systems without prior knowledge of the control landscape. To achieve a fast and precise control for quantum…

Quantum Physics · Physics 2021-01-05 Hailan Ma , Daoyi Dong , Steven X. Ding , Chunlin Chen

Flexibility provided by Combined Heat and Power (CHP) units in district heating networks is an important means to cope with increasing penetration of intermittent renewable energy resources, and various methods have been proposed to exploit…

Systems and Control · Electrical Eng. & Systems 2023-05-15 Hikaru Hoshino , T. John Koo , Yun-Chung Chu , Yoshihiko Susuki

With the rising extension of renewable energies, the intraday electricity markets have recorded a growing popularity amongst traders as well as electric utilities to cope with the induced volatility of the energy supply. Through their short…

Machine Learning · Computer Science 2024-09-18 Malte Lehna , Björn Hoppmann , René Heinrich , Christoph Scholz

Optimizing HVAC (Heating, Ventilation and Air Conditioning) can enhance a building's energy efficiency while providing comfort levels for its occupants. Using conventional control systems to maintain HVAC functions is often difficult…

Model-Predictive Control (MPC) is a powerful tool for controlling complex, real-world systems that uses a model to make predictions about future behavior. For each state encountered, MPC solves an online optimization problem to choose a…

Machine Learning · Computer Science 2021-04-15 Mohak Bhardwaj , Sanjiban Choudhury , Byron Boots

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

Fluid Dynamics · Physics 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa

Among the auxiliary loads in light-duty vehicles, the air conditioning system is the single largest energy consumer. For electrified vehicles, the impact of heating and cooling loads becomes even more significant, as they compete with the…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Dennis Kibalama , Yuxing Liu , Stephanie Stockar , Marcello Canova

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. While the capabilities of DRL to solve…

Fluid Dynamics · Physics 2022-11-30 Jonathan Viquerat , Philippe Meliga , Elie Hachem

The aim of the project is to investigate and assess opportunities for applying reinforcement learning (RL) for power system control. As a proof of concept (PoC), voltage control of thermostatically controlled loads (TCLs) for power…

Machine Learning · Computer Science 2020-05-12 Oleh Lukianykhin , Tetiana Bogodorova

Model predictive control (MPC) is widely used for motion planning, particularly in autonomous driving. Real-time capability of the planner requires utilizing convex approximation of optimal control problems (OCPs) for the planner. However,…

Robotics · Computer Science 2025-12-04 Johannes Fischer , Marlon Steiner , Ömer Sahin Tas , Christoph Stiller

Noise pollution from heat pumps (HPs) has been an emerging concern to their broader adoption, especially in densely populated areas. This paper explores a model predictive control (MPC) approach for building climate control, aimed at…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Yun Li , Jicheng Shi , Colin N. Jones , Neil Yorke-Smith , Tamas Keviczky

Model-Based Reinforcement Learning (MBRL) has been widely studied for Heating, Ventilation, and Air Conditioning (HVAC) control in buildings. One of the critical challenges is the large amount of data required to effectively train neural…

Systems and Control · Electrical Eng. & Systems 2024-11-07 Xianzhong Ding , Zhiyu An , Arya Rathee , Wan Du

Rotating detonation engines (RDEs) are a promising propulsion concept that may offer higher thermodynamic efficiency and specific impulse than conventional systems, but nonlinear phenomena, including transitions to oscillatory or chaotic…

Fluid Dynamics · Physics 2026-04-17 Kristian Holme , Jean Rabault , Ricardo Vinuesa , Mikael Mortensen

The transformation of fossil fuel-based district heating grids (DHGs) to CO$_2$-neutral DHGs requires the development of novel operating strategies. Model predictive control (MPC) is a promising approach, as knowledge about future heat…

Systems and Control · Electrical Eng. & Systems 2024-04-03 Max Rose , Hannes Gernandt , Juan E. Machado , Johannes Schiffer

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song