English
Related papers

Related papers: HVAC-DPT: A Decision Pretrained Transformer for HV…

200 papers

Model Predictive Control (MPC) has demonstrated significant potential in improving energy efficiency in building climate control, outperforming traditional controllers commonly used in modern building management systems. Among MPC variants,…

Systems and Control · Electrical Eng. & Systems 2026-02-25 Jicheng Shi , Christophe Salzmann , Colin N. Jones

Price-based demand response (DR) of heating, ventilating, and air-conditioning (HVAC) systems is a challenging task, requiring comprehensive models to represent the building thermal dynamics and game theoretic interactions among…

Systems and Control · Electrical Eng. & Systems 2020-12-15 Youngjin Kim

The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Hasibul Jamil , Jacob Goldverg , Elvis Rodrigues , MD S Q Zulkar Nine , Tevfik Kosar

Decision Transformer (DT), which employs expressive sequence modeling techniques to perform action generation, has emerged as a promising approach to offline policy optimization. However, DT generates actions conditioned on a desired future…

Machine Learning · Computer Science 2024-06-25 Chen-Xiao Gao , Chenyang Wu , Mingjun Cao , Rui Kong , Zongzhang Zhang , Yang Yu

Given its substantial contribution of 40\% to global power consumption, the built environment has received increasing attention to serve as a source of flexibility to assist the modern power grid. In that respect, previous research mainly…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Gargya Gokhale , Niels Tiben , Marie-Sophie Verwee , Manu Lahariya , Bert Claessens , Chris Develder

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully…

Artificial Intelligence · Computer Science 2023-10-13 Judah Goldfeder , John Sipple

In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses…

Machine Learning · Computer Science 2023-01-30 Xianzhong Ding , Alberto Cerpa , Wan Du

Reinforcement learning (RL) techniques have been developed to optimize industrial cooling systems, offering substantial energy savings compared to traditional heuristic policies. A major challenge in industrial control involves learning…

Machine Learning · Computer Science 2022-09-20 William Wong , Praneet Dutta , Octavian Voicu , Yuri Chervonyi , Cosmin Paduraru , Jerry Luo

This article proposes a transfer reinforcement learning (RL) based adaptive energy managing approach for a hybrid electric vehicle (HEV) with parallel topology. This approach is bi-level. The up-level characterizes how to transform the…

Systems and Control · Electrical Eng. & Systems 2020-07-27 Teng Liu , Wenhao Tan , Xiaolin Tang , Jiaxin Chen , Dongpu Cao

The ongoing energy transition drives the development of decentralised renewable energy sources, which are heterogeneous and weather-dependent, complicating their integration into energy systems. This study tackles this issue by introducing…

Machine Learning · Computer Science 2024-07-01 Marine Cauz , Adrien Bolland , Nicolas Wyrsch , Christophe Ballif

Building operations represent a significant percentage of the total primary energy consumed in most countries due to the proliferation of Heating, Ventilation and Air-Conditioning (HVAC) installations in response to the growing demand for…

This study focuses on operational control strategies for a multi-energy District Heating Network (DHN). Two control strategies are investigated and compared: (i) a reactive rule-based control (RBC) and (ii) a model predictive control (MPC).…

Optimization and Control · Mathematics 2025-06-19 Michael Nikhil Descamps , Nicolas Lamaison , Mathieu Vallee , Roland Baviere

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

Cooling system plays a critical role in a modern data center (DC). Developing an optimal control policy for DC cooling system is a challenging task. The prevailing approaches often rely on approximating system models that are built upon the…

Artificial Intelligence · Computer Science 2018-07-19 Yuanlong Li , Yonggang Wen , Kyle Guan , Dacheng Tao

The integration of distributed renewable generation (DRG) in distribution networks can be effectively promoted by scheduling flexible resources such as heating, ventilation, and air conditioning (HVAC) loads. However, finding the optimal…

Systems and Control · Electrical Eng. & Systems 2022-10-03 Ge Chen , Hongcai Zhang , Hongxun Hui , Yonghua Song

Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A…

Systems and Control · Electrical Eng. & Systems 2023-12-11 Manuel Schaller , Amelie Zeller , Michael Böhm , Oliver Sawodny , Cristina Tarín , Karl Worthmann

Predictive power allocation is conceived for energy-efficient video streaming over mobile networks using deep reinforcement learning. The goal is to minimize the accumulated energy consumption of each base station over a complete video…

Machine Learning · Computer Science 2020-11-06 Dong Liu , Jianyu Zhao , Chenyang Yang , Lajos Hanzo

The flexible power consumption feature of thermostatically controlled loads (TCLs) such as heating, ventilation, and air-conditioning (HVAC) systems makes them attractive targets for demand response (DR). TCLs possess a brief period where…

Systems and Control · Electrical Eng. & Systems 2021-10-26 Praveen Dhanasekar , Cunzhi Zhao , Xingpeng Li