Related papers: From Model-Based to Model-Free: Learning Building …
Water treatment facilities are critical infrastructure they must accommodate dynamic demand patterns without system disruption. These patterns can be scheduled, such as daily residential irrigation, or unexpected, such as demand spikes from…
In addition to its public health crisis, COVID-19 pandemic has led to the shutdown and closure of workplaces with an estimated total cost of more than $16 trillion. Given the long hours an average person spends in buildings and indoor…
We report on a real-time demand response experiment with 100 controllable devices. The experiment reveals several key challenges in the deployment of a real-time demand response program, including time delays, uncertainties,…
The primary objective of this paper is to highlight the need for and benefits of studying the steady state and dynamic response of power systems using three phase integrated transmission and distribution (T&D) system models (hereafter…
The heating, ventilation and air-conditioning (HVAC) system dominates building's energy consumption and meanwhile exhibits substantial operational flexibility that can be exploited for providing grid services. However, the goal is largely…
Flexible loads are a resource for the Balancing Authority (BA) of the future to aid in the balance of power supply and demand. In order to be used as a resource, the BA must know the capacity of the flexible loads to vary their power demand…
Cost-effective decarbonisation of the built environment is a stepping stone to achieving net-zero carbon emissions since buildings are globally responsible for more than a quarter of global energy-related CO$_2$ emissions. Improving energy…
The 4th generation of district heating systems face a potential problem where lowered water temperatures lead to higher flow rates, which requires higher hydraulic capacity in terms of pipe and pump sizes. This increases the effect of the…
Increasing penetration of renewable energy sources (RES) and electrification of energy systems necessitates the engagement of demand-side management (DSM) to help alleviate congestion in electricity grid. Heat pump and thermal energy…
This paper investigates a sample-based solution to the hybrid mode control problem across non-differentiable and algorithmic hybrid modes. Our approach reasons about a set of hybrid control modes as an integer-based optimization problem…
In cloud computing management, the dynamic adaptation of computing resource allocations under time-varying workload is an active domain of investigation. Several control strategies were already proposed. Here the model-free control setting…
Advanced control strategies like Model Predictive Control (MPC) offer significant energy savings for HVAC systems but often require substantial engineering effort, limiting scalability. Reinforcement Learning (RL) promises greater…
Reinforcement learning (RL)-based heating, ventilation, and air conditioning (HVAC) control has emerged as a promising technology for reducing building energy consumption while maintaining indoor thermal comfort. However, the efficacy of…
To respond to volatility and congestion in the power grid, demand response (DR) mechanisms allow for shaping the load compared to a base load profile. When tapping on a large population of heterogeneous appliances as a DR resource, the…
The flexible, efficient, and reliable operation of grid-interactive efficient buildings (GEBs) is increasingly impacted by the growing penetration of distributed energy resources (DERs). Besides, the optimization and control of DERs,…
A frequency based data-driven control design considering mixed H2/H-infinity control objectives is developed for multiple input-single output systems. The main advantage of the data-driven control over the model-based control is its ability…
Recent success in deep reinforcement learning for continuous control has been dominated by model-free approaches which, unlike model-based approaches, do not suffer from representational limitations in making assumptions about the world…
Although variable-speed three-blade wind turbines are nowadays quite popular, their control remains a challenging task. We propose a new easily implementable model-free control approach with the corresponding intelligent controllers.…
Optimizing the operation of heating, ventilation, and air-conditioning (HVAC) systems is a challenging task, requiring the modeling of complex nonlinear relationships among HVAC load, indoor temperatures, and outdoor environments. This…
This paper proposes a fully distributed Demand-Side Management system for Smart Grid infrastructures, especially tailored to reduce the peak demand of residential users. In particular, we use a dynamic pricing strategy, where energy tariffs…