Related papers: Reinforcement Learning-based Thermal Comfort Contr…
Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant…
This paper presents a trustworthy reinforcement learning approach for the control of industrial compressed air systems. We develop a framework that enables safe and energy-efficient operation under realistic boundary conditions and…
This paper deals with the problem of cost-optimal operation of smart buildings that integrate a centralized HVAC system, photovoltaic generation and both thermal and electrical storage devices. Building participation in a Demand-Response…
We propose an energy-efficient controller to minimize the energy consumption of a mobile robot by dynamically manipulating the mechanical and computational actuators of the robot. The mobile robot performs real-time vision-based…
Autonomous driving technologies are expected to not only improve mobility and road safety but also bring energy efficiency benefits. In the foreseeable future, autonomous vehicles (AVs) will operate on roads shared with human-driven…
Emerging vehicular systems with increasing proportions of automated components present opportunities for optimal control to mitigate congestion and increase efficiency. There has been a recent interest in applying deep reinforcement…
Heating, Ventilation, and Cooling (HVAC) systems are often the most significant contributor to the energy usage, and the operational cost, of large office buildings. Therefore, to understand the various factors affecting the energy usage,…
This study proposes a novel climate control strategy for electric vehicles (EVs) by addressing door-opening interruptions, an overlooked aspect in EV thermal management. We create and validate an EV simulation model that incorporates…
We extend earlier work for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal-free intersection by including all possible turns taken so as to optimize a passenger comfort metric along with energy and travel time…
Cabin heating demand and engine efficiency degradation in cold weather lead to considerable increase in fuel consumption of hybrid electric vehicles (HEVs), especially in congested traffic conditions. This paper presents an integrated power…
Reinforcement learning (RL)-based heating, ventilation, and air conditioning (HVAC) control has emerged as a promising technology for reducing building energy consumption while maintaining indoor thermal comfort. However, the efficacy of…
Most modern HVAC systems suffer from two intrinsic problems. First, inability to meet diverse comfort requirements of the occupants. Second, heat or cool an entire zone even when the zone is only partially occupied. Both issues can be…
Heating, ventilation, and air conditioning (HVAC) systems are well proved to be capable to provide operating reserve for power systems. As a type of large-capacity and energy-efficient HVAC system (up to 100 MW), district cooling system…
As electric vehicles (EVs) are increasingly adopted as platforms for connected and automated vehicles (CAVs), enhancing their energy efficiency becomes critical. With the emergence of vehicle-to-vehicle (V2V) communication, cooperative…
Grid-interactive building control is a challenging and important problem for reducing carbon emissions, increasing energy efficiency, and supporting the electric power grid. Currently researchers and practitioners are confronted with a…
In this paper, we investigate an energy cost minimization problem for a smart home in the absence of a building thermal dynamics model with the consideration of a comfortable temperature range. Due to the existence of model uncertainty,…
Automated driving (AD) has substantially improved vehicle safety and driving comfort, but their impact on passenger well-being, particularly infant sleep, is not sufficiently studied. Sudden acceleration, abrupt braking, and sharp maneuvers…
This paper presents a modeling and optimization framework to minimize the energy consumption of a fully electric powertrain by optimizing its design and control strategies whilst explicitly accounting for the thermal behavior of the…
Considering the potential of thermostatically controlled loads (TCLs) to provide flexibility in demand response or load control, a semi-Markov model (SMM) for the ON/OFF controlled TCL is developed in this paper. This model makes full use…
Thermostatically controlled loads and electric vehicles offer flexibility to reduce power peaks in low-voltage distribution networks. This flexibility can be maximized if the devices are coordinated centrally, given some level of…