Related papers: Mean Field Control of Thermostatically Controlled …
Distributed model predictive control methods for uncertain systems often suffer from considerable conservatism and can tolerate only small uncertainties due to the use of robust formulations that are amenable to distributed design and…
This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…
A collection of thermostatically controlled loads (TCLs) -- such as air conditioners and water heaters -- can vary their power consumption within limits to help the balancing authority of a power grid maintain demand supply balance. Doing…
A significant portion of electricity consumed worldwide is used to power thermostatically controlled loads (TCLs) such as air conditioners, refrigerators, and water heaters. Because the short-term timing of operation of such systems is…
This paper presents a new aggregate power tracking control scheme for populations of thermostatically controlled loads (TCLs). The control design is carried out in the framework of partial differential equations (PDEs) based on a…
Traffic-responsive signal control is a cost-effective and easy-to-implement network management strategy with high potential in improving performance in congested networks with dynamic characteristics. Max Pressure (MP) distributed…
Piecewise-deterministic Markov processes (PDMPs) are often used to model abrupt changes in the global environment or capabilities of a controlled system. This is typically done by considering a set of "operating modes" (each with its own…
A sequential trajectory linearized adaptive model based predictive controller is designed using the DMC algorithm to control the temperature of a batch MMA polymerization process. Using the mechanistic model of the polymerization, a…
We develop an exhaustive study of Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise, and when optimization is performed over open-loop controls on infinite horizon. Such…
The main goal of this paper is to derive sufficient conditions for the existence of an optimal control strategy for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a…
In this work we are interested in the mean-field formulation of kinetic models under control actions where the control is formulated through a model predictive control strategy (MPC) with varying horizon. The relation between the (usually…
When controlling multi-agent systems, the trade-off between performance and scalability is a major challenge. Here, we address this difficulty by using mean field games (MFGs), which is a framework that deduces the macroscopic dynamics…
Piecewise deterministic Markov processes (PDMPs) are a class of stochastic processes with applications in several fields of applied mathematics spanning from mathematical modeling of physical phenomena to computational methods. A PDMP is…
Aggregations of thermostatically controlled loads (TCLs), such as air conditioners, offer valuable flexibility to the power grid. The aggregate power consumption of a TCL fleet can be controlled by adjusting thermostat setpoints. An…
Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…
Within the realm of dynamic of \emph{smart buildings} and \emph{smart cities}, dynamic response management is playing an ever-increasing role thus attracting the attention of scientists from different disciplines. Dynamic demand response…
Mean field limits are an important tool in the context of large-scale dynamical systems, in particular, when studying multiagent and interacting particle systems. While the continuous-time theory is well-developed, few works have considered…
Thermostatically controlled loads (TCLs) can provide ancillary services to the power network by aiding existing frequency control mechanisms. TCLs are, however, characterized by an intrinsic limit cycle behavior which raises the risk that…
This work discusses a two-step procedure, based on formal abstractions, to generate a finite-space stochastic dynamical model as an aggregation of the continuous temperature dynamics of a homogeneous population of Thermostatically…
The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with…