English
Related papers

Related papers: Reinforcement learning based demand charge minimiz…

200 papers

There is increasing demand to bring machine learning capabilities to low power devices. By integrating the computational power of machine learning with the deployment capabilities of low power devices, a number of new applications become…

Optimizing the energy management within a smart grids scenario presents significant challenges, primarily due to the complexity of real-world systems and the intricate interactions among various components. Reinforcement Learning (RL) is…

Machine Learning · Computer Science 2025-10-21 Julen Cestero , Carmine Delle Femine , Kenji S. Muro , Marco Quartulli , Marcello Restelli

Understanding and predicting the electricity demand responses to prices are critical activities for system operators, retailers, and regulators. While conventional machine learning and time series analyses have been adequate for the routine…

Signal Processing · Electrical Eng. & Systems 2024-10-07 Adrian Esteban-Perez , Derek Bunn , Yashar Ghiassi-Farrokhfal

Power sector decarbonization plays a vital role in the upcoming energy transition towards a more sustainable future. Decentralized energy resources, such as Electric Vehicles (EV) and solar photovoltaic systems (PV), are continuously…

Buildings account for 40% of global energy consumption. A considerable portion of building energy consumption stems from heating, ventilation, and air conditioning (HVAC), and thus implementing smart, energy-efficient HVAC systems has the…

Optimization and Control · Mathematics 2025-05-05 Fredrik Hagström , Vikas Garg , Fabricio Oliveira

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Ali Aalipour , Alireza Khani

We explore the use of deep reinforcement learning to provide strategies for long term scheduling of hydropower production. We consider a use-case where the aim is to optimise the yearly revenue given week-by-week inflows to the reservoir…

Machine Learning · Computer Science 2020-12-14 Signe Riemer-Sorensen , Gjert H. Rosenlund

The widespread diffusion of distributed energy resources, especially those based on renewable energy, and energy storage devices has deeply modified power systems. As a consequence, demand response, the ability of customers to respond to…

Systems and Control · Electrical Eng. & Systems 2021-04-21 Francesco Conte , Matteo Saviozzi , Samuele Grillo

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

Demand response is widely employed by today's data centers to reduce energy consumption in response to the increasing of electricity cost. To incentivize users of data centers participate in the demand response programs, i.e., breaking the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-08 Yong Zhan , Du Xu , Hongfang Yu , Shui Yu

The increasing number of Electric Vehicles (EVs) have led to rising energy demands which aggregates the burden on grid supply. A few solutions have been proposed to reduce grid load, for example, using storage systems for storing surplus…

Systems and Control · Electrical Eng. & Systems 2023-12-14 Ferheen Ayaz , Maziar Nekovee

Demand flexibility plays a vital role in maintaining grid balance, reducing peak demand, and saving customers' energy bills. Given their highly shiftable load and significant contribution to a building's energy consumption, Heating,…

Systems and Control · Electrical Eng. & Systems 2023-06-30 Ruohong Liu , Yuxin Pan , Yize Chen

Reinforcement learning has been explored for many problems, from video games with deterministic environments to portfolio and operations management in which scenarios are stochastic; however, there have been few attempts to test these…

General Finance · Quantitative Finance 2024-02-19 Sherly Alfonso-Sánchez , Jesús Solano , Alejandro Correa-Bahnsen , Kristina P. Sendova , Cristián Bravo

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

With the time-varying renewable energy generation and power demand, microgrids (MGs) exchange energy in smart grids to reduce their dependence on power plants. In this paper, we formulate an MG energy trading game, in which each MG trades…

Systems and Control · Computer Science 2018-01-22 Liang Xiao , Xingyu Xiao , Canhuang Dai , Mugen Pengy , Lichun Wang , H. Vincent Poor

Since the electricity bill of a data center constitutes a significant portion of its overall operational costs, reducing this has become important. We investigate cost reduction opportunities that arise by the use of uninterrupted power…

Performance · Computer Science 2011-03-22 Rahul Urgaonkar , Bhuvan Urgaonkar , Michael J. Neely , Anand Sivasubramaniam

This paper demonstrates how reinforcement learning can explain two puzzling empirical patterns in household consumption behavior during economic downturns. I develop a model where agents use Q-learning with neural network approximation to…

General Economics · Economics 2025-10-24 Brandon Kaplowitz

One of the major challenges in training deep architectures for predictive tasks is the scarcity and cost of labeled training data. Active Learning (AL) is one way of addressing this challenge. In stream-based AL, observations are…

Machine Learning · Computer Science 2019-09-05 Andreas Kvistad , Massimiliano Ruocco , Eliezer de Souza da Silva , Erlend Aune

In this work we investigate the inefficiency of the electricity system with strategic agents. Specifically, we prove that without a proper control the total demand of an inefficient system is at most twice the total demand of the optimal…

Computer Science and Game Theory · Computer Science 2015-09-10 Carlos Barreto , Eduardo Mojica-Nava , Nicanor Quijano

In a day-ahead market, energy buyers and sellers submit their bids for a particular future time, including the amount of energy they wish to buy or sell and the price they are prepared to pay or receive. However, the dynamic for forming the…

Optimization and Control · Mathematics 2024-11-26 Luca Di Persio , Matteo Garbelli , Luca M. Giordano