English
Related papers

Related papers: A Deep Reinforcement Learning Framework for Contin…

200 papers

Maintaining energy balance and economical operation is significant for multi-energy systems such as the energy hub. However, it is usually challenged by the frequently changing and unpredictable uncertainties at different timescales. Under…

Computational Engineering, Finance, and Science · Computer Science 2022-03-03 Jiaxin Cao , Bo Yang , Shanying Zhu , Chi Yung Chung , Xinping Guan

Motivated by the application of energy storage management in electricity markets, this paper considers the problem of online linear programming with inventory management constraints. Specifically, a decision maker should satisfy some units…

Data Structures and Algorithms · Computer Science 2019-01-15 Lin Yang , Mohammad H. Hajiesmaili , Ramesh Sitaraman , Enrique Mallada , Wing S. Wong , Adam Wierman

We characterize profit-maximizing operating strategies, over some time horizon [0,T], for an energy store which is trading in an arbitrage market. Our theory allows for leakage, operating inefficiencies, operating constraints and general…

Optimization and Control · Mathematics 2014-12-03 Lisa Flatley , Robert S. MacKay , Michael Waterson

An important revenue stream for electric battery operators is often arbitraging the hourly price spreads in the day-ahead auction. The optimal approach to this is challenging if risk is a consideration as this requires the estimation of…

Applications · Statistics 2021-09-01 Ekaterina Abramova , Derek Bunn

Many real-world auctions are dynamic processes, in which bidders interact and report information over multiple rounds with the auctioneer. The sequential decision making aspect paired with imperfect information renders analyzing the…

Computer Science and Game Theory · Computer Science 2023-12-21 Vinzenz Thoma , Michael Curry , Niao He , Sven Seuken

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

Distributed energy resources (DERs), such as rooftop solar panels, are growing rapidly and are reshaping power systems. To promote DERs, feed-in-tariff (FIT) is usually adopted by utilities to pay DER owners certain fixed rates for…

Systems and Control · Electrical Eng. & Systems 2020-02-24 Zibo Zhao , Andrew L. Liu

Agricultural products are often subject to seasonal fluctuations in production and demand. Predicting and managing inventory levels in response to these variations can be challenging, leading to either excess inventory or stockouts.…

Artificial Intelligence · Computer Science 2025-07-23 Amandeep Kaur , Gyan Prakash

In this paper, we propose a complete modelling framework to value several batteries in the electricity intraday market at the trading session scale. The model consists of a stochastic model for the 24 mid-prices (one price per delivery…

Trading and Market Microstructure · Quantitative Finance 2024-12-23 Enzo Cognéville , Thomas Deschatre , Xavier Warin

With the large number of prosumers deploying distributed energy resources (DERs), integrating these prosumers into a transactive energy market (TEM) is a trend for the future smart grid. A community-based double auction market is considered…

Systems and Control · Electrical Eng. & Systems 2025-02-25 Jun Jiang , Yuanliang Li , Luyang Hou , Mohsen Ghafouri , Peng Zhang , Jun Yan , Yuhong Liu

In multi-agent reinforcement learning systems, the actions of one agent can have a negative impact on the rewards of other agents. One way to combat this problem is to let agents trade their rewards amongst each other. Motivated by this,…

Artificial Intelligence · Computer Science 2022-07-25 Michael Kölle , Lennart Rietdorf , Kyrill Schmid

The participation of electric vehicle (EV) aggregators in real-time electricity markets offers promising revenue opportunities through price-responsive energy arbitrage. A central challenge in economic bidding lies in quantifying the…

Optimization and Control · Mathematics 2025-10-02 Zhen Zhu , Hongcai Zhang , Yonghua Song

We demonstrate an application of risk-sensitive reinforcement learning to optimizing execution in limit order book markets. We represent taking order execution decisions based on limit order book knowledge by a Markov Decision Process; and…

Trading and Market Microstructure · Quantitative Finance 2021-01-07 Svitlana Vyetrenko , Shaojie Xu

This paper studies how platform design shapes strategic behavior in decentralized electricity trading. We develop a finite-horizon dynamic game in which photovoltaic- and battery-equipped players ("prosumers") trade on a platform that maps…

General Economics · Economics 2026-03-23 Nicolas Eschenbaum , Nicolas Greber

We consider a meal delivery service fulfilling dynamic customer requests given a set of couriers over the course of a day. A courier's duty is to pick-up an order from a restaurant and deliver it to a customer. We model this service as a…

Machine Learning · Computer Science 2022-03-01 Hadi Jahanshahi , Aysun Bozanta , Mucahit Cevik , Eray Mert Kavuk , Ayşe Tosun , Sibel B. Sonuc , Bilgin Kosucu , Ayşe Başar

Demand response (DR), as one of the important energy resources in the future's grid, provides the services of peak shaving, enhancing the efficiency of renewable energy utilization with a short response period, and low cost. Various…

Artificial Intelligence · Computer Science 2022-02-10 Kuan-Cheng Lee , Hong-Tzer Yang , Wenjun Tang

The smart grid vision entails advanced information technology and data analytics to enhance the efficiency, sustainability, and economics of the power grid infrastructure. Aligned to this end, modern statistical learning tools are leveraged…

Machine Learning · Statistics 2015-06-17 Vassilis Kekatos , Yu Zhang , Georgios B. Giannakis

The energy transition is expected to significantly increase the share of renewable energy sources whose production is intermittent in the electricity mix. Apart from key benefits, this development has the major drawback of generating a…

Trading and Market Microstructure · Quantitative Finance 2023-01-30 Thibaut Théate , Antonio Sutera , Damien Ernst

To accommodate the advent of microgrids (MG) managing distributed energy resources (DER) in distribution systems, an interactive two-stage joint retail electricity market mechanism is proposed to provide an effective platform for these…

Systems and Control · Electrical Eng. & Systems 2021-07-28 Chunyi Huang , Mingzhi Zhang , Chengmin Wang , Ning Xie , Jian Wang , Shi Peng

Finding optimal bidding strategies for generation units in electricity markets would result in higher profit. However, it is a challenging problem due to the system uncertainty which is due to the unknown other generation units' strategies.…

Artificial Intelligence · Computer Science 2022-08-15 Pegah Rokhforoz , Olga Fink