English
Related papers

Related papers: Enhancing Battery Storage Energy Arbitrage with De…

200 papers

We study the dynamic pricing and replenishment problems under inconsistent decision frequencies. Different from the traditional demand assumption, the discreteness of demand and the parameter within the Poisson distribution as a function of…

Machine Learning · Computer Science 2024-10-29 Yi Zheng , Zehao Li , Peng Jiang , Yijie Peng

Reinforcement learning has been increasingly applied in monitoring applications because of its ability to learn from previous experiences and can make adaptive decisions. However, existing machine learning-based health monitoring…

Machine Learning · Computer Science 2024-10-28 Thanveer Shaik , Xiaohui Tao , Lin Li , Haoran Xie , U R Acharya , Raj Gururajan , Xujuan Zhou

This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand…

With the rapid development of artificial intelligence, data-driven methods effectively overcome limitations in traditional portfolio optimization. Conventional models primarily employ long-only mechanisms, excluding highly correlated assets…

Computational Finance · Quantitative Finance 2025-03-18 Gang Huang , Xiaohua Zhou , Qingyang Song

Financial trading has been widely analyzed for decades with market participants and academics always looking for advanced methods to improve trading performance. Deep reinforcement learning (DRL), a recently reinvigorated method with…

Trading and Market Microstructure · Quantitative Finance 2021-06-17 Ali Hirsa , Joerg Osterrieder , Branka Hadji-Misheva , Jan-Alexander Posth

Recently equal risk pricing, a framework for fair derivative pricing, was extended to consider dynamic risk measures. However, all current implementations either employ a static risk measure that violates time consistency, or are based on…

Pricing of Securities · Quantitative Finance 2021-09-10 Saeed Marzban , Erick Delage , Jonathan Yumeng Li

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

This paper proposes a novel energy storage price arbitrage algorithm combining supervised learning with dynamic programming. The proposed approach uses a neural network to directly predicts the opportunity cost at different energy storage…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Ningkun Zheng , Xiaoxiang Liu , Bolun Xu , Yuanyuan Shi

With the rising extension of renewable energies, the intraday electricity markets have recorded a growing popularity amongst traders as well as electric utilities to cope with the induced volatility of the energy supply. Through their short…

Machine Learning · Computer Science 2024-09-18 Malte Lehna , Björn Hoppmann , René Heinrich , Christoph Scholz

Traditional economic models often rely on fixed assumptions about market dynamics, limiting their ability to capture the complexities and stochastic nature of real-world scenarios. However, reality is more complex and includes noise, making…

Dairy farms consume a significant amount of electricity for their operations, and this research focuses on enhancing energy efficiency and minimizing the impact on the environment in the sector by maximizing the utilization of renewable…

Machine Learning · Computer Science 2024-07-03 Nawazish Ali , Rachael Shaw , Karl Mason

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Deep reinforcement learning (DRL) is a well-suited approach to financial decision-making, where an agent makes decisions based on its trading strategy developed from market observations. Existing DRL intraday trading strategies mainly use…

Trading and Market Microstructure · Quantitative Finance 2024-06-13 Sven Goluža , Tomislav Kovačević , Tessa Bauman , Zvonko Kostanjčar

Can an agent learn efficiently in a noisy and self adapting environment with sequential, non-stationary and non-homogeneous observations? Through trading bots, we illustrate how Deep Reinforcement Learning (DRL) can tackle this challenge.…

Machine Learning · Computer Science 2020-10-19 Eric Benhamou , David Saltiel , Sandrine Ungari , Abhishek Mukhopadhyay , Jamal Atif

Renewable energy resources (RERs) have been increasingly integrated into distribution networks (DNs) for decarbonization. However, the variable nature of RERs introduces uncertainties to DNs, frequently resulting in voltage fluctuations…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Jinhao Li , Ruichang Zhang , Hao Wang , Zhi Liu , Hongyang Lai , Yanru Zhang

In this paper, we discuss the Dutch power market, which is comprised of a day-ahead market and an intraday balancing market that operates like an auction. Due to fluctuations in power supply and demand, there is often an imbalance that…

Trading and Market Microstructure · Quantitative Finance 2023-09-12 Yuanrong Wang , Vignesh Raja Swaminathan , Nikita P. Granger , Carlos Ros Perez , Christian Michler

Deep Reinforcement Learning (DRL) solutions are becoming pervasive at the edge of the network as they enable autonomous decision-making in a dynamic environment. However, to be able to adapt to the ever-changing environment, the DRL…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ivana Dusparic

Predictive control approaches based on deep reinforcement learning (DRL) have gained significant attention in microgrid energy optimization. However, existing research often overlooks the issue of uncertainty stemming from imperfect…

Machine Learning · Computer Science 2025-11-25 Fulong Yao , Wanqing Zhao , Matthew Forshaw

In this letter, we address the problem of controlling energy storage systems (ESSs) for arbitrage in real-time electricity markets under price uncertainty. We first formulate this problem as a Markov decision process, and then develop a…

Machine Learning · Computer Science 2019-05-07 Hanchen Xu , Xiao Li , Xiangyu Zhang , Junbo Zhang

This paper studies the synergy of solar-battery energy storage system (BESS) and develops a viable strategy for the BESS to unlock its economic potential by serving as a backup to reduce solar curtailments while also participating in the…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Jinhao Li , Changlong Wang , Hao Wang