English
Related papers

Related papers: Approximating Energy Market Clearing and Bidding W…

200 papers

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

The increasing complexity of power grid management, driven by the emergence of prosumers and the demand for cleaner energy solutions, has needed innovative approaches to ensure stability and efficiency. This paper presents a novel approach…

Artificial Intelligence · Computer Science 2025-03-27 Eloy Anguiano Batanero , Ángela Fernández , Álvaro Barbero

Being able to harness the power of large datasets for developing cooperative multi-agent controllers promises to unlock enormous value for real-world applications. Many important industrial systems are multi-agent in nature and are…

Machine Learning · Computer Science 2023-09-26 Claude Formanek , Asad Jeewa , Jonathan Shock , Arnu Pretorius

Market making is a fundamental trading problem in which an agent provides liquidity by continually offering to buy and sell a security. The problem is challenging due to inventory risk, the risk of accumulating an unfavourable position and…

Artificial Intelligence · Computer Science 2018-04-13 Thomas Spooner , John Fearnley , Rahul Savani , Andreas Koukorinis

Power grid operation is becoming increasingly complex due to the rising integration of renewable energy sources and the need for more adaptive control strategies. Reinforcement Learning (RL) has emerged as a promising approach to power…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Erica van der Sar , Alessandro Zocca , Sandjai Bhulai

The existing research on market price-affecting agents, i.e. price makers, neglects or simplifies the nature of AC power flows in the power system as it predominantly relies on DC power flows. This paper proposes a novel bilevel formulation…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Karlo Šepetanc , Hrvoje Pandžić , Tomislav Capuder

Mean-Field Control (MFC) has recently been proven to be a scalable tool to approximately solve large-scale multi-agent reinforcement learning (MARL) problems. However, these studies are typically limited to unconstrained cumulative reward…

Machine Learning · Computer Science 2024-09-11 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

Optimized trade execution is to sell (or buy) a given amount of assets in a given time with the lowest possible trading cost. Recently, reinforcement learning (RL) has been applied to optimized trade execution to learn smarter policies from…

Trading and Market Microstructure · Quantitative Finance 2023-07-24 Chuheng Zhang , Yitong Duan , Xiaoyu Chen , Jianyu Chen , Jian Li , Li Zhao

In the context of managing distributed energy resources (DERs) within distribution networks (DNs), this work focuses on the task of developing local controllers. We propose an unsupervised learning framework to train functions that can…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Zhenyi Yuan , Guido Cavraro , Ahmed S. Zamzam , Jorge Cortés

In this paper, we develop a multi-agent reinforcement learning (MARL) framework to obtain online power control policies for a large energy harvesting (EH) multiple access channel, when only causal information about the EH process and…

Machine Learning · Computer Science 2019-10-23 Mohit K. Sharma , Alessio Zappone , Mohamad Assaad , Merouane Debbah , Spyridon Vassilaras

Reinforcement learning (RL) algorithms aim to learn optimal decisions in unknown environments through experience of taking actions and observing the rewards gained. In some cases, the environment is not influenced by the actions of the RL…

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

Accurate and efficient imbalance electricity price forecasting is critical for industrial energy trading systems, especially as battery assets and automated bidding pipelines increasingly participate in balancing markets. However, real-time…

Computational Finance · Quantitative Finance 2026-05-12 Runyao Yu , Julia Lin , Derek W. Bunn , Jochen Stiasny , Wentao Wang , Yujie Chen , Tara Esterl , Peter Palensky , Jochen L. Cremer

The problem of market clearing is to set a price for an item such that quantity demanded equals quantity supplied. In this work, we cast the problem of predicting clearing prices into a learning framework and use the resulting models to…

Machine Learning · Computer Science 2019-06-25 Weiran Shen , Sébastien Lahaie , Renato Paes Leme

Market making (MM) has attracted significant attention in financial trading owing to its essential function in ensuring market liquidity. With strong capabilities in sequential decision-making, Reinforcement Learning (RL) technology has…

Machine Learning · Computer Science 2023-08-21 Hui Niu , Siyuan Li , Jiahao Zheng , Zhouchi Lin , Jian Li , Jian Guo , Bo An

We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall…

Information Theory · Computer Science 2024-02-06 Tianzhang Cai , Qichen Wang , Shuai Zhang , Özlem Tuğfe Demir , Cicek Cavdar

Multi-Agent Reinforcement Learning (MARL) considers settings in which a set of coexisting agents interact with one another and their environment. The adaptation and learning of other agents induces non-stationarity in the environment…

Machine Learning · Computer Science 2020-06-09 Ian Davies , Zheng Tian , Jun Wang

Algorithmic trading refers to executing buy and sell orders for specific assets based on automatically identified trading opportunities. Strategies based on reinforcement learning (RL) have demonstrated remarkable capabilities in addressing…

Trading and Market Microstructure · Quantitative Finance 2024-07-03 Xi Cheng , Jinghao Zhang , Yunan Zeng , Wenfang Xue

Multi-agent reinforcement learning (MARL) is a widely used Artificial Intelligence (AI) technique. However, current studies and applications need to address its scalability, non-stationarity, and trustworthiness. This paper aims to review…

Artificial Intelligence · Computer Science 2024-06-07 Ziyuan Zhou , Guanjun Liu , Ying Tang

This paper addresses a critical challenge in the high-speed passenger railway industry: designing effective dynamic pricing strategies in the context of competing and cooperating operators. To address this, a multi-agent reinforcement…