English
Related papers

Related papers: Natural-gas storage modelling by deep reinforcemen…

200 papers

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

This paper introduces an enhanced framework for managing Battery Energy Storage Systems (BESS) in residential communities. The non-convex BESS control problem is first addressed using a gradient-based optimizer, providing a benchmark…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Alaa Selim , Huadong Mo , Hemanshu Pota , Daoyi Dong

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

This paper investigates the application of Deep Reinforcement Learning (DRL) for Environment, Social, and Governance (ESG) financial portfolio management, with a specific focus on the potential benefits of ESG score-based market regulation.…

Portfolio Management · Quantitative Finance 2023-07-20 Eduardo C. Garrido-Merchán , Sol Mora-Figueroa-Cruz-Guzmán , María Coronado-Vaca

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with complex, real-world constraints, especially when action space feasibility is…

Machine Learning · Computer Science 2025-08-12 Jaike van Twiller , Yossiri Adulyasak , Erick Delage , Djordje Grbic , Rune Møller Jensen

Energy arbitrage is one of the most profitable sources of income for battery operators, generating revenues by buying and selling electricity at different prices. Forecasting these revenues is challenging due to the inherent uncertainty of…

Machine Learning · Computer Science 2024-10-29 Manuel Sage , Joshua Campbell , Yaoyao Fiona Zhao

Green hydrogen has multiple use cases and is produced from renewable energy, such as solar or wind energy. It can be stored in large quantities, decoupling renewable energy generation from its use, and is therefore considered essential for…

Optimization and Control · Mathematics 2026-01-01 Umur Hasturk , Albert H. Schrotenboer , Kees Jan Roodbergen , Evrim Ursavas

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

Robotics · Computer Science 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision…

Portfolio Management · Quantitative Finance 2026-05-19 Kamil Kashif , Robert Ślepaczuk

In recent years, many practitioners in quantitative finance have attempted to use Deep Reinforcement Learning (DRL) to build better quantitative trading (QT) strategies. Nevertheless, many existing studies fail to address several serious…

Portfolio Management · Quantitative Finance 2022-06-14 Zitao Song , Xuyang Jin , Chenliang Li

Dynamic hedging is the practice of periodically transacting financial instruments to offset the risk caused by an investment or a liability. Dynamic hedging optimization can be framed as a sequential decision problem; thus, Reinforcement…

Computational Finance · Quantitative Finance 2024-02-26 Andrei Neagu , Frédéric Godin , Clarence Simard , Leila Kosseim

The application of deep reinforcement learning algorithms to economic battery dispatch problems has significantly increased recently. However, optimizing battery dispatch over long horizons can be challenging due to delayed rewards. In our…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Manuel Sage , Martin Staniszewski , Yaoyao Fiona Zhao

Although Reinforcement Learning (RL) is effective for sequential decision-making problems under uncertainty, it still fails to thrive in real-world systems where risk or safety is a binding constraint. In this paper, we formulate the RL…

Machine Learning · Computer Science 2022-07-07 Yannis Flet-Berliac , Debabrota Basu

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample…

Dispatching strategies for gas turbines (GTs) are changing in modern electricity grids. A growing incorporation of intermittent renewable energy requires GTs to operate more but shorter cycles and more frequently on partial loads. Deep…

Machine Learning · Computer Science 2023-08-30 Manuel Sage , Martin Staniszewski , Yaoyao Fiona Zhao

The battery energy storage system (BESS) has immense potential for enhancing grid reliability and security through its participation in the electricity market. BESS often seeks various revenue streams by taking part in multiple markets to…

Systems and Control · Electrical Eng. & Systems 2024-03-01 Jinhao Li , Changlong Wang , Yanru Zhang , Hao Wang

During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision-making applications such as robotics, autonomous driving or video games. Off-policy algorithms tend to be more sample-efficient than…

Machine Learning · Computer Science 2021-12-06 Jesus Bujalance Martin , Raphael Chekroun , Fabien Moutarde

Portfolio optimization requires dynamic allocation of funds by balancing the risk and return tradeoff under dynamic market conditions. With the recent advancements in AI, Deep Reinforcement Learning (DRL) has gained prominence in providing…

Portfolio Management · Quantitative Finance 2025-05-08 Arishi Orra , Aryan Bhambu , Himanshu Choudhary , Manoj Thakur , Selvaraju Natarajan

Replacing poorly performing existing controllers with smarter solutions will decrease the energy intensity of the building sector. Recently, controllers based on Deep Reinforcement Learning (DRL) have been shown to be more effective than…

Machine Learning · Computer Science 2022-03-11 Loris Di Natale , Bratislav Svetozarevic , Philipp Heer , Colin N. Jones

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

Machine Learning · Computer Science 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia