English
Related papers

Related papers: Realistic Market Impact Modeling for Reinforcement…

200 papers

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are hard to leverage in real-world systems due…

Machine Learning · Computer Science 2021-03-05 Gabriel Dulac-Arnold , Nir Levine , Daniel J. Mankowitz , Jerry Li , Cosmin Paduraru , Sven Gowal , Todd Hester

Inspired by the developments in deep generative models, we propose a model-based RL approach, coined Reinforced Deep Markov Model (RDMM), designed to integrate desirable properties of a reinforcement learning algorithm acting as an…

Trading and Market Microstructure · Quantitative Finance 2020-11-10 Tadeu A. Ferreira

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

Machine Learning · Computer Science 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

Optimal execution is a sequential decision-making problem for cost-saving in algorithmic trading. Studies have found that reinforcement learning (RL) can help decide the order-splitting sizes. However, a problem remains unsolved: how to…

Trading and Market Microstructure · Quantitative Finance 2022-07-25 Feiyang Pan , Tongzhe Zhang , Ling Luo , Jia He , Shuoling Liu

We demonstrate an application of risk-sensitive reinforcement learning to optimizing execution in limit order book markets. We represent taking order execution decisions based on limit order book knowledge by a Markov Decision Process; and…

Trading and Market Microstructure · Quantitative Finance 2021-01-07 Svitlana Vyetrenko , Shaojie Xu

Nowadays, a significant share of the Business-to-Consumer sector is based on online platforms like Amazon and Alibaba and uses Artificial Intelligence for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly…

General Economics · Economics 2024-06-05 Shidi Deng , Maximilian Schiffer , Martin Bichler

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

We introduce GasRL, a simulator that couples a calibrated representation of the natural gas market with a model of storage-operator policies trained with deep reinforcement learning (RL). We use it to analyse how optimal stockpile…

Machine Learning · Computer Science 2025-11-05 Tiziano Balaconi , Aldo Glielmo , Marco Taboga

We investigate the mechanisms by which medium-frequency trading agents are adversely selected by opportunistic high-frequency traders. We use reinforcement learning (RL) within a Hawkes Limit Order Book (LOB) model in order to replicate the…

Trading and Market Microstructure · Quantitative Finance 2025-11-03 Ali Raza Jafree , Konark Jain , Nick Firoozye

Model Predictive Control (MPC) faces computational demands and performance degradation from model inaccuracies. We propose two architectures combining Neural Network-approximated MPC (NNMPC) with Reinforcement Learning (RL). The first, Warm…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Xiaolong Jia , Nikhil Bajaj

The increasing penetration of renewable generations, along with the deregulation and marketization of power industry, promotes the transformation of power market operation paradigms. The optimal bidding strategy and dispatching methodology…

Machine Learning · Computer Science 2023-05-15 Ziqing Zhu , Ze Hu , Ka Wing Chan , Siqi Bu , Bin Zhou , Shiwei Xia

This paper presents an empirical study of reset-free reinforcement learning (RL) for real-world agile driving, in which a physical 1/10-scale vehicle learns continuously on a slippery indoor track without manual resets. High-speed driving…

Robotics · Computer Science 2026-04-10 Kohei Honda , Hirotaka Hosogaya

Traditional economic models often rely on fixed assumptions about market dynamics, limiting their ability to capture the complexities and stochastic nature of real-world scenarios. However, reality is more complex and includes noise, making…

Deep reinforcement learning (DRL) has shown huge potentials in building financial market simulators recently. However, due to the highly complex and dynamic nature of real-world markets, raw historical financial data often involve large…

Trading and Market Microstructure · Quantitative Finance 2022-03-03 Xiao-Yang Liu , Jingyang Rui , Jiechao Gao , Liuqing Yang , Hongyang Yang , Zhaoran Wang , Christina Dan Wang , Jian Guo

Reinforcement learning can interact with the environment and is suitable for applications in decision control systems. Therefore, we used the reinforcement learning method to establish a foreign exchange transaction, avoiding the…

Machine Learning · Computer Science 2020-06-05 Yun-Cheng Tsai , Chun-Chieh Wang

Reinforcement Learning (RL) has shown significant promise in automated portfolio management; however, effectively balancing risk and return remains a central challenge, as many models fail to adapt to dynamically changing market conditions.…

Machine Learning · Computer Science 2025-12-04 Jiayi Chen , Jing Li , Guiling Wang

Stock trading strategy plays a crucial role in investment companies. However, it is challenging to obtain optimal strategy in the complex and dynamic stock market. We explore the potential of deep reinforcement learning to optimize stock…

Machine Learning · Computer Science 2022-08-02 Xiao-Yang Liu , Zhuoran Xiong , Shan Zhong , Hongyang Yang , Anwar Walid

Through many recent successes in simulation, model-free reinforcement learning has emerged as a promising approach to solving continuous control robotic tasks. The research community is now able to reproduce, analyze and build quickly on…

Machine Learning · Computer Science 2018-09-21 A. Rupam Mahmood , Dmytro Korenkevych , Gautham Vasan , William Ma , James Bergstra

With the rapid development of artificial intelligence, data-driven methods effectively overcome limitations in traditional portfolio optimization. Conventional models primarily employ long-only mechanisms, excluding highly correlated assets…

Computational Finance · Quantitative Finance 2025-03-18 Gang Huang , Xiaohua Zhou , Qingyang Song