English
Related papers

Related papers: Market Making with Deep Reinforcement Learning fro…

200 papers

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

Market-based agents refer to reinforcement learning agents which determine their actions based on an internal market of sub-agents. We introduce a new type of market-based algorithm where the state itself is factored into several axes…

Artificial Intelligence · Computer Science 2025-03-11 Abhimanyu Pallavi Sudhir , Long Tran-Thanh

We report successful results from using deep learning neural networks (DLNNs) to learn, purely by observation, the behavior of profitable traders in an electronic market closely modelled on the limit-order-book (LOB) market mechanisms that…

Computational Engineering, Finance, and Science · Computer Science 2018-11-08 Arthur le Calvez , Dave Cliff

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

We propose a microstructural modeling framework for studying optimal market making policies in a FIFO (first in first out) limit order book (LOB). In this context, the limit orders, market orders, and cancel orders arrivals in the LOB are…

Trading and Market Microstructure · Quantitative Finance 2020-02-21 Frédéric Abergel , Côme Huré , Huyên Pham

In this paper we consider classes of models that have been recently developed for quantitative finance that involve modelling a highly complex multivariate, multi-attribute stochastic process known as the Limit Order Book (LOB). The LOB is…

Computational Finance · Quantitative Finance 2015-04-23 Gareth W. Peters , Efstathios Panayi , Francois Septier

There has been a recent surge in interest in the application of artificial intelligence to automated trading. Reinforcement learning has been applied to single- and multi-instrument use cases, such as market making or portfolio management.…

Trading and Market Microstructure · Quantitative Finance 2020-04-16 Jonathan Sadighian

Order execution is a fundamental task in quantitative finance, aiming at finishing acquisition or liquidation for a number of trading orders of the specific assets. Recent advance in model-free reinforcement learning (RL) provides a…

Artificial Intelligence · Computer Science 2023-07-07 Yuchen Fang , Zhenggang Tang , Kan Ren , Weiqing Liu , Li Zhao , Jiang Bian , Dongsheng Li , Weinan Zhang , Yong Yu , Tie-Yan Liu

Modeling the dynamics of financial Limit Order Books (LOB) at the message level is challenging due to irregular event timing, rapid regime shifts, and the reactions of high-frequency traders to visible order flow. Previous LOB models…

Artificial Intelligence · Computer Science 2025-11-18 Eljas Linna , Kestutis Baltakys , Alexandros Iosifidis , Juho Kanniainen

Optimal execution is a sequential decision-making problem for cost-saving in algorithmic trading. Studies have found that reinforcement learning (RL) can help decide the order-splitting sizes. However, a problem remains unsolved: how to…

Trading and Market Microstructure · Quantitative Finance 2022-07-25 Feiyang Pan , Tongzhe Zhang , Ling Luo , Jia He , Shuoling Liu

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language…

Machine Learning · Computer Science 2023-10-31 Dhawal Gupta , Yinlam Chow , Aza Tulepbergenov , Mohammad Ghavamzadeh , Craig Boutilier

In this paper, we propose an event-driven Limit Order Book (LOB) model that captures twelve of the most observed LOB events in exchange-based financial markets. To model these events, we propose using the state-of-the-art Neural Hawkes…

Computational Finance · Quantitative Finance 2025-09-19 Luca Lalor , Anatoliy Swishchuk

The modeling of the limit order book is directly related to the assumptions on the behavior of real market participants. This paper is twofold. We first present empirical findings that lay the ground for two improvements to these models.The…

Trading and Market Microstructure · Quantitative Finance 2020-09-08 Mouhamad Drame

The rapid changes in the finance industry due to the increasing amount of data have revolutionized the techniques on data processing and data analysis and brought new theoretical and computational challenges. In contrast to classical…

Mathematical Finance · Quantitative Finance 2023-03-01 Ben Hambly , Renyuan Xu , Huining Yang

Unlike traditional reinforcement learning (RL), market-based RL is in principle applicable to worlds described by partially observable Markov Decision Processes (POMDPs), where an agent needs to learn short-term memories of relevant…

Artificial Intelligence · Computer Science 2007-05-23 Ivo Kwee , Marcus Hutter , Juergen Schmidhuber

The latency of the exchanges in Market Making (MM) is inevitable due to hardware limitations, system processing times, delays in receiving data from exchanges, the time required for order transmission to reach the market, etc. Existing…

Machine Learning · Computer Science 2025-05-20 Junzhe Jiang , Chang Yang , Xinrun Wang , Zhiming Li , Xiao Huang , Bo Li

In this work, we present a continuous-time large-population game for modeling market microstructure betweentwo consecutive trades. The proposed modeling framework is inspired by our previous work [23]. In this framework, the Limit Order…

Trading and Market Microstructure · Quantitative Finance 2017-06-21 Roman Gayduk , Sergey Nadtochiy

The deployment of autonomous AI agents in derivatives markets has widened a practical gap between static model calibration and realized hedging outcomes. We introduce two reinforcement learning frameworks, a novel Replication Learning of…

Artificial Intelligence · Computer Science 2026-03-10 Minxuan Hu , Ziheng Chen , Jiayu Yi , Wenxi Sun