English
Related papers

Related papers: Market Making via Reinforcement Learning

200 papers

Market manipulation is a strategy used by traders to alter the price of financial securities. One type of manipulation is based on the process of buying or selling assets by using several trading strategies, among them spoofing is a popular…

Trading and Market Microstructure · Quantitative Finance 2015-11-04 Enrique Martínez-Miranda , Peter McBurney , Matthew J. Howard

This paper sets forth a framework for deep reinforcement learning as applied to market making (DRLMM) for cryptocurrencies. Two advanced policy gradient-based algorithms were selected as agents to interact with an environment that…

Trading and Market Microstructure · Quantitative Finance 2019-11-21 Jonathan Sadighian

This study investigates the development of an optimal execution strategy through reinforcement learning, aiming to determine the most effective approach for traders to buy and sell inventory within a finite time horizon. Our proposed model…

Trading and Market Microstructure · Quantitative Finance 2025-11-04 Yadh Hafsi , Edoardo Vittori

Market makers provide liquidity to other market participants: they propose prices at which they stand ready to buy and sell a wide variety of assets. They face a complex optimization problem with both static and dynamic components. They…

Trading and Market Microstructure · Quantitative Finance 2017-05-09 Olivier Guéant

Market making is one of the most important aspects of algorithmic trading, and it has been studied quite extensively from a theoretical point of view. The practical implementation of so-called "optimal strategies" however suffers from the…

Trading and Market Microstructure · Quantitative Finance 2018-06-14 Xiaofei Lu , Frédéric Abergel

Multi-agent market simulators usually require careful calibration to emulate real markets, which includes the number and the type of agents. Poorly calibrated simulators can lead to misleading conclusions, potentially causing severe loss…

Trading and Market Microstructure · Quantitative Finance 2022-10-19 Andrea Coletta , Aymeric Moulin , Svitlana Vyetrenko , Tucker Balch

Machine learning (especially reinforcement learning) methods for trading are increasingly reliant on simulation for agent training and testing. Furthermore, simulation is important for validation of hand-coded trading strategies and for…

Trading and Market Microstructure · Quantitative Finance 2019-12-12 Svitlana Vyetrenko , David Byrd , Nick Petosa , Mahmoud Mahfouz , Danial Dervovic , Manuela Veloso , Tucker Hybinette Balch

We consider the issue of a market maker acting at the same time in the lit and dark pools of an exchange. The exchange wishes to establish a suitable make-take fees policy to attract transactions on its venues. We first solve the stochastic…

Mathematical Finance · Quantitative Finance 2019-12-04 Bastien Baldacci , Iuliia Manziuk , Thibaut Mastrolia , Mathieu Rosenbaum

We demonstrate an application of risk-sensitive reinforcement learning to optimizing execution in limit order book markets. We represent taking order execution decisions based on limit order book knowledge by a Markov Decision Process; and…

Trading and Market Microstructure · Quantitative Finance 2021-01-07 Svitlana Vyetrenko , Shaojie Xu

In this article, we develop a modular framework for the application of Reinforcement Learning to the problem of Optimal Trade Execution. The framework is designed with flexibility in mind, in order to ease the implementation of different…

Computational Engineering, Finance, and Science · Computer Science 2022-08-15 Fernando de Meer Pardo , Christoph Auth , Florin Dascalu

Market-based agents refer to reinforcement learning agents which determine their actions based on an internal market of sub-agents. We introduce a new type of market-based algorithm where the state itself is factored into several axes…

Artificial Intelligence · Computer Science 2025-03-11 Abhimanyu Pallavi Sudhir , Long Tran-Thanh

Market making (MM) has attracted significant attention in financial trading owing to its essential function in ensuring market liquidity. With strong capabilities in sequential decision-making, Reinforcement Learning (RL) technology has…

Machine Learning · Computer Science 2023-08-21 Hui Niu , Siyuan Li , Jiahao Zheng , Zhouchi Lin , Jian Li , Jian Guo , Bo An

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

We present a new model for prediction markets, in which we use risk measures to model agents and introduce a market maker to describe the trading process. This specific choice on modelling tools brings us mathematical convenience. The…

Computer Science and Game Theory · Computer Science 2014-03-05 Jinli Hu , Amos Storkey

Stock trading is one of the popular ways for financial management. However, the market and the environment of economy is unstable and usually not predictable. Furthermore, engaging in stock trading requires time and effort to analyze,…

Machine Learning · Computer Science 2025-05-20 Yunfei Luo , Zhangqi Duan

The development of reinforced learning methods has extended application to many areas including algorithmic trading. In this paper trading on the stock exchange is interpreted into a game with a Markov property consisting of states,…

Trading and Market Microstructure · Quantitative Finance 2020-02-28 Evgeny Ponomarev , Ivan Oseledets , Andrzej Cichocki

We consider the learning dynamics of a single reinforcement learning optimal execution trading agent when it interacts with an event driven agent-based financial market model. Trading takes place asynchronously through a matching engine in…

Trading and Market Microstructure · Quantitative Finance 2023-11-23 Matthew Dicks , Andrew Paskaramoorthy , Tim Gebbie

We study a game between liquidity provider and liquidity taker agents interacting in an over-the-counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions…

Multiagent Systems · Computer Science 2023-08-02 Nelson Vadori , Leo Ardon , Sumitra Ganesh , Thomas Spooner , Selim Amrouni , Jared Vann , Mengda Xu , Zeyu Zheng , Tucker Balch , Manuela Veloso

We study a Markov matching market involving a planner and a set of strategic agents on the two sides of the market. At each step, the agents are presented with a dynamical context, where the contexts determine the utilities. The planner…

Machine Learning · Computer Science 2022-03-09 Yifei Min , Tianhao Wang , Ruitu Xu , Zhaoran Wang , Michael I. Jordan , Zhuoran Yang

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri