English
Related papers

Related papers: Multi-Agent Deep Reinforcement Learning for Liquid…

200 papers

Deep or reinforcement learning (RL) approaches have been adapted as reactive agents to quickly learn and respond with new investment strategies for portfolio management under the highly turbulent financial market environments in recent…

Portfolio Management · Quantitative Finance 2024-09-11 Zhenglong Li , Vincent Tam , Kwan L. Yeung

We present a deep learning solution to address the challenges of simulating realistic synthetic first-price sealed-bid auction data. The complexities encountered in this type of auction data include high-cardinality discrete feature spaces…

General Economics · Economics 2024-11-13 Igor Sadoune , Andrea Lodi , Marcelin Joanis

In many reinforcement learning applications, the underlying environment reward and transition functions are explicitly known differentiable functions. This enables us to use recent research which applies machine learning tools to stochastic…

Portfolio Management · Quantitative Finance 2022-04-08 Thibault Jaisson

This paper shows how reinforcement learning can be used to derive optimal hedging strategies for derivatives when there are transaction costs. The paper illustrates the approach by showing the difference between using delta hedging and…

Computational Finance · Quantitative Finance 2021-03-31 Jay Cao , Jacky Chen , John Hull , Zissis Poulos

Online auctions are one of the most fundamental facets of the modern economy and power an industry generating hundreds of billions of dollars a year in revenue. Auction theory has historically focused on the question of designing the best…

Computer Science and Game Theory · Computer Science 2021-09-23 Thomas Nedelec , Clément Calauzènes , Noureddine El Karoui , Vianney Perchet

Deep Reinforcement Learning (DRL) algorithms can scale to previously intractable problems. The automation of profit generation in the stock market is possible using DRL, by combining the financial assets price "prediction" step and the…

Trading and Market Microstructure · Quantitative Finance 2022-09-20 Taylan Kabbani , Ekrem Duman

In this paper, we simulate the execution of a large stock order with real data and general power law in the Almgren and Chriss model. The example that we consider is the liquidation of a large position executed over the course of a single…

Computational Finance · Quantitative Finance 2023-06-16 A. Papanicolaou , H. Fu , P. Krishnamurthy , B. Healy , F. Khorrami

Optimal trade execution is an important problem faced by essentially all traders. Much research into optimal execution uses stringent model assumptions and applies continuous time stochastic control to solve them. Here, we instead take a…

Trading and Market Microstructure · Quantitative Finance 2020-06-09 Brian Ning , Franco Ho Ting Lin , Sebastian Jaimungal

We adopt Deep Reinforcement Learning algorithms to design trading strategies for continuous futures contracts. Both discrete and continuous action spaces are considered and volatility scaling is incorporated to create reward functions which…

Computational Finance · Quantitative Finance 2019-11-25 Zihao Zhang , Stefan Zohren , Stephen Roberts

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

We propose a framework to study the optimal liquidation strategy in a limit order book for large-tick stocks, with spread equal to one tick. All order book events (market orders, limit orders and cancellations) occur according to…

Trading and Market Microstructure · Quantitative Finance 2017-11-16 Antoine Jacquier , Hao Liu

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent…

Multiagent Systems · Computer Science 2019-05-30 Ercüment İlhan , Jeremy Gow , Diego Perez-Liebana

We consider a class of optimal liquidation problems where the agent's transactions create transient price impact driven by a Volterra-type propagator along with temporary price impact. We formulate these problems as maximization of a…

Trading and Market Microstructure · Quantitative Finance 2025-09-17 Eduardo Abi Jaber , Eyal Neuman

This paper presents a multi-agent reinforcement learning algorithm to represent strategic bidding behavior in freight transport markets. Using this algorithm, we investigate whether feasible market equilibriums arise without any central…

Machine Learning · Computer Science 2021-02-19 Wouter van Heeswijk

In a day-ahead market, energy buyers and sellers submit their bids for a particular future time, including the amount of energy they wish to buy or sell and the price they are prepared to pay or receive. However, the dynamic for forming the…

Optimization and Control · Mathematics 2024-11-26 Luca Di Persio , Matteo Garbelli , Luca M. Giordano

We employ deep reinforcement learning (RL) to train an agent to successfully translate a high-frequency trading signal into a trading strategy that places individual limit orders. Based on the ABIDES limit order book simulator, we build a…

Trading and Market Microstructure · Quantitative Finance 2023-09-27 Peer Nagy , Jan-Peter Calliess , Stefan Zohren

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

Trailing stop is a popular stop-loss trading strategy by which the investor will sell the asset once its price experiences a pre-specified percentage drawdown. In this paper, we study the problem of timing buy and then sell an asset subject…

Mathematical Finance · Quantitative Finance 2019-03-26 Tim Leung , Hongzhong Zhang

Deep Reinforcement Learning (DRL) has been extensively used to address portfolio optimization problems. The DRL agents acquire knowledge and make decisions through unsupervised interactions with their environment without requiring explicit…

Machine Learning · Computer Science 2025-01-14 Ruoyu Sun , Yue Xi , Angelos Stefanidis , Zhengyong Jiang , Jionglong Su

This paper considers the problem of optimal liquidation of a position in a risky security in a financial market, where price evolution are risky and trades have an impact on price as well as uncertainty in the filling orders. The problem is…

Mathematical Finance · Quantitative Finance 2019-07-16 Xue Cheng , Marina Di Giacinto , Tai-Ho Wang