English
Related papers

Related papers: Optimal Market Making by Reinforcement Learning

200 papers

We consider the dynamics and the interactions of multiple reinforcement learning optimal execution trading agents interacting with a reactive Agent-Based Model (ABM) of a financial market in event time. The model represents a market ecology…

Trading and Market Microstructure · Quantitative Finance 2024-08-15 Matthew Dicks , Andrew Paskaramoorthy , Tim Gebbie

In this paper, we derive a temporal arbitrage policy for storage via reinforcement learning. Real-time price arbitrage is an important source of revenue for storage units, but designing good strategies have proven to be difficult because of…

Systems and Control · Computer Science 2020-10-27 Hao Wang , Baosen Zhang

The paper explores the application of a continuous action space soft actor-critic (SAC) reinforcement learning model to the area of automated market-making. The reinforcement learning agent receives a simulated flow of client trades, thus…

Pricing of Securities · Quantitative Finance 2020-08-28 Alexey Bakshaev

We present a novel definition of the reinforcement learning state, actions and reward function that allows a deep Q-network (DQN) to learn to control an optimization hyperparameter. Using Q-learning with experience replay, we train two DQNs…

Optimization and Control · Mathematics 2016-06-21 Samantha Hansen

The problem of market clearing is to set a price for an item such that quantity demanded equals quantity supplied. In this work, we cast the problem of predicting clearing prices into a learning framework and use the resulting models to…

Machine Learning · Computer Science 2019-06-25 Weiran Shen , Sébastien Lahaie , Renato Paes Leme

Game theory has been developed by scientists as a theory of strategic interaction among players who are supposed to be perfectly rational. These strategic interactions might have been presented in an auction, a business negotiation, a chess…

Computer Science and Game Theory · Computer Science 2020-04-07 Medet Kanmaz , Elif Surer

Our premise is that autonomous vehicles must optimize communications and motion planning jointly. Specifically, a vehicle must adapt its motion plan staying cognizant of communications rate related constraints and adapt the use of…

Systems and Control · Computer Science 2018-07-31 Mayank K. Pal , Rupali Bhati , Anil Sharma , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Artificial Intelligence (AI) and Machine Learning (ML) are transforming the domain of Quantitative Trading (QT) through the deployment of advanced algorithms capable of sifting through extensive financial datasets to pinpoint lucrative…

Trading and Market Microstructure · Quantitative Finance 2023-12-27 Maochun Xu , Zixun Lan , Zheng Tao , Jiawei Du , Zongao Ye

The increasing deployment of AI is shaping the future landscape of the internet, which is set to become an integrated ecosystem of AI agents. Orchestrating the interaction among AI agents necessitates decentralized, self-sustaining…

Computer Science and Game Theory · Computer Science 2024-10-08 Dima Ivanov , Paul Dütting , Inbal Talgam-Cohen , Tonghan Wang , David C. Parkes

Market making (MM) has attracted significant attention in financial trading owing to its essential function in ensuring market liquidity. With strong capabilities in sequential decision-making, Reinforcement Learning (RL) technology has…

Machine Learning · Computer Science 2023-08-21 Hui Niu , Siyuan Li , Jiahao Zheng , Zhouchi Lin , Jian Li , Jian Guo , Bo An

Opponent modeling is necessary in multi-agent settings where secondary agents with competing goals also adapt their strategies, yet it remains challenging because strategies interact with each other and change. Most previous work focuses on…

Machine Learning · Computer Science 2016-09-20 He He , Jordan Boyd-Graber , Kevin Kwok , Hal Daumé

The construction of replication strategies for contingent claims in the presence of risk and market friction is a key problem of financial engineering. In real markets, continuous replication, such as in the model of Black, Scholes and…

Machine Learning · Computer Science 2023-07-07 Loris Cannelli , Giuseppe Nuti , Marzio Sala , Oleg Szehr

Liquidation is the process of selling a large number of shares of one stock sequentially within a given time frame, taking into consideration the costs arising from market impact and a trader's risk aversion. The main challenge in…

Trading and Market Microstructure · Quantitative Finance 2019-06-27 Wenhang Bao , Xiao-yang Liu

Efficient maintenance has always been essential for the successful application of engineering systems. However, the challenges to be overcome in the implementation of Industry 4.0 necessitate new paradigms of maintenance optimization.…

Machine Learning · Computer Science 2025-05-28 Alberto Pliego Marugán , Jesús M. Pinar-Pérez , Fausto Pedro García Márquez

In the last decade quantum machine learning has provided fascinating and fundamental improvements to supervised, unsupervised and reinforcement learning. In reinforcement learning, a so-called agent is challenged to solve a task given by…

Quantum Physics · Physics 2022-04-13 Arne Hamann , Sabine Wölk

Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable,…

Machine Learning · Computer Science 2021-03-22 Thomas D. Barrett , William R. Clements , Jakob N. Foerster , A. I. Lvovsky

In response to the increasing complexity of electricity markets due to low-carbon requirements and the integration of sustainable energy sources, this paper proposes a dynamic quantum computing enhanced bilevel optimization model for…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Shuyang Zhu , Ziqing Zhu

Reinforcement learning (RL) algorithms typically deal with maximizing the expected cumulative return (discounted or undiscounted, finite or infinite horizon). However, several crucial applications in the real world, such as drug discovery,…

The role of a market maker is to simultaneously offer to buy and sell quantities of goods, often a financial asset such as a share, at specified prices. An automated market maker (AMM) is a mechanism that offers to trade according to some…

Computer Science and Game Theory · Computer Science 2024-02-15 Michael J. Curry , Zhou Fan , David C. Parkes

In financial markets, agents often mutually influence each other's investment strategies and adjust their strategies to align with others. However, there is limited quantitative study of agents' investment strategies in such scenarios. In…

Systems and Control · Electrical Eng. & Systems 2025-01-27 Huisheng Wang , H. Vicky Zhao