English
Related papers

Related papers: Optimal Market Making by Reinforcement Learning

200 papers

Reinforcement learning for the optimization of quantum circuits uses an agent whose goal is to maximize the value of a reward function that decides what is correct and what is wrong during the exploration of the search space. It is an open…

Quantum Physics · Physics 2023-11-22 Ioana Moflic , Alexandru Paler

Following the recent literature on make take fees policies, we consider an exchange wishing to set a suitable contract with several market makers in order to improve trading quality on its platform. To do so, we use a principal-agent…

Trading and Market Microstructure · Quantitative Finance 2021-03-09 Bastien Baldacci , Dylan Possamaï , Mathieu Rosenbaum

Market makers provide liquidity to other market participants: they propose prices at which they stand ready to buy and sell a wide variety of assets. They face a complex optimization problem with both static and dynamic components. They…

Trading and Market Microstructure · Quantitative Finance 2017-05-09 Olivier Guéant

This article explores the optimisation of trading strategies in Constant Function Market Makers (CFMMs) and centralised exchanges. We develop a model that accounts for the interaction between these two markets, estimating the conditional…

Trading and Market Microstructure · Quantitative Finance 2026-05-06 Sebastian Jaimungal , Yuri F. Saporito , Max O. Souza , Yuri Thamsten

Reinforcement learning has traditionally been studied with exponential discounting or the average reward setup, mainly due to their mathematical tractability. However, such frameworks fall short of accurately capturing human behavior, which…

Machine Learning · Computer Science 2024-09-18 S. R. Eshwar , Mayank Motwani , Nibedita Roy , Gugan Thoppe

The large variety of digital payment choices available to consumers today has been a key driver of e-commerce transactions in the past decade. Unfortunately, this has also given rise to cybercriminals and fraudsters who are constantly…

Machine Learning · Computer Science 2021-12-09 Siddharth Vimal , Kanishka Kayathwal , Hardik Wadhwa , Gaurav Dhama

In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices. However, during deployment, these agents trade in live markets where their own transactions…

Machine Learning · Computer Science 2026-01-27 Shaocong Ma , Heng Huang

Optimal trade execution is an important problem faced by essentially all traders. Much research into optimal execution uses stringent model assumptions and applies continuous time stochastic control to solve them. Here, we instead take a…

Trading and Market Microstructure · Quantitative Finance 2020-06-09 Brian Ning , Franco Ho Ting Lin , Sebastian Jaimungal

One obstacle to applying reinforcement learning algorithms to real-world problems is the lack of suitable reward functions. Designing such reward functions is difficult in part because the user only has an implicit understanding of the task…

Machine Learning · Computer Science 2018-11-20 Jan Leike , David Krueger , Tom Everitt , Miljan Martic , Vishal Maini , Shane Legg

Power suppliers can exercise market power to gain higher profit. However, this becomes difficult when external information is extremely rare. To get a promising performance in an extremely incomplete information market environment, a novel…

Systems and Control · Electrical Eng. & Systems 2020-08-05 Qiangang Jia , Zhaoyu Hu , Yiyan Li , Zheng Yan , Sijie Chen

Reformulating the history matching problem from a least-square mathematical optimization problem into a Markov Decision Process introduces a method in which reinforcement learning can be utilized to solve the problem. This method provides a…

Machine Learning · Computer Science 2022-12-26 Omar S. Alolayan , Abdullah O. Alomar , John R. Williams

Energy market rules should incentivize market participants to behave in a market and grid conform way. However, they can also provide incentives for undesired and unexpected strategies if the market design is flawed. Multi-agent…

Systems and Control · Electrical Eng. & Systems 2023-11-02 Thomas Wolgast , Astrid Nieße

We focus on the problem of market making in high-frequency trading. Market making is a critical function in financial markets that involves providing liquidity by buying and selling assets. However, the increasing complexity of financial…

Trading and Market Microstructure · Quantitative Finance 2023-07-03 Jiafa He , Cong Zheng , Can Yang

The agency problem emerges in today's large scale machine learning tasks, where the learners are unable to direct content creation or enforce data collection. In this work, we propose a theoretical framework for aligning economic interests…

Machine Learning · Computer Science 2024-07-03 Jibang Wu , Siyu Chen , Mengdi Wang , Huazheng Wang , Haifeng Xu

Stock trading is one of the popular ways for financial management. However, the market and the environment of economy is unstable and usually not predictable. Furthermore, engaging in stock trading requires time and effort to analyze,…

Machine Learning · Computer Science 2025-05-20 Yunfei Luo , Zhangqi Duan

This paper seeks to establish a framework for directing a society of simple, specialized, self-interested agents to solve what traditionally are posed as monolithic single-agent sequential decision problems. What makes it challenging to use…

Machine Learning · Computer Science 2020-08-17 Michael Chang , Sidhant Kaushik , S. Matthew Weinberg , Thomas L. Griffiths , Sergey Levine

Quantum Machine Learning (QML) is a young but rapidly growing field where quantum information meets machine learning. Here, we will introduce a new QML model generalizing the classical concept of Reinforcement Learning to the quantum…

Quantum Physics · Physics 2024-07-08 Nicola Dalla Pozza , Lorenzo Buffoni , Stefano Martina , Filippo Caruso

Optimal Order Execution is a well-established problem in finance that pertains to the flawless execution of a trade (buy or sell) for a given volume within a specified time frame. This problem revolves around optimizing returns while…

Computational Finance · Quantitative Finance 2026-01-13 Khabbab Zakaria , Jayapaulraj Jerinsh , Andreas Maier , Patrick Krauss , Stefano Pasquali , Dhagash Mehta

We develop a general method for incentive-based programming of hybrid quantum-classical computing systems using reinforcement learning, and apply this to solve combinatorial optimization problems on both simulated and real gate-based…

Quantum Physics · Physics 2019-08-23 Keri A. McKiernan , Erik Davis , M. Sohaib Alam , Chad Rigetti

A model among many may only be best under certain states of the world. Switching from a model to another can also be costly. Finding a procedure to dynamically choose a model in these circumstances requires to solve a complex estimation…

Machine Learning · Computer Science 2023-10-10 Francesco Cordoni , Alessio Sancetta