English
Related papers

Related papers: Optimal Execution with Reinforcement Learning

200 papers

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading…

Artificial Intelligence · Computer Science 2019-10-10 Haoran Wei , Yuanbo Wang , Lidia Mangu , Keith Decker

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

We study the optimal execution of market and limit orders with permanent and temporary price impacts as well as uncertainty in the filling of limit orders. Our continuous-time model incorporates a trade speed limiter and a trader director…

Mathematical Finance · Quantitative Finance 2017-04-13 Brian Bulthuis , Julio Concha , Tim Leung , Brian Ward

A major challenge in the field of education is providing review schedules that present learned items at appropriate intervals to each student so that memory is retained over time. In recent years, attempts have been made to formulate item…

Artificial Intelligence · Computer Science 2021-08-03 Yoshiki Kubotani , Yoshihiro Fukuhara , Shigeo Morishima

Reinforcement learning has been explored for many problems, from video games with deterministic environments to portfolio and operations management in which scenarios are stochastic; however, there have been few attempts to test these…

General Finance · Quantitative Finance 2024-02-19 Sherly Alfonso-Sánchez , Jesús Solano , Alejandro Correa-Bahnsen , Kristina P. Sendova , Cristián Bravo

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Can deep reinforcement learning algorithms be exploited as solvers for optimal trading strategies? The aim of this work is to test reinforcement learning algorithms on conceptually simple, but mathematically non-trivial, trading…

Mathematical Finance · Quantitative Finance 2020-04-10 Ayman Chaouki , Stephen Hardiman , Christian Schmidt , Emmanuel Sérié , Joachim de Lataillade

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Stock trading is one of the popular ways for financial management. However, the market and the environment of economy is unstable and usually not predictable. Furthermore, engaging in stock trading requires time and effort to analyze,…

Machine Learning · Computer Science 2025-05-20 Yunfei Luo , Zhangqi Duan

In this thesis, we research learning algorithms for optimal decision making in two different contexts, Reinforcement Learning in Part I and Auction Design in Part II. Reinforcement learning (RL) is an area of machine learning that is…

Machine Learning · Computer Science 2022-10-07 Jad Rahme

We apply Reinforcement Learning algorithms to solve the classic quantitative finance Market Making problem, in which an agent provides liquidity to the market by placing buy and sell orders while maximizing a utility function. The optimal…

Machine Learning · Computer Science 2021-04-12 Matias Selser , Javier Kreiner , Manuel Maurette

Optimal execution is an important problem faced by any trader. Most solutions are based on the assumption of constant market impact, while liquidity is known to be dynamic. Moreover, models with time-varying liquidity typically assume that…

Trading and Market Microstructure · Quantitative Finance 2024-02-21 Andrea Macrì , Fabrizio Lillo

Optimal decision making with limited or no information in stochastic environments where multiple agents interact is a challenging topic in the realm of artificial intelligence. Reinforcement learning (RL) is a popular approach for arriving…

Machine Learning · Computer Science 2019-01-08 Roi Ceren

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

Machine Learning · Computer Science 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

We demonstrate an application of risk-sensitive reinforcement learning to optimizing execution in limit order book markets. We represent taking order execution decisions based on limit order book knowledge by a Markov Decision Process; and…

Trading and Market Microstructure · Quantitative Finance 2021-01-07 Svitlana Vyetrenko , Shaojie Xu

We analyze an optimal trade execution problem in a financial market with stochastic liquidity. To this end we set up a limit order book model in which both order book depth and resilience evolve randomly in time. Trading is allowed in both…

Trading and Market Microstructure · Quantitative Finance 2021-04-16 Julia Ackermann , Thomas Kruse , Mikhail Urusov

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama