English
Related papers

Related papers: Deep Reinforcement Learning for Market Making Unde…

200 papers

Market makers play an important role in providing liquidity to markets by continuously quoting prices at which they are willing to buy and sell, and managing inventory risk. In this paper, we build a multi-agent simulation of a dealer…

Trading and Market Microstructure · Quantitative Finance 2019-11-15 Sumitra Ganesh , Nelson Vadori , Mengda Xu , Hua Zheng , Prashant Reddy , Manuela Veloso

The large integration of variable energy resources is expected to shift a large part of the energy exchanges closer to real-time, where more accurate forecasts are available. In this context, the short-term electricity markets and in…

Trading and Market Microstructure · Quantitative Finance 2020-04-14 Ioannis Boukas , Damien Ernst , Thibaut Théate , Adrien Bolland , Alexandre Huynen , Martin Buchwald , Christelle Wynants , Bertrand Cornélusse

We survey in this article the connections between Machine Learning and Control Theory. Control Theory provide useful concepts and tools for Machine Learning. Conversely Machine Learning can be used to solve large control problems. In the…

Machine Learning · Computer Science 2020-06-11 Alain Bensoussan , Yiqun Li , Dinh Phan Cao Nguyen , Minh-Binh Tran , Sheung Chi Phillip Yam , Xiang Zhou

This paper investigates methods for estimating the optimal stochastic control policy for a Markov Decision Process with unknown transition dynamics and an unknown reward function. This form of model-free reinforcement learning comprises…

Machine Learning · Computer Science 2019-12-06 Brandon Trabucco , Albert Qu , Simon Li , Ganeshkumar Ashokavardhanan

Questions remain on the robustness of data-driven learning methods when crossing the gap from simulation to reality. We utilize weight anchoring, a method known from continual learning, to cultivate and fixate desired behavior in Neural…

Machine Learning · Computer Science 2023-04-21 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

The capability to autonomously track a non-cooperative target is a key technological requirement for micro aerial vehicles. In this paper, we propose an output feedback control scheme based on deep reinforcement learning for controlling a…

Robotics · Computer Science 2024-02-08 Alberto Dionigi , Mirko Leomanni , Alessandro Saviolo , Giuseppe Loianno , Gabriele Costante

The problem of how to take the right actions to make profits in sequential process continues to be difficult due to the quick dynamics and a significant amount of uncertainty in many application scenarios. In such complicated environments,…

Machine Learning · Computer Science 2023-10-03 Zhendong Shi , Xiaoli Wei , Ercan E. Kuruoglu

We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading…

Artificial Intelligence · Computer Science 2019-10-10 Haoran Wei , Yuanbo Wang , Lidia Mangu , Keith Decker

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

We investigate Monte Carlo based algorithms for solving stochastic control problems with probabilistic constraints. Our motivation comes from microgrid management, where the controller tries to optimally dispatch a diesel generator while…

Optimization and Control · Mathematics 2024-02-06 Alessandro Balata , Michael Ludkovski , Aditya Maheshwari , Jan Palczewski

Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward. Deep reinforcement learning provides good opportunity to model the complexity…

Statistical Finance · Quantitative Finance 2021-08-05 Zhaolu Dong , Shan Huang , Simiao Ma , Yining Qian

Estimation of physical quantities is at the core of most scientific research and the use of quantum devices promises to enhance its performances. In real scenarios, it is fundamental to consider that the resources are limited and Bayesian…

Reinforcement Learning (RL) controllers have generated excitement within the control community. The primary advantage of RL controllers relative to existing methods is their ability to optimize uncertain systems independently of explicit…

Machine Learning · Computer Science 2021-12-07 Max Mowbray , Panagiotis Petsagkourakis , Ehecatl Antonio del Río Chanona , Dongda Zhang

Hawkes Process has been used to model Limit Order Book (LOB) dynamics in several ways in the literature however the focus has been limited to capturing the inter-event times while the order size is usually assumed to be constant. We propose…

Trading and Market Microstructure · Quantitative Finance 2024-08-15 Konark Jain , Nick Firoozye , Jonathan Kochems , Philip Treleaven

We consider an optimal trading problem under a market impact model with endogenous market resistance generated by a sophisticated trader who (partially) detects metaorders and trades against them to exploit price overreactions induced by…

Trading and Market Microstructure · Quantitative Finance 2026-02-05 Nathan De Carvalho , Youssef Ouazzani Chahdi , Grégoire Szymanski

Machine learning and formal methods have complimentary benefits and drawbacks. In this work, we address the controller-design problem with a combination of techniques from both fields. The use of black-box neural networks in deep…

Logic in Computer Science · Computer Science 2020-08-26 Parand Alizadeh Alamdari , Guy Avni , Thomas A. Henzinger , Anna Lukina

Common approaches to control a data-center cooling system rely on approximated system/environment models that are built upon the knowledge of mechanical cooling and electrical and thermal management. These models are difficult to design and…

Systems and Control · Computer Science 2018-08-31 Takao Moriyama , Giovanni De Magistris , Michiaki Tatsubori , Tu-Hoa Pham , Asim Munawar , Ryuki Tachibana

We propose a microstructural modeling framework for studying optimal market making policies in a FIFO (first in first out) limit order book (LOB). In this context, the limit orders, market orders, and cancel orders arrivals in the LOB are…

Trading and Market Microstructure · Quantitative Finance 2020-02-21 Frédéric Abergel , Côme Huré , Huyên Pham

To create efficient-high performing processes, one must find an optimal design with its corresponding controller that ensures optimal operation in the presence of uncertainty. When comparing different process designs, for the comparison to…

Systems and Control · Electrical Eng. & Systems 2021-08-12 Steven Sachio , Max Mowbray , Maria Papathanasiou , Ehecatl Antonio del Rio-Chanona , Panagiotis Petsagkourakis

Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes…

Computational Finance · Quantitative Finance 2025-10-28 Ollie Olby , Andreea Bacalum , Rory Baggott , Namid Stillman