English
Related papers

Related papers: Option Market Making via Reinforcement Learning

200 papers

This paper presents a multi-agent reinforcement learning algorithm to represent strategic bidding behavior in freight transport markets. Using this algorithm, we investigate whether feasible market equilibriums arise without any central…

Machine Learning · Computer Science 2021-02-19 Wouter van Heeswijk

We study the problem of collaborative machine learning markets where multiple parties can achieve improved performance on their machine learning tasks by combining their training data. We discuss desired properties for these machine…

Computer Science and Game Theory · Computer Science 2019-11-21 Olga Ohrimenko , Shruti Tople , Sebastian Tschiatschek

Temporal abstraction allows reinforcement learning agents to represent knowledge and develop strategies over different temporal scales. The option-critic framework has been demonstrated to learn temporally extended actions, represented as…

Machine Learning · Computer Science 2025-11-21 Anand Kamat , Doina Precup

A novel high-frequency market-making approach in discrete time is proposed that admits closed-form solutions. By taking advantage of demand functions that are linear in the quoted bid and ask spreads with random coefficients, we model the…

Trading and Market Microstructure · Quantitative Finance 2024-05-21 Jonathan Chávez-Casillas , José E. Figueroa-López , Chuyi Yu , Yi Zhang

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Online bidding is a classic optimization problem, with several applications in online decision-making, the design of interruptible systems, and the analysis of approximation algorithms. In this work, we study online bidding under…

Computer Science and Game Theory · Computer Science 2025-10-30 Spyros Angelopoulos , Bertrand Simon

Long horizon robot learning tasks with sparse rewards pose a significant challenge for current reinforcement learning algorithms. A key feature enabling humans to learn challenging control tasks is that they often receive expert…

Machine Learning · Computer Science 2022-11-18 Souradeep Dutta , Kaustubh Sridhar , Osbert Bastani , Edgar Dobriban , James Weimer , Insup Lee , Julia Parish-Morris

The objective of this paper is to introduce the theory of option pricing for markets with informed traders within the framework of dynamic asset pricing theory. We introduce new models for option pricing for informed traders in complete…

Mathematical Finance · Quantitative Finance 2020-08-13 Yuan Hu , Abootaleb Shirvani , Stoyan Stoyanov , Young Shin Kim , Frank J. Fabozzi , Svetlozar T. Rachev

Online recommendation and advertising are two major income channels for online recommendation platforms (e.g. e-commerce and news feed site). However, most platforms optimize recommending and advertising strategies by different teams…

Information Retrieval · Computer Science 2020-06-22 Xiangyu Zhao , Xudong Zheng , Xiwang Yang , Xiaobing Liu , Jiliang Tang

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

We consider the challenge of finding a deterministic policy for a Markov decision process that uniformly (in all states) maximizes one reward subject to a probabilistic constraint over a different reward. Existing solutions do not fully…

Machine Learning · Computer Science 2022-01-21 Jaeyoung Lee , Sean Sedwards , Krzysztof Czarnecki

As a fundamental problem in algorithmic trading, order execution aims at fulfilling a specific trading order, either liquidation or acquirement, for a given instrument. Towards effective execution strategy, recent years have witnessed the…

Trading and Market Microstructure · Quantitative Finance 2021-03-22 Yuchen Fang , Kan Ren , Weiqing Liu , Dong Zhou , Weinan Zhang , Jiang Bian , Yong Yu , Tie-Yan Liu

Market making is a popular trading strategy, which aims to generate profit from the spread between the quotes posted at either side of the market. It has been shown that training market makers (MMs) with adversarial reinforcement learning…

Trading and Market Microstructure · Quantitative Finance 2025-08-26 Ziyi Wang , Carmine Ventre , Maria Polukarov

This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to…

Machine Learning · Computer Science 2019-07-23 Baicen Xiao , Bhaskar Ramasubramanian , Andrew Clark , Hannaneh Hajishirzi , Linda Bushnell , Radha Poovendran

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

Machine Learning · Computer Science 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

We propose an automata-theoretic approach for reinforcement learning (RL) under complex spatio-temporal constraints with time windows. The problem is formulated using a Markov decision process under a bounded temporal logic constraint.…

Artificial Intelligence · Computer Science 2023-08-01 Xiaoshan Lin , Abbasali Koochakzadeh , Yasin Yazicioglu , Derya Aksaray

Wind power producers (WPPs) participating in short-term power markets face significant imbalance costs due to their non-dispatchable and variable production. While some WPPs have a large enough market share to influence prices with their…

Machine Learning · Computer Science 2026-03-12 Shobhit Singhal , Marta Fochesato , Liviu Aolaritei , Florian Dörfler

Based on the analog between the stochastic dynamics and quantum harmonic oscillator, we propose a market force driving model to generalize the Black-Scholes model in finance market. We give new schemes of option pricing, in which we can…

Risk Management · Quantitative Finance 2026-01-05 Pengpeng Li , Shi-Dong Liang

In this paper we are introducing a new reinforcement learning method for control problems in environments with delayed feedback. Specifically, our method employs stochastic planning, versus previous methods that used deterministic planning.…

Machine Learning · Computer Science 2024-02-02 Zhiyuan Yao , Ionut Florescu , Chihoon Lee