English
Related papers

Related papers: Reinforcement learning for options on target volat…

200 papers

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

Portfolio Selection is an important real-world financial task and has attracted extensive attention in artificial intelligence communities. This task, however, has two main difficulties: (i) the non-stationary price series and complex asset…

Machine Learning · Computer Science 2020-03-09 Yifan Zhang , Peilin Zhao , Qingyao Wu , Bin Li , Junzhou Huang , Mingkui Tan

With the increasing power of computers and the rapid development of self-learning methodologies such as machine learning and artificial intelligence, the problem of constructing an automatic Financial Trading Systems (FTFs) becomes an…

Trading and Market Microstructure · Quantitative Finance 2019-08-29 Haoqian Li , Thomas Lau

We develop an approach for solving time-consistent risk-sensitive stochastic optimization problems using model-free reinforcement learning (RL). Specifically, we assume agents assess the risk of a sequence of random variables using dynamic…

Machine Learning · Computer Science 2022-12-01 Anthony Coache , Sebastian Jaimungal

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

Recent years have seen an emerging class of structured financial products based on options linked to dynamic asset allocation strategies. One of the most chosen approach is the so-called target volatility mechanism. It shifts between risky…

Pricing of Securities · Quantitative Finance 2019-02-26 Luca Di Persio , Luca Prezioso , Kai Wallbaum

Constrained Reinforcement Learning has been employed to enforce safety constraints on policy through the use of expected cost constraints. The key challenge is in handling expected cost accumulated using the policy and not just in a single…

Machine Learning · Computer Science 2024-01-17 Hao Jiang , Tien Mai , Pradeep Varakantham , Minh Huy Hoang

The development of reinforced learning methods has extended application to many areas including algorithmic trading. In this paper trading on the stock exchange is interpreted into a game with a Markov property consisting of states,…

Trading and Market Microstructure · Quantitative Finance 2020-02-28 Evgeny Ponomarev , Ivan Oseledets , Andrzej Cichocki

We propose a reinforcement learning (RL) approach to model optimal exercise strategies for option-type products. We pursue the RL avenue in order to learn the optimal action-value function of the underlying stopping problem. In addition to…

Pricing of Securities · Quantitative Finance 2024-06-27 John Ery , Loris Michel

We present a framework for hedging a portfolio of derivatives in the presence of market frictions such as transaction costs, market impact, liquidity constraints or risk limits using modern deep reinforcement machine learning methods. We…

Computational Finance · Quantitative Finance 2018-02-12 Hans Bühler , Lukas Gonon , Josef Teichmann , Ben Wood

Option pricing theory, such as the Black and Scholes (1973) model, provides an explicit solution to construct a strategy that perfectly hedges an option in a continuous-time setting. In practice, however, trading occurs in discrete time and…

Mathematical Finance · Quantitative Finance 2025-05-30 Pierre Brugière , Gabriel Turinici

We study a speculative trading problem within the exploratory reinforcement learning (RL) framework of Wang et al. [2020]. The problem is formulated as a sequential optimal stopping problem over entry and exit times under general utility…

Mathematical Finance · Quantitative Finance 2026-04-03 Yun Zhao , Alex S. L. Tse , Harry Zheng

This paper studies reinforcement learning (RL) under malicious falsification on cost signals and introduces a quantitative framework of attack models to understand the vulnerabilities of RL. Focusing on $Q$-learning, we show that…

Machine Learning · Computer Science 2019-08-20 Yunhan Huang , Quanyan Zhu

This study investigates the mean-variance (MV) trade-off in reinforcement learning (RL), an instance of the sequential decision-making under uncertainty. Our objective is to obtain MV-efficient policies whose means and variances are located…

Machine Learning · Computer Science 2024-11-14 Masahiro Kato , Kei Nakagawa , Kenshi Abe , Tetsuro Morimura , Kentaro Baba

Scaling reinforcement learning (RL) to recommender systems (RS) is promising since maximizing the expected cumulative rewards for RL agents meets the objective of RS, i.e., improving customers' long-term satisfaction. A key approach to this…

Machine Learning · Computer Science 2022-09-27 Chengqian Gao , Ke Xu , Kuangqi Zhou , Lanqing Li , Xueqian Wang , Bo Yuan , Peilin Zhao

Stock trading strategy plays a crucial role in investment companies. However, it is challenging to obtain optimal strategy in the complex and dynamic stock market. We explore the potential of deep reinforcement learning to optimize stock…

Machine Learning · Computer Science 2022-08-02 Xiao-Yang Liu , Zhuoran Xiong , Shan Zhong , Hongyang Yang , Anwar Walid

Optimal stopping is the problem of deciding the right time at which to take a particular action in a stochastic system, in order to maximize an expected reward. It has many applications in areas such as finance, healthcare, and statistics.…

Artificial Intelligence · Computer Science 2021-05-20 Abderrahim Fathan , Erick Delage

In this paper, we study the continuous-time multi-asset mean-variance (MV) portfolio selection using a reinforcement learning (RL) algorithm, specifically the soft actor-critic (SAC) algorithm, in the time-varying financial market. A family…

Mathematical Finance · Quantitative Finance 2025-05-13 Yu Li , Yuhan Wu , Shuhua Zhang

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee