English
Related papers

Related papers: Option Hedging with Risk Averse Reinforcement Lear…

200 papers

We present an actor-critic-type reinforcement learning algorithm for solving the problem of hedging a portfolio of financial instruments such as securities and over-the-counter derivatives using purely historic data. The key characteristics…

Computational Finance · Quantitative Finance 2024-06-26 Hans Buehler , Phillip Murray , Ben Wood

Deep reinforcement learning has recently made significant progress in solving computer games and robotic control tasks. A known problem, though, is that policies overfit to the training environment and may not avoid rare, catastrophic…

Machine Learning · Computer Science 2019-04-02 Xinlei Pan , Daniel Seita , Yang Gao , John Canny

Deep hedging trains neural networks to manage derivative risk under market frictions, but produces hedge ratios with no measure of model confidence -- a significant barrier to deployment. We introduce uncertainty quantification to the deep…

Computational Finance · Quantitative Finance 2026-03-12 Manan Poddar

In finance, sequential decision problems are often faced, for which reinforcement learning (RL) emerges as a promising tool for optimisation without the need of analytical tractability. However, the objective of classical RL is the expected…

Computational Finance · Quantitative Finance 2026-02-13 Federico Cacciamani , Roberto Daluiso , Marco Pinciroli , Michele Trapletti , Edoardo Vittori

This study presents a Reinforcement Learning (RL)-based portfolio management model tailored for high-risk environments, addressing the limitations of traditional RL models and exploiting market opportunities through two-sided transactions…

Portfolio Management · Quantitative Finance 2024-08-13 Ali Habibnia , Mahdi Soltanzadeh

The cryptocurrency market is volatile, non-stationary and non-continuous. Together with liquid derivatives markets, this poses a unique opportunity to study risk management, especially the hedging of options, in a turbulent market. We study…

Pricing of Securities · Quantitative Finance 2022-12-05 Jovanka Lili Matic , Natalie Packham , Wolfgang Karl Härdle

Deep hedging is a framework for hedging derivatives in the presence of market frictions. In this study, we focus on the problem of hedging a given target option by using multiple options. To extend the deep hedging framework to this…

Computational Finance · Quantitative Finance 2023-05-23 Masanori Hirano , Kentaro Imajo , Kentaro Minami , Takuya Shimada

We address the problem of inverse reinforcement learning in Markov decision processes where the agent is risk-sensitive. In particular, we model risk-sensitivity in a reinforcement learning framework by making use of models of human…

Machine Learning · Computer Science 2017-11-23 Lillian J. Ratliff , Eric Mazumdar

This scientific paper propose a novel portfolio optimization model using an improved deep reinforcement learning algorithm. The objective function of the optimization model is the weighted sum of the expectation and value at risk(VaR) of…

Machine Learning · Computer Science 2022-08-30 Boyi Jin

We consider reinforcement learning with performance evaluated by a dynamic risk measure. We construct a projected risk-averse dynamic programming equation and study its properties. Then we propose risk-averse counterparts of the methods of…

Optimization and Control · Mathematics 2020-03-03 Umit Kose , Andrzej Ruszczynski

We study neural networks as nonparametric estimation tools for the hedging of options. To this end, we design a network, named HedgeNet, that directly outputs a hedging strategy. This network is trained to minimise the hedging error instead…

Risk Management · Quantitative Finance 2021-06-15 Johannes Ruf , Weiguan Wang

In this chapter we first briefly review the existing approaches to hedging in rough volatility models. Next, we present a simple but general result which shows that in a one-factor rough stochastic volatility model, any option may be…

Mathematical Finance · Quantitative Finance 2021-05-11 Masaaki Fukasawa , Blanka Horvath , Peter Tankov

This article leverages deep reinforcement learning (DRL) to hedge American put options, utilizing the deep deterministic policy gradient (DDPG) method. The agents are first trained and tested with Geometric Brownian Motion (GBM) asset paths…

Risk Management · Quantitative Finance 2024-05-14 Reilly Pickard , Finn Wredenhagen , Julio DeJesus , Mario Schlener , Yuri Lawryshyn

Inverse Reinforcement Learning (IRL) learns a reward function to explain expert demonstrations. Modern IRL methods often use the adversarial (minimax) formulation that alternates between reward and policy optimization, which often lead to…

Machine Learning · Computer Science 2025-10-14 Yang Chen , Menglin Zou , Jiaqi Zhang , Yitan Zhang , Junyi Yang , Gael Gendron , Libo Zhang , Jiamou Liu , Michael J. Witbrock

Building on the functional-analytic framework of operator-valued kernels and un-truncated signature kernels, we propose a scalable, provably convergent signature-based algorithm for a broad class of high-dimensional, path-dependent hedging…

Functional Analysis · Mathematics 2025-02-06 Nicola Muca Cirone , Cristopher Salvi

The autonomous trading agent is one of the most actively studied areas of artificial intelligence to solve the capital market portfolio management problem. The two primary goals of the portfolio management problem are maximizing profit and…

Trading and Market Microstructure · Quantitative Finance 2019-09-10 Wonsup Shin , Seok-Jun Bu , Sung-Bae Cho

We adopt Deep Reinforcement Learning algorithms to design trading strategies for continuous futures contracts. Both discrete and continuous action spaces are considered and volatility scaling is incorporated to create reward functions which…

Computational Finance · Quantitative Finance 2019-11-25 Zihao Zhang , Stefan Zohren , Stephen Roberts

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

We present a robust Deep Hedging framework for the pricing and hedging of option portfolios that significantly improves training efficiency and model robustness. In particular, we propose a neural model for training model embeddings which…

Computational Finance · Quantitative Finance 2025-04-24 Fabienne Schmid , Daniel Oeltz

Model-free reinforcement learning (RL) methods are succeeding in a growing number of tasks, aided by recent advances in deep learning. However, they tend to suffer from high sample complexity, which hinders their use in real-world domains.…

Machine Learning · Computer Science 2018-10-08 Thanard Kurutach , Ignasi Clavera , Yan Duan , Aviv Tamar , Pieter Abbeel