English
Related papers

Related papers: Hedging with Sparse Reward Reinforcement Learning

200 papers

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

We present a method for finding optimal hedging policies for arbitrary initial portfolios and market states. We develop a novel actor-critic algorithm for solving general risk-averse stochastic control problems and use it to learn hedging…

Computational Finance · Quantitative Finance 2022-07-18 Phillip Murray , Ben Wood , Hans Buehler , Magnus Wiese , Mikko S. Pakkanen

Sparse deep learning aims to address the challenge of huge storage consumption by deep neural networks, and to recover the sparse structure of target functions. Although tremendous empirical successes have been achieved, most sparse deep…

Machine Learning · Statistics 2020-11-17 Jincheng Bai , Qifan Song , Guang Cheng

Agent-based models help explain stock price dynamics as emergent phenomena driven by interacting investors. In this modeling tradition, investor behavior has typically been captured by two distinct mechanisms -- learning and heterogeneous…

Computers and Society · Computer Science 2025-11-12 Ryuji Hashimoto , Ryosuke Takata , Masahiro Suzuki , Yuki Tanaka , Kiyoshi Izumi

Portfolio management is a fundamental problem in finance. It involves periodic reallocations of assets to maximize the expected returns within an appropriate level of risk exposure. Deep reinforcement learning (RL) has been considered a…

Computational Finance · Quantitative Finance 2022-10-05 Hui Niu , Siyuan Li , Jian Li

We propose a deep hedging framework for index option portfolios, grounded in a realistic market simulator that captures the joint dynamics of S&P 500 returns and the full implied volatility surface. Our approach integrates surface-informed…

Risk Management · Quantitative Finance 2025-08-14 Pascal François , Geneviève Gauthier , Frédéric Godin , Carlos O. Pérez-Mendoza

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges…

Methodology · Statistics 2026-03-23 Bo Fu , Dandan Jiang

We propose a Reinforcement Learning framework for sparse indirect control of large-scale multi-agent systems, where few controlled agents shape the collective behavior of many uncontrolled agents. The approach addresses this multi-scale…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Luigi Catello , Italo Napolitano , Davide Salzano , Mario di Bernardo

One of the most fundamental questions in quantitative finance is the existence of continuous-time diffusion models that fit market prices of a given set of options. Traditionally, one employs a mix of intuition, theoretical and empirical…

Computational Finance · Quantitative Finance 2023-10-09 Nelson Vadori

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

We propose a reinforcement learning (RL) framework that leverages multimodal data including historical stock prices, sentiment analysis, and topic embeddings from news articles, to optimize trading strategies for SP100 stocks. Building upon…

Portfolio Management · Quantitative Finance 2024-12-24 Sumit Nawathe , Ravi Panguluri , James Zhang , Sashwat Venkatesh

In most real scenarios the construction of a risk-neutral portfolio must be performed in discrete time and with transaction costs. Two human imposed constraints are the risk-aversion and the profit maximization, which together define a…

Risk Management · Quantitative Finance 2021-12-21 G. Mazzei , F. G. Bellora , J. A. Serur

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

This paper contributes to the existing literature on hedging American options with Deep Reinforcement Learning (DRL). The study first investigates hyperparameter impact on hedging performance, considering learning rates, training episodes,…

Risk Management · Quantitative Finance 2024-05-15 Reilly Pickard , F. Wredenhagen , Y. Lawryshyn

The construction of approximate replication strategies for pricing and hedging of derivative contracts in incomplete markets is a key problem of financial engineering. Recently Reinforcement Learning algorithms for hedging under realistic…

Artificial Intelligence · Computer Science 2023-11-02 Oleg Szehr

This paper presents machine learning techniques and deep reinforcement learningbased algorithms for the efficient resolution of nonlinear partial differential equations and dynamic optimization problems arising in investment decisions and…

Optimization and Control · Mathematics 2021-04-19 Maximilien Germain , Huyên Pham , Xavier Warin

Recent advances in reinforcement-learning research have demonstrated impressive results in building algorithms that can out-perform humans in complex tasks. Nevertheless, creating reinforcement-learning systems that can build abstractions…

Machine Learning · Computer Science 2022-11-08 Lucas Lehnert , Michael J. Frank , Michael L. Littman

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

Machine Learning · Computer Science 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

Representation learning has emerged as a powerful paradigm for extracting valuable latent features from complex, high-dimensional data. In financial domains, learning informative representations for assets can be used for tasks like sector…

Machine Learning · Computer Science 2024-07-29 Rian Dolphin , Barry Smyth , Ruihai Dong