English
Related papers

Related papers: Adversarial Deep Reinforcement Learning in Portfol…

200 papers

The theory of continuous-time reinforcement learning (RL) has progressed rapidly in recent years. While the ultimate objective of RL is typically to learn deterministic control policies, most existing continuous-time RL methods rely on…

Machine Learning · Computer Science 2026-03-17 Ziheng Cheng , Xin Guo , Yufei Zhang

We introduce Diffusion Policy Policy Optimization, DPPO, an algorithmic framework including best practices for fine-tuning diffusion-based policies (e.g. Diffusion Policy) in continuous control and robot learning tasks using the policy…

Deep reinforcement learning (DRL) has emerged as a powerful framework for solving sequential decision-making problems, achieving remarkable success in a wide range of applications, including game AI, autonomous driving, biomedicine, and…

Machine Learning · Computer Science 2025-05-14 Yinghan Sun , Hongxi Wang , Hua Chen , Wei Zhang

This paper proposes an algorithm that aims to improve generalization for reinforcement learning agents by removing overfitting to confounding features. Our approach consists of a max-min game theoretic objective. A generator transfers the…

Machine Learning · Computer Science 2023-08-31 Md Masudur Rahman , Yexiang Xue

Many currently deployed Reinforcement Learning agents work in an environment shared with humans, be them co-workers, users or clients. It is desirable that these agents adjust to people's preferences, learn faster thanks to their help, and…

Machine Learning · Computer Science 2018-08-14 Hélène Plisnier , Denis Steckelmacher , Tim Brys , Diederik M. Roijers , Ann Nowé

In this paper, we present a novel trading strategy that integrates reinforcement learning methods with clustering techniques for portfolio management in multi-period trading. Specifically, we leverage the clustering method to categorize…

Portfolio Management · Quantitative Finance 2023-10-03 Zhengyong Jiang , Jeyan Thiayagalingam , Jionglong Su , Jinjun Liang

Stock trading strategy plays a crucial role in investment companies. However, it is challenging to obtain optimal strategy in the complex and dynamic stock market. We explore the potential of deep reinforcement learning to optimize stock…

Machine Learning · Computer Science 2022-08-02 Xiao-Yang Liu , Zhuoran Xiong , Shan Zhong , Hongyang Yang , Anwar Walid

In this paper, we propose a new algorithm PPG (Proximal Policy Gradient), which is close to both VPG (vanilla policy gradient) and PPO (proximal policy optimization). The PPG objective is a partial variation of the VPG objective and the…

Machine Learning · Computer Science 2020-10-21 Ju-Seung Byun , Byungmoon Kim , Huamin Wang

The policy gradient method enjoys the simplicity of the objective where the agent optimizes the cumulative reward directly. Moreover, in the continuous action domain, parameterized distribution of action distribution allows easy control of…

Machine Learning · Computer Science 2022-12-16 Md Masudur Rahman , Yexiang Xue

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in realworld applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing…

Machine Learning · Computer Science 2025-01-09 Tianyang Duan , Zongyuan Zhang , Zheng Lin , Yue Gao , Ling Xiong , Yong Cui , Hongbin Liang , Xianhao Chen , Heming Cui , Dong Huang

Can deep reinforcement learning algorithms be exploited as solvers for optimal trading strategies? The aim of this work is to test reinforcement learning algorithms on conceptually simple, but mathematically non-trivial, trading…

Mathematical Finance · Quantitative Finance 2020-04-10 Ayman Chaouki , Stephen Hardiman , Christian Schmidt , Emmanuel Sérié , Joachim de Lataillade

Stock trading strategies play a critical role in investment. However, it is challenging to design a profitable strategy in a complex and dynamic stock market. In this paper, we propose an ensemble strategy that employs deep reinforcement…

Trading and Market Microstructure · Quantitative Finance 2025-11-18 Hongyang Yang , Xiao-Yang Liu , Shan Zhong , Anwar Walid

This paper presents a novel safe reinforcement learning algorithm for strategic bidding of Virtual Power Plants (VPPs) in day-ahead electricity markets. The proposed algorithm utilizes the Deep Deterministic Policy Gradient (DDPG) method to…

Systems and Control · Electrical Eng. & Systems 2023-09-13 Ognjen Stanojev , Lesia Mitridati , Riccardo de Nardis di Prata , Gabriela Hug

Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward. Deep reinforcement learning provides good opportunity to model the complexity…

Statistical Finance · Quantitative Finance 2021-08-05 Zhaolu Dong , Shan Huang , Simiao Ma , Yining Qian

Algorithmic trading or Financial robots have been conquering the stock markets with their ability to fathom complex statistical trading strategies. But with the recent development of deep learning technologies, these strategies are becoming…

Portfolio Management · Quantitative Finance 2024-05-06 Ashish Anil Pawar , Vishnureddy Prashant Muskawar , Ritesh Tiku

Deep Reinforcement Learning approaches to Online Portfolio Selection have grown in popularity in recent years. The sensitive nature of training Reinforcement Learning agents implies a need for extensive efforts in market representation,…

Machine Learning · Computer Science 2024-01-17 Marc Velay , Bich-Liên Doan , Arpad Rimmel , Fabrice Popineau , Fabrice Daniel

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

This paper provides the details of implementing two important policy gradient methods to solve the inverted pendulum problem. These are namely the Deep Deterministic Policy Gradient (DDPG) and the Proximal Policy Optimization (PPO)…

Machine Learning · Computer Science 2021-05-18 Swagat Kumar

This paper proposes a Deep Reinforcement Learning algorithm for financial portfolio trading based on Deep Q-learning. The algorithm is capable of trading high-dimensional portfolios from cross-sectional datasets of any size which may…

Portfolio Management · Quantitative Finance 2021-12-10 Uta Pigorsch , Sebastian Schäfer

This work adopts the very successful distributional perspective on reinforcement learning and adapts it to the continuous control setting. We combine this within a distributed framework for off-policy learning in order to develop what we…