English
Related papers

Related papers: Deep Reinforcement Learning for Online Optimal Exe…

200 papers

This work introduces a novel value decomposition algorithm, termed \textit{Dynamic Deep Factor Graphs} (DDFG). Unlike traditional coordination graphs, DDFG leverages factor graphs to articulate the decomposition of value functions, offering…

Robotics · Computer Science 2024-06-10 Yuchen Shi , Shihong Duan , Cheng Xu , Ran Wang , Fangwen Ye , Chau Yuen

In this paper we propose a novel gradient algorithm to learn a policy from an expert's observed behavior assuming that the expert behaves optimally with respect to some unknown reward function of a Markovian Decision Problem. The…

Machine Learning · Computer Science 2012-06-26 Gergely Neu , Csaba Szepesvari

This paper provides the details of implementing two important policy gradient methods to solve the inverted pendulum problem. These are namely the Deep Deterministic Policy Gradient (DDPG) and the Proximal Policy Optimization (PPO)…

Machine Learning · Computer Science 2021-05-18 Swagat Kumar

The deep reinforcement learning (DRL) based Volt-VAR optimization (VVO) methods have been widely studied for active distribution networks (ADNs). However, most of them lack safety guarantees in terms of power injection uncertainties due to…

Systems and Control · Electrical Eng. & Systems 2024-09-30 Zhengrong Chen , Siyao Cai , A. P. Sakis Meliopoulos

Optimal Order Execution is a well-established problem in finance that pertains to the flawless execution of a trade (buy or sell) for a given volume within a specified time frame. This problem revolves around optimizing returns while…

Computational Finance · Quantitative Finance 2026-01-13 Khabbab Zakaria , Jayapaulraj Jerinsh , Andreas Maier , Patrick Krauss , Stefano Pasquali , Dhagash Mehta

This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision…

Portfolio Management · Quantitative Finance 2026-05-19 Kamil Kashif , Robert Ślepaczuk

In many reinforcement learning applications, the underlying environment reward and transition functions are explicitly known differentiable functions. This enables us to use recent research which applies machine learning tools to stochastic…

Portfolio Management · Quantitative Finance 2022-04-08 Thibault Jaisson

In this paper we explore the usage of deep reinforcement learning algorithms to automatically generate consistently profitable, robust, uncorrelated trading signals in any general financial market. In order to do this, we present a novel…

Computational Finance · Quantitative Finance 2019-12-17 Souradeep Chakraborty

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We present a method for finding optimal hedging policies for arbitrary initial portfolios and market states. We develop a novel actor-critic algorithm for solving general risk-averse stochastic control problems and use it to learn hedging…

Computational Finance · Quantitative Finance 2022-07-18 Phillip Murray , Ben Wood , Hans Buehler , Magnus Wiese , Mikko S. Pakkanen

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in…

Machine Learning · Computer Science 2019-03-05 Zhizheng Zhang , Jiale Chen , Zhibo Chen , Weiping Li

Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be copied to autonomous driving because the state spaces in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Sen Wang , Daoyuan Jia , Xinshuo Weng

Sample efficiency is a critical property when optimizing policy parameters for the controller of a robot. In this paper, we evaluate two state-of-the-art policy optimization algorithms. One is a recent deep reinforcement learning method…

Machine Learning · Computer Science 2016-08-23 Arnaud de Froissard de Broissia , Olivier Sigaud

The energy transition has increased the reliance on intermittent energy sources, destabilizing energy markets and causing unprecedented volatility, culminating in the global energy crisis of 2021. In addition to harming producers and…

Trading and Market Microstructure · Quantitative Finance 2023-08-07 Jonas Hanetho

This study investigates the development of an optimal execution strategy through reinforcement learning, aiming to determine the most effective approach for traders to buy and sell inventory within a finite time horizon. Our proposed model…

Trading and Market Microstructure · Quantitative Finance 2025-11-04 Yadh Hafsi , Edoardo Vittori

Mobile edge computing (MEC) allows appliances to offload workloads to neighboring MEC servers that have the potential for computation-intensive tasks with limited computational capabilities. This paper studied how deep reinforcement…

Information Theory · Computer Science 2025-06-04 Nguyen Chi Long , Trinh Van Chien , Ta Hai Tung , Van Son Nguyen , Trong-Minh Hoang , Nguyen Ngoc Hai Dang

Our work focuses on training RL agents on multiple visually diverse environments to improve observational generalization performance. In prior methods, policy and value networks are separately optimized using a disjoint network architecture…

Machine Learning · Computer Science 2023-01-10 Seungyong Moon , JunYeong Lee , Hyun Oh Song

The average reward criterion is relatively less studied as most existing works in the Reinforcement Learning literature consider the discounted reward criterion. There are few recent works that present on-policy average reward actor-critic…

Machine Learning · Computer Science 2023-07-20 Naman Saxena , Subhojyoti Khastigir , Shishir Kolathaya , Shalabh Bhatnagar

Heave compensation is an essential part in various offshore operations. It is used in various applications, which include on-loading or off-loading systems, offshore drilling, landing helicopter on oscillating structures, and deploying and…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Shrenik Zinage , Abhilash Somayajula

We investigate optimal order execution problems in discrete time with instantaneous price impact and stochastic resilience. First, in the setting of linear transient price impact we derive a closed-form recursion for the optimal strategy,…

Trading and Market Microstructure · Quantitative Finance 2023-10-31 Tao Chen , Mike Ludkovski , Moritz Voß