English
Related papers

Related papers: Sample-based Distributional Policy Gradient

200 papers

The goal of an offline reinforcement learning (RL) algorithm is to learn optimal polices using historical (offline) data, without access to the environment for online exploration. One of the main challenges in offline RL is the distribution…

Machine Learning · Computer Science 2023-10-31 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

While a powerful and promising approach, deep reinforcement learning (DRL) still suffers from sample inefficiency, which can be notably improved by resorting to more sophisticated techniques to address the exploration-exploitation dilemma.…

Machine Learning · Computer Science 2024-09-10 Jianshu Hu , Paul Weng , Yutong Ban

We propose a metalearning approach for learning gradient-based reinforcement learning (RL) algorithms. The idea is to evolve a differentiable loss function, such that an agent, which optimizes its policy to minimize this loss, will achieve…

Machine Learning · Computer Science 2018-05-01 Rein Houthooft , Richard Y. Chen , Phillip Isola , Bradly C. Stadie , Filip Wolski , Jonathan Ho , Pieter Abbeel

Deep reinforcement learning (DRL) frameworks are increasingly used to solve high-dimensional continuous control tasks in robotics. However, due to the lack of sample efficiency, applying DRL for online learning is still practically…

Robotics · Computer Science 2024-04-30 Yu Tang Liu , Aamir Ahmad

Distributed Distributional DrQ is a model-free and off-policy RL algorithm for continuous control tasks based on the state and observation of the agent, which is an actor-critic method with the data-augmentation and the distributional…

Machine Learning · Computer Science 2024-04-17 Zehao Zhou

Upside Down Reinforcement Learning (UDRL) is a promising framework for solving reinforcement learning problems which focuses on learning command-conditioned policies. In this work, we extend UDRL to the task of learning a…

Machine Learning · Computer Science 2025-01-29 Jacopo Di Ventura , Dylan R. Ashley , Vincent Herrmann , Francesco Faccio , Jürgen Schmidhuber

Dynamic hedging is a financial strategy that consists in periodically transacting one or multiple financial assets to offset the risk associated with a correlated liability. Deep Reinforcement Learning (DRL) algorithms have been used to…

Computational Finance · Quantitative Finance 2025-04-18 Andrei Neagu , Frédéric Godin , Leila Kosseim

Multi-agent reinforcement learning has drawn increasing attention in practice, e.g., robotics and automatic driving, as it can explore optimal policies using samples generated by interacting with the environment. However, high reward…

Machine Learning · Computer Science 2022-10-17 Jifeng Hu , Yanchao Sun , Hechang Chen , Sili Huang , haiyin piao , Yi Chang , Lichao Sun

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

In the ever-changing and intricate landscape of financial markets, portfolio optimisation remains a formidable challenge for investors and asset managers. Conventional methods often struggle to capture the complex dynamics of market…

Machine Learning · Statistics 2025-10-09 Himanshu Choudhary , Arishi Orra , Manoj Thakur

Inference scaling further accelerates Large Language Models (LLMs) toward Artificial General Intelligence (AGI), with large-scale Reinforcement Learning (RL) to unleash long Chain-of-Thought reasoning. Most contemporary reasoning approaches…

Machine Learning · Computer Science 2025-05-20 Xuerui Su , Liya Guo , Yue Wang , Yi Zhu , Zhiming Ma , Zun Wang , Yuting Liu

Order picking is a pivotal operation in warehouses that directly impacts overall efficiency and profitability. This study addresses the dynamic order picking problem, a significant concern in modern warehouse management, where real-time…

Optimization and Control · Mathematics 2025-04-08 Sasan Mahmoudinazlou , Abhay Sobhanan , Hadi Charkhgard , Ali Eshragh , George Dunn

Pick-up and Delivery Route Prediction (PDRP), which aims to estimate the future service route of a worker given his current task pool, has received rising attention in recent years. Deep neural networks based on supervised learning have…

Machine Learning · Computer Science 2023-08-01 Xiaowei Mao , Haomin Wen , Hengrui Zhang , Huaiyu Wan , Lixia Wu , Jianbin Zheng , Haoyuan Hu , Youfang Lin

This paper investigates the application of Deep Reinforcement Learning (DRL) to classical inventory management problems, with a focus on practical implementation considerations. We apply a DRL algorithm based on DirectBackprop to several…

Particle robots are novel biologically-inspired robotic systems where locomotion can be achieved collectively and robustly, but not independently. While its control is currently limited to a hand-crafted policy for basic locomotion tasks,…

Robotics · Computer Science 2025-05-12 Jeremy Shen , Erdong Xiao , Yuchen Liu , Chen Feng

Recent deep reinforcement learning (DRL) methods in finance show promising outcomes. However, there is limited research examining the behavior of these DRL algorithms. This paper aims to investigate their tendencies towards holding or…

Trading and Market Microstructure · Quantitative Finance 2024-07-16 Alireza Mohammadshafie , Akram Mirzaeinia , Haseebullah Jumakhan , Amir Mirzaeinia

Reinforcement Learning algorithms are primarily focused on learning a policy that maximizes expected return. As a result, the learned policy can exploit one or few reward sources. However, in many natural situations, it is desirable to…

Machine Learning · Computer Science 2026-03-31 Sagalpreet Singh , Rishi Saket , Aravindan Raghuveer

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

Machine Learning · Computer Science 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

The application of Deep Reinforcement Learning (DRL) to inventory management is an emerging field. However, traditional DRL algorithms, originally developed for diverse domains such as game-playing and robotics, may not be well-suited for…

Machine Learning · Computer Science 2025-06-04 Tarkan Temizöz , Christina Imdahl , Remco Dijkman , Douniel Lamghari-Idrissi , Willem van Jaarsveld

Researchers have demonstrated that Deep Reinforcement Learning (DRL) is a powerful tool for finding policies that perform well on complex robotic systems. However, these policies are often unpredictable and can induce highly variable…

Robotics · Computer Science 2022-03-08 Sean Gillen , Asutay Ozmen , Katie Byl