English
Related papers

Related papers: Efficient Deep Reinforcement Learning with Predict…

200 papers

Reinforcement learning algorithms are fundamental to align large language models with human preferences and to enhance their reasoning capabilities. However, current reinforcement learning algorithms often suffer from training instability…

Machine Learning · Computer Science 2025-06-05 Yaru Hao , Li Dong , Xun Wu , Shaohan Huang , Zewen Chi , Furu Wei

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Given the recent impact of Deep Reinforcement Learning in training agents to win complex games like StarCraft and DoTA(Defense Of The Ancients) - there has been a surge in research for exploiting learning based techniques for professional…

Cryptography and Security · Computer Science 2024-07-03 Ahaan Dabholkar , James Z. Hare , Mark Mittrick , John Richardson , Nicholas Waytowich , Priya Narayanan , Saurabh Bagchi

Proximal Policy Optimization (PPO) is a highly popular model-free reinforcement learning (RL) approach. However, we observe that in a continuous action space, PPO can prematurely shrink the exploration variance, which leads to slow progress…

Machine Learning · Computer Science 2020-11-04 Perttu Hämäläinen , Amin Babadi , Xiaoxiao Ma , Jaakko Lehtinen

In this paper, we study offline preference-based reinforcement learning (PbRL), where learning is based on pre-collected preference feedback over pairs of trajectories. While offline PbRL has demonstrated remarkable empirical success,…

Machine Learning · Computer Science 2025-06-04 Hyungkyu Kang , Min-hwan Oh

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a…

Machine Learning · Computer Science 2020-05-15 Alexander C. Li , Carlos Florensa , Ignasi Clavera , Pieter Abbeel

Real-world applications require RL algorithms to act safely. During learning process, it is likely that the agent executes sub-optimal actions that may lead to unsafe/poor states of the system. Exploration is particularly brittle in…

Machine Learning · Statistics 2019-06-17 Elena Smirnova , Elvis Dohmatob , Jérémie Mary

Advanced algorithms based on Deep Reinforcement Learning (DRL) have been able to become a reliable tool for the Forex market traders and provide a suitable strategy for maximizing profit and reducing trading risk. These tools try to find…

Computational Engineering, Finance, and Science · Computer Science 2024-11-05 Sahar Arabha , Davoud Sarani , Parviz Rashidi-Khazaee

In this article, we explore the feasibility of applying proximal policy optimization, a state-of-the-art deep reinforcement learning algorithm for continuous control tasks, on the dual-objective problem of controlling an underactuated…

Machine Learning · Computer Science 2019-12-20 Eivind Meyer , Haakon Robinson , Adil Rasheed , Omer San

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by using deep neural networks as function approximators to learn directly from raw input images. However, learning directly from raw images…

Machine Learning · Computer Science 2019-07-31 Gabriel V. de la Cruz , Yunshu Du , Matthew E. Taylor

We argue that inventory management presents unique opportunities for the reliable application of deep reinforcement learning (DRL). To enable this, we emphasize and test two complementary techniques. The first is Hindsight Differentiable…

Machine Learning · Computer Science 2025-09-12 Matias Alvo , Daniel Russo , Yash Kanoria , Minuk Lee

We address the problem of production planning and distribution in multi-echelon supply chains. We consider uncertain demands and lead times which makes the problem stochastic and non-linear. A Markov Decision Process formulation and a…

Machine Learning · Computer Science 2022-01-14 Julio César Alves , Geraldo Robson Mateus

Proximal policy optimization (PPO) is a widely-used algorithm for on-policy reinforcement learning. This work offers an alternative perspective of PPO, in which it is decomposed into the inner-loop estimation of update vectors, and the…

Machine Learning · Computer Science 2024-11-04 Charlie B. Tan , Edan Toledo , Benjamin Ellis , Jakob N. Foerster , Ferenc Huszár

Reinforcement learning (RL) has become an increasingly active area of research in recent years. Although there are many algorithms that allow an agent to solve tasks efficiently, they often ignore the possibility that prior experience…

Artificial Intelligence · Computer Science 2020-01-07 Francisco M. Garcia , Chris Nota , Philip S. Thomas

Real-time learning is crucial for robotic agents adapting to ever-changing, non-stationary environments. A common setup for a robotic agent is to have two different computers simultaneously: a resource-limited local computer tethered to the…

Robotics · Computer Science 2023-06-28 Yan Wang , Gautham Vasan , A. Rupam Mahmood

Designing robust reinforcement learning (RL) agents in the presence of imperfect reward signals remains a core challenge. In practice, agents are often trained with proxy rewards that only approximate the true objective, leaving them…

Machine Learning · Computer Science 2026-04-15 Zixuan Liu , Xiaolin Sun , Zizhan Zheng

Pretraining with expert demonstrations have been found useful in speeding up the training process of deep reinforcement learning algorithms since less online simulation data is required. Some people use supervised learning to speed up the…

Artificial Intelligence · Computer Science 2018-02-12 Xiaoqin Zhang , Huimin Ma

Recent advances in multi-agent reinforcement learning (MARL) have created opportunities to solve complex real-world tasks. Cybersecurity is a notable application area, where defending networks against sophisticated adversaries remains a…

Machine Learning · Computer Science 2025-09-08 Aditya Vikram Singh , Ethan Rathbun , Emma Graham , Lisa Oakley , Simona Boboila , Alina Oprea , Peter Chin

Reinforcement learning (RL) has been extensively employed in a wide range of decision-making problems, such as games and robotics. Recently, diffusion policies have shown strong potential in modeling multi-modal behaviors, enabling more…

Machine Learning · Computer Science 2026-03-06 Ben Liu , Shunpeng Yang , Hua Chen

Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming not only from sparse outcome feedback but also from the agent's inability to leverage prior…

Machine Learning · Computer Science 2026-03-19 Dilxat Muhtar , Jiashun Liu , Wei Gao , Weixun Wang , Shaopan Xiong , Ju Huang , Siran Yang , Wenbo Su , Jiamang Wang , Ling Pan , Bo Zheng