English
Related papers

Related papers: Diversity-based Trajectory and Goal Selection with…

200 papers

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

Machine Learning · Computer Science 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

In Reinforcement Learning (RL), an agent explores the environment and collects trajectories into the memory buffer for later learning. However, the collected trajectories can easily be imbalanced with respect to the achieved goal states.…

Machine Learning · Computer Science 2020-05-27 Rui Zhao , Volker Tresp

Reinforcement Learning(RL) with sparse rewards is a major challenge. We propose \emph{Hindsight Trust Region Policy Optimization}(HTRPO), a new RL algorithm that extends the highly successful TRPO algorithm with \emph{hindsight} to tackle…

Machine Learning · Computer Science 2021-05-18 Hanbo Zhang , Site Bai , Xuguang Lan , David Hsu , Nanning Zheng

Non-uniform goal selection has the potential to improve the reinforcement learning (RL) of skills over uniform-random selection. In this paper, we introduce a method for learning a goal-selection policy in intrinsically-motivated…

Artificial Intelligence · Computer Science 2024-11-07 Erik M. Lintunen , Nadia M. Ady , Christian Guckelsberger

Sparse rewards present a difficult problem in reinforcement learning and may be inevitable in certain domains with complex dynamics such as real-world robotics. Hindsight Experience Replay (HER) is a recent replay memory development that…

Machine Learning · Computer Science 2020-08-31 Trevor A. McInroe

Deep Reinforcement Learning (RL) is a promising approach for adaptive robot control, but its current application to robotics is currently hindered by high sample requirements. To alleviate this issue, we propose to exploit the symmetries…

Robotics · Computer Science 2020-08-27 Yijiong Lin , Jiancong Huang , Matthieu Zimmer , Yisheng Guan , Juan Rojas , Paul Weng

Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (ER) methods, especially those using TD-error prioritization,…

Machine Learning · Computer Science 2025-09-19 Tianyang Duan , Zongyuan Zhang , Songxiao Guo , Yuanye Zhao , Zheng Lin , Zihan Fang , Yi Liu , Dianxin Luan , Dong Huang , Heming Cui , Yong Cui

Oftentimes, environments for sequential decision-making problems can be quite sparse in the provision of evaluative feedback to guide reinforcement-learning agents. In the extreme case, long trajectories of behavior are merely punctuated…

Machine Learning · Computer Science 2023-08-22 Akash Velu , Skanda Vaidyanath , Dilip Arumugam

Training agents via off-policy deep reinforcement learning (RL) requires a large memory, named replay memory, that stores past experiences used for learning. These experiences are sampled, uniformly or non-uniformly, to create the batches…

Machine Learning · Computer Science 2022-12-27 Bumgeun Park , Taeyoung Kim , Woohyeon Moon , Luiz Felipe Vecchietti , Dongsoo Har

This paper addresses the challenge of incremental learning in growing graphs with increasingly complex tasks. The goal is to continuously train a graph model to handle new tasks while retaining proficiency in previous tasks via memory…

Machine Learning · Computer Science 2025-03-04 Ziyue Qiao , Junren Xiao , Qingqiang Sun , Meng Xiao , Xiao Luo , Hui Xiong

Online recommendation requires handling rapidly changing user preferences. Deep reinforcement learning (DRL) is gaining interest as an effective means of capturing users' dynamic interest during interactions with recommender systems.…

Information Retrieval · Computer Science 2021-10-22 Xiaocong Chen , Lina Yao , Xianzhi Wang , Julian McAuley

While large language models excel in diverse domains, their performance on complex longhorizon agentic decision-making tasks remains limited. Most existing methods concentrate on designing effective reward models (RMs) to advance…

Machine Learning · Computer Science 2026-03-20 Zhicong Lu , Zichuan Lin , Wei Jia , Changyuan Tian , Deheng Ye , Peiguang Li , Li Jin , Nayu Liu , Guangluan Xu , Wei Feng

Meta-reinforcement learning (meta-RL) has proven to be a successful framework for leveraging experience from prior tasks to rapidly learn new related tasks, however, current meta-RL approaches struggle to learn in sparse reward…

Artificial Intelligence · Computer Science 2021-12-03 Charles Packer , Pieter Abbeel , Joseph E. Gonzalez

The experience replay mechanism allows agents to use the experiences multiple times. In prior works, the sampling probability of the transitions was adjusted according to their importance. Reassigning sampling probabilities for every…

Machine Learning · Computer Science 2021-11-15 Dogan C. Cicek , Enes Duran , Baturay Saglam , Furkan B. Mutlu , Suleyman S. Kozat

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for post-training reasoning models. However, group-based methods such as Group Relative Policy Optimization (GRPO) face a critical dilemma in…

Machine Learning · Computer Science 2026-04-07 Yuning Wu , Ke Wang , Devin Chen , Kai Wei

Reinforcement learning has shown great potential in solving complex tasks when large amounts of data can be generated with little effort. In robotics, one approach to generate training data builds on simulations based on dynamics models…

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

Actor learning and critic learning are two components of the outstanding and mostly used Deep Deterministic Policy Gradient (DDPG) reinforcement learning method. Since actor and critic learning plays a significant role in the overall…

Robotics · Computer Science 2022-10-25 Adarsh Sehgal , Muskan Sehgal , Hung Manh La

The utilization of the experience replay mechanism enables agents to effectively leverage their experiences on several occasions. In previous studies, the sampling probability of the transitions was modified based on their relative…

Machine Learning · Computer Science 2024-06-14 Arda Sarp Yenicesu , Furkan B. Mutlu , Suleyman S. Kozat , Ozgur S. Oguz