中文
相关论文

相关论文: Next-Future: Sample-Efficient Policy Learning for …

200 篇论文

Complex sequential tasks in continuous-control settings often require agents to successfully traverse a set of "narrow passages" in their state space. Solving such tasks with a sparse reward in a sample-efficient manner poses a challenge to…

机器人学 · 计算机科学 2022-03-23 Todor Davchev , Oleg Sushkov , Jean-Baptiste Regli , Stefan Schaal , Yusuf Aytar , Markus Wulfmeier , Jon Scholz

Multi-task reinforcement learning (RL) aims to simultaneously learn policies for solving many tasks. Several prior works have found that relabeling past experience with different reward functions can improve sample efficiency. Relabeling…

机器学习 · 计算机科学 2020-02-26 Benjamin Eysenbach , Xinyang Geng , Sergey Levine , Ruslan Salakhutdinov

Sparse reward is one of the most challenging problems in reinforcement learning (RL). Hindsight Experience Replay (HER) attempts to address this issue by converting a failed experience to a successful one by relabeling the goals. Despite…

机器学习 · 计算机科学 2019-02-13 Harris Chan , Yuhuai Wu , Jamie Kiros , Sanja Fidler , Jimmy Ba

This paper presents CONTHER, a novel reinforcement learning algorithm designed to efficiently and rapidly train robotic agents for goal-oriented manipulation tasks and obstacle avoidance. The algorithm uses a modified replay buffer inspired…

机器人学 · 计算机科学 2025-03-21 Maria Makarova , Qian Liu , Dzmitry Tsetserukou

Solving goal-oriented tasks is an important but challenging problem in reinforcement learning (RL). For such tasks, the rewards are often sparse, making it difficult to learn a policy effectively. To tackle this difficulty, we propose a new…

机器学习 · 计算机科学 2019-11-04 Hao Sun , Zhizhong Li , Xiaotong Liu , Dahua Lin , Bolei Zhou

In this paper, we propose a novel technique, Back-stepping Experience Replay (BER), that is compatible with arbitrary off-policy reinforcement learning (RL) algorithms. BER aims to enhance learning efficiency in systems with approximate…

机器人学 · 计算机科学 2024-09-25 Xinda Qi , Dong Chen , Zhaojian Li , Xiaobo Tan

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

系统与控制 · 电气工程与系统科学 2021-06-08 Myoung Hoon Lee , Jun Moon

Even though reinforcement-learning-based algorithms achieved superhuman performance in many domains, the field of robotics poses significant challenges as the state and action spaces are continuous, and the reward function is predominantly…

We present a novel technique called Dynamic Experience Replay (DER) that allows Reinforcement Learning (RL) algorithms to use experience replay samples not only from human demonstrations but also successful transitions generated by RL…

人工智能 · 计算机科学 2020-10-19 Jieliang Luo , Hui Li

This paper deals with robotic lever control using Explainable Deep Reinforcement Learning. First, we train a policy by using the Deep Deterministic Policy Gradient algorithm and the Hindsight Experience Replay technique, where the goal is…

机器人学 · 计算机科学 2021-10-08 Sindre Benjamin Remman , Anastasios M. Lekkas

Reinforcement learning (RL) has achieved some impressive recent successes in various computer games and simulations. Most of these successes are based on having large numbers of episodes from which the agent can learn. In typical robotic…

机器人学 · 计算机科学 2024-01-05 Jonas Tebbe , Lukas Krauch , Yapeng Gao , Andreas Zell

This work is inspired by recent advances in hierarchical reinforcement learning (HRL) (Barto and Mahadevan 2003; Hengst 2010), and improvements in learning efficiency from heuristic-based subgoal selection, experience replay (Lin 1993;…

人工智能 · 计算机科学 2020-09-30 Xinyi Xu , Tiancheng Huang , Pengfei Wei , Akshay Narayan , Tze-Yun Leong

This paper presents a benchmarking study of some of the state-of-the-art reinforcement learning algorithms used for solving two simulated vision-based robotics problems. The algorithms considered in this study include soft actor-critic…

机器人学 · 计算机科学 2022-01-13 Swagat Kumar , Hayden Sampson , Ardhendu Behera

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

机器学习 · 计算机科学 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

Reinforcement learning (RL) presents a promising framework to learn policies through environment interaction, but often requires an infeasible amount of interaction data to solve complex tasks from sparse rewards. One direction includes…

机器学习 · 计算机科学 2024-05-07 Stone Tao , Arth Shukla , Tse-kai Chan , Hao Su

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for post-training reasoning models. However, group-based methods such as Group Relative Policy Optimization (GRPO) face a critical dilemma in…

机器学习 · 计算机科学 2026-04-07 Yuning Wu , Ke Wang , Devin Chen , Kai Wei

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Experience replay (ER) is a fundamental component of off-policy deep reinforcement learning (RL). ER recalls experiences from past iterations to compute gradient estimates for the current policy, increasing data-efficiency. However, the…

机器学习 · 计算机科学 2019-05-21 Guido Novati , Petros Koumoutsakos

Reinforcement learning has shown great potential in solving complex tasks when large amounts of data can be generated with little effort. In robotics, one approach to generate training data builds on simulations based on dynamics models…

机器人学 · 计算机科学 2023-03-10 Simon Guist , Jan Schneider , Alexander Dittrich , Vincent Berenz , Bernhard Schölkopf , Dieter Büchler