中文
相关论文

相关论文: ACDER: Augmented Curiosity-Driven Experience Repla…

200 篇论文

Solving multi-goal reinforcement learning (RL) problems with sparse rewards is generally challenging. Existing approaches have utilized goal relabeling on collected experiences to alleviate issues raised from sparse rewards. However, these…

机器学习 · 计算机科学 2021-11-30 Rui Yang , Meng Fang , Lei Han , Yali Du , Feng Luo , Xiu Li

Exploration of the high-dimensional state action space is one of the biggest challenges in Reinforcement Learning (RL), especially in multi-agent domain. We present a novel technique called Experience Augmentation, which enables a…

机器学习 · 计算机科学 2020-05-21 Zhenhui Ye , Yining Chen , Guanghua Song , Bowei Yang , Shen Fan

Actor-critic (AC) algorithms are a class of model-free deep reinforcement learning algorithms, which have proven their efficacy in diverse domains, especially in solving continuous control problems. Improvement of exploration (action…

机器学习 · 计算机科学 2022-10-04 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Experience replay (ER) improves the data efficiency of off-policy reinforcement learning (RL) algorithms by allowing an agent to store and reuse its past experiences in a replay buffer. While many techniques have been proposed to enhance ER…

机器学习 · 计算机科学 2021-04-06 Yunshu Du , Garrett Warnell , Assefaw Gebremedhin , Peter Stone , Matthew E. Taylor

Continual lifelong learning is an machine learning framework inspired by human learning, where learners are trained to continuously acquire new knowledge in a sequential manner. However, the non-stationary nature of streaming training data…

机器学习 · 计算机科学 2024-05-14 Xingyu Li , Bo Tang , Haifeng Li

As modern games continue growing both in size and complexity, it has become more challenging to ensure that all the relevant content is tested and that any potential issue is properly identified and fixed. Attempting to maximize testing…

机器学习 · 计算机科学 2021-06-25 Camilo Gordillo , Joakim Bergdahl , Konrad Tollmar , Linus Gisslén

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

人工智能 · 计算机科学 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Replay (HER) has been…

人工智能 · 计算机科学 2020-02-07 Qiwei He , Liansheng Zhuang , Houqiang Li

Dealing with sparse rewards is one of the biggest challenges in Reinforcement Learning (RL). We present a novel technique called Hindsight Experience Replay which allows sample-efficient learning from rewards which are sparse and binary and…

Sparse rewards pose a significant challenge to achieving high sample efficiency in goal-conditioned reinforcement learning (RL). Specifically, in sequential manipulation tasks, the agent receives failure rewards until it successfully…

机器人学 · 计算机科学 2024-06-24 Yuming Huang , Bin Ren , Ziming Xu , Lianghong Wu

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

机器学习 · 计算机科学 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Hindsight Experience Replay (HER) is widely regarded as the state-of-the-art algorithm for achieving sample-efficient multi-goal reinforcement learning (RL) in robotic manipulation tasks with binary rewards. HER facilitates learning from…

机器人学 · 计算机科学 2025-04-16 Fikrican Özgür , René Zurbrügg , Suryansh Kumar

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

机器学习 · 计算机科学 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

机器学习 · 计算机科学 2021-02-04 Mirza Ramicic , Andrea Bonarini

Efficient exploration has presented a long-standing challenge in reinforcement learning, especially when rewards are sparse. A developmental system can overcome this difficulty by learning from both demonstrations and self-exploration.…

机器学习 · 计算机科学 2021-02-19 Siqing Hou , Dongqi Han , Jun Tani

This paper introduces ACS2HER, a novel integration of the Anticipatory Classifier System (ACS2) with the Hindsight Experience Replay (HER) mechanism. While ACS2 is highly effective at building cognitive maps through latent learning, its…

机器学习 · 计算机科学 2026-01-15 Olgierd Unold , Stanisław Franczyk

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

机器学习 · 计算机科学 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

Combining off-policy reinforcement learning methods with function approximators such as neural networks has been found to lead to overestimation of the value function and sub-optimal solutions. Improvement such as TD3 has been proposed to…

机器学习 · 计算机科学 2021-09-09 Bo Zhou , Kejiao Li , Hongsheng Zeng , Fan Wang , Hao Tian

Hierarchical Reinforcement Learning (HRL) frameworks like Option-Critic (OC) and Multi-updates Option Critic (MOC) have introduced significant advancements in learning reusable options. However, these methods underperform in multi-goal…

Exploration strategy design is one of the challenging problems in reinforcement learning~(RL), especially when the environment contains a large state space or sparse rewards. During exploration, the agent tries to discover novel areas or…

机器学习 · 计算机科学 2019-06-07 Xiao Ma , Shen-Yi Zhao , Wu-Jun Li