English
Related papers

Related papers: Landmark Guided Active Exploration with State-spec…

200 papers

Solving goal-conditioned tasks with sparse rewards using self-supervised learning is promising because of its simplicity and stability over current reinforcement learning (RL) algorithms. A recent work, called Goal-Conditioned Supervised…

Machine Learning · Computer Science 2022-02-15 Rui Yang , Yiming Lu , Wenzhe Li , Hao Sun , Meng Fang , Yali Du , Xiu Li , Lei Han , Chongjie Zhang

Sparse-reward reinforcement learning (RL) can model a wide range of highly complex tasks. Solving sparse-reward tasks is RL's core premise, requiring efficient exploration coupled with long-horizon credit assignment, and overcoming these…

Machine Learning · Computer Science 2025-10-21 Leander Diaz-Bone , Marco Bagatella , Jonas Hübotter , Andreas Krause

Exploration is a key problem in reinforcement learning. Recently bonus-based methods have achieved considerable successes in environments where exploration is difficult such as Montezuma's Revenge, which assign additional bonuses (e.g.,…

Artificial Intelligence · Computer Science 2020-09-02 Yan Song , Yingfeng Chen , Yujing Hu , Changjie Fan

We consider a team of reinforcement learning agents that concurrently operate in a common environment, and we develop an approach to efficient coordinated exploration that is suitable for problems of practical scale. Our approach builds on…

Machine Learning · Computer Science 2018-12-18 Maria Dimakopoulou , Ian Osband , Benjamin Van Roy

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

Machine Learning · Computer Science 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

Reinforcement Learning (RL) has achieved significant success in solving single-goal tasks. However, uniform goal selection often results in sample inefficiency in multi-goal settings where agents must learn a universal goal-conditioned…

Machine Learning · Computer Science 2025-12-30 Gaurav Chaudhary , Laxmidhar Behera

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

Machine Learning · Computer Science 2025-09-09 Yang Yu

Goal-conditioned reinforcement learning (RL) can solve tasks in a wide range of domains, including navigation and manipulation, but learning to reach distant goals remains a central challenge to the field. Learning to reach such goals is…

Machine Learning · Computer Science 2021-10-26 Tianjun Zhang , Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine , Joseph E. Gonzalez

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

Machine Learning · Computer Science 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

Machine Learning · Computer Science 2021-10-14 Ammar Fayad , Majd Ibrahim

Reinforcement learning faces significant challenges when applied to tasks characterized by sparse reward structures. Although imitation learning, within the domain of supervised learning, offers faster convergence, it relies heavily on…

Machine Learning · Computer Science 2025-09-04 Zeqiang Zhang , Fabian Wurzberger , Gerrit Schmid , Sebastian Gottwald , Daniel A. Braun

Cooperative multi-agent reinforcement learning (MARL) requires agents to discover joint strategies in a combinatorially large state-action space, yet effective coordination configurations are exceedingly rare. Intrinsic motivation, which…

Multiagent Systems · Computer Science 2026-05-05 Dahyun Oh , Minhyuk Yoon , H. Jin Kim

Goal-conditioned hierarchical reinforcement learning (HRL) decomposes complex reaching tasks into a sequence of simple subgoal-conditioned tasks, showing significant promise for addressing long-horizon planning in large-scale environments.…

Machine Learning · Computer Science 2025-04-15 Haoran Wang , Yaoru Sun , Zeshen Tang , Haibo Shi , Chenyuan Jiao

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

Machine Learning · Computer Science 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

LLM-based agents have seen promising advances, yet they are still limited in "hard-exploration" tasks requiring learning new knowledge through exploration. We present GLoW, a novel approach leveraging dual-scale world models, maintaining a…

Computation and Language · Computer Science 2025-10-01 Minsoo Kim , Seung-won Hwang

Recently, graph-based planning algorithms have gained much attention to solve goal-conditioned reinforcement learning (RL) tasks: they provide a sequence of subgoals to reach the target-goal, and the agents learn to execute…

Machine Learning · Computer Science 2023-03-21 Junsu Kim , Younggyo Seo , Sungsoo Ahn , Kyunghwan Son , Jinwoo Shin

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

Goal-conditioned reinforcement learning is a crucial yet challenging algorithm which enables agents to achieve multiple user-specified goals when learning a set of skills in a dynamic environment. However, it typically requires millions of…

Robotics · Computer Science 2022-03-01 Zhifeng Qian , Mingyu You , Hongjun Zhou , Bin He

Unsupervised Reinforcement Learning (RL) provides a promising paradigm for learning useful behaviors via reward-free per-training. Existing methods for unsupervised RL mainly conduct empowerment-driven skill discovery or entropy-based…

Machine Learning · Computer Science 2024-05-28 Chenjia Bai , Rushuai Yang , Qiaosheng Zhang , Kang Xu , Yi Chen , Ting Xiao , Xuelong Li

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen