English
Related papers

Related papers: Landmark Guided Active Exploration with State-spec…

200 papers

Goal-conditioned reinforcement learning (RL) is a promising direction for training agents that are capable of solving multiple tasks and reach a diverse set of objectives. How to \textit{specify} and \textit{ground} these goals in such a…

Approaches for goal-conditioned reinforcement learning (GCRL) often use learned state representations to extract goal-reaching policies. Two frameworks for representation structure have yielded particularly effective GCRL algorithms: (1)…

Machine Learning · Computer Science 2025-12-03 Vivek Myers , Bill Chunyuan Zheng , Benjamin Eysenbach , Sergey Levine

Hierarchical reinforcement learning (HRL) proposes to solve difficult tasks by performing decision-making and control at successively higher levels of temporal abstraction. However, off-policy HRL often suffers from the problem of a…

Machine Learning · Computer Science 2023-03-14 Vivienne Huiling Wang , Joni Pajarinen , Tinghuai Wang , Joni-Kristian Kämäräinen

Offline goal-conditioned reinforcement learning (GCRL) offers a practical learning paradigm in which goal-reaching policies are trained from abundant state-action trajectory datasets without additional environment interaction. However,…

Machine Learning · Computer Science 2025-11-05 Hongjoon Ahn , Heewoong Choi , Jisu Han , Taesup Moon

In this work, we introduce dual goal representations for goal-conditioned reinforcement learning (GCRL). A dual goal representation characterizes a state by "the set of temporal distances from all other states"; in other words, it encodes a…

Machine Learning · Computer Science 2026-02-17 Seohong Park , Deepinder Mann , Sergey Levine

We propose an exploration method that incorporates look-ahead search over basic learnt skills and their dynamics, and use it for reinforcement learning (RL) of manipulation policies . Our skills are multi-goal policies learned in isolation…

Robotics · Computer Science 2018-11-21 Arpit Agarwal , Katharina Muelling , Katerina Fragkiadaki

Goal-conditioned reinforcement learning (GCRL) allows agents to learn diverse objectives using a unified policy. The success of GCRL, however, is contingent on the choice of goal representation. In this work, we propose a mask-based goal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fahim Shahriar , Cheryl Wang , Alireza Azimi , Gautham Vasan , Hany Hamed Elanwar , A. Rupam Mahmood , Colin Bellinger

In recent years Landmark Complexes have been successfully employed for localization-free and metric-free autonomous exploration using a group of sensing-limited and communication-limited robots in a GPS-denied environment. To ensure rapid…

Robotics · Computer Science 2022-09-27 Xiatao Sun , Yuwei Wu , Subhrajit Bhattacharya , Vijay Kumar

Numerous deep reinforcement learning agents have been proposed, and each of them has its strengths and flaws. In this work, we present a Cooperative Heterogeneous Deep Reinforcement Learning (CHDRL) framework that can learn a policy by…

Machine Learning · Computer Science 2020-11-03 Han Zheng , Pengfei Wei , Jing Jiang , Guodong Long , Qinghua Lu , Chengqi Zhang

Hierarchical reinforcement learning (HRL) effectively improves agents' exploration efficiency on tasks with sparse reward, with the guide of high-quality hierarchical structures (e.g., subgoals or options). However, how to automatically…

Machine Learning · Computer Science 2022-10-14 Shaohui Peng , Xing Hu , Rui Zhang , Ke Tang , Jiaming Guo , Qi Yi , Ruizhi Chen , Xishan Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Goal-conditioned reinforcement learning (GCRL) with sparse rewards remains a fundamental challenge in reinforcement learning. While hindsight experience replay (HER) has shown promise by relabeling collected trajectories with achieved…

Machine Learning · Computer Science 2025-08-11 Xing Lei , Wenyan Yang , Kaiqiang Ke , Shentao Yang , Xuetao Zhang , Joni Pajarinen , Donglin Wang

Reinforcement learning has empowered large language models to act as intelligent agents, yet training them for long-horizon tasks remains challenging due to the scarcity of high-quality trajectories, especially under limited resources.…

Machine Learning · Computer Science 2026-01-29 Jinyang Wu , Shuo Yang , Changpeng Yang , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Goal-Conditioned Reinforcement Learning (GCRL) mitigates the difficulty of reward design by framing tasks as goal reaching rather than maximizing hand-crafted reward signals. In this setting, the optimal goal-conditioned value function…

Machine Learning · Computer Science 2026-03-03 Vittorio Giammarino , Ahmed H. Qureshi

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2024-12-20 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Exploring unknown environments efficiently is a fundamental challenge in unsupervised goal-conditioned reinforcement learning. While selecting exploratory goals at the frontier of previously explored states is an effective strategy, the…

Machine Learning · Computer Science 2024-11-05 Yuanlin Duan , Guofeng Cui , He Zhu

Model-based reinforcement learning (MBRL) has been a primary approach to ameliorating the sample efficiency issue as well as to make a generalist agent. However, there has not been much effort toward enhancing the strategy of dreaming…

Machine Learning · Computer Science 2024-06-05 Hany Hamed , Subin Kim , Dongyeong Kim , Jaesik Yoon , Sungjin Ahn

Transfer learning across different reinforcement learning (RL) tasks is becoming an increasingly valuable area of research. We consider a goal-based multi-task RL framework and mechanisms by which previously solved tasks can reduce sample…

Machine Learning · Computer Science 2019-07-02 Nick Denis

Offline goal-conditioned reinforcement learning (GCRL) often struggles with long-horizon tasks, where errors in value estimation accumulate and produce unreliable policies. It is typically assumed that effective long-term planning is…

Machine Learning · Computer Science 2026-05-26 Evgenii Opryshko , Junwei Quan , Claas Voelcker , Yilun Du , Igor Gilitschenski

Goal-conditioned reinforcement learning (GCRL) has a wide range of potential real-world applications, including manipulation and navigation problems in robotics. Especially in such robotics tasks, sample efficiency is of the utmost…

Machine Learning · Computer Science 2023-01-23 Bo Liu , Yihao Feng , Qiang Liu , Peter Stone