English
Related papers

Related papers: Landmark-Guided Subgoal Generation in Hierarchical…

200 papers

The integration of graphs with Goal-conditioned Hierarchical Reinforcement Learning (GCHRL) has recently gained attention, as intermediate goals (subgoals) can be effectively sampled from graphs that naturally represent the overall task…

Machine Learning · Computer Science 2025-11-17 Shuyuan Zhang , Zihan Wang , Xiao-Wen Chang , Doina Precup

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

Humans are able to understand and perform complex tasks by strategically structuring the tasks into incremental steps or subgoals. For a robot attempting to learn to perform a sequential task with critical subgoal states, such states can…

Human-Computer Interaction · Computer Science 2018-06-25 Xinlei Pan , Eshed Ohn-Bar , Nicholas Rhinehart , Yan Xu , Yilin Shen , Kris M. Kitani

Hierarchical reinforcement learning (HRL) provides a promising solution for complex tasks with sparse rewards of intelligent agents, which uses a hierarchical framework that divides tasks into subgoals and completes them sequentially.…

Artificial Intelligence · Computer Science 2024-11-28 Xinglin Zhou , Yifu Yuan , Shaofu Yang , Jianye Hao

Goal-conditioned hierarchical reinforcement learning (HRL) decomposes complex reaching tasks into a sequence of simple subgoal-conditioned tasks, showing significant promise for addressing long-horizon planning in large-scale environments.…

Machine Learning · Computer Science 2025-04-15 Haoran Wang , Yaoru Sun , Zeshen Tang , Haibo Shi , Chenyuan Jiao

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2024-12-20 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Large language model (LLM) agents have demonstrated strong capabilities in complex interactive decision-making tasks. However, existing LLM agents typically rely on increasingly long interaction histories, resulting in high computational…

Artificial Intelligence · Computer Science 2026-04-16 Shuai Zhen , Yanhua Yu , Ruopei Guo , Nan Cheng , Yang Deng

Offline goal-conditioned reinforcement learning (GCRL) is a promising approach for pretraining generalist policies on large datasets of reward-free trajectories, akin to the self-supervised objectives used to train foundation models for…

Machine Learning · Computer Science 2026-01-05 John L. Zhou , Jonathan C. Kao

Real-world decision-making tasks typically occur in complex and open environments, posing significant challenges to reinforcement learning (RL) agents' exploration efficiency and long-horizon planning capabilities. A promising approach is…

Machine Learning · Computer Science 2025-09-29 Yajie Qi , Wei Wei , Lin Li , Lijun Zhang , Zhidong Gao , Da Wang , Huizhong Song

Robots have been successfully used to perform tasks with high precision. In real-world environments with sparse rewards and multiple goals, learning is still a major challenge and Reinforcement Learning (RL) algorithms fail to learn good…

Robotics · Computer Science 2023-08-21 Tejaswini Manjunath , Mozhgan Navardi , Prakhar Dixit , Bharat Prakash , Tinoosh Mohsenin

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

Reinforcement Learning (RL) with rubric-based rewards has recently shown remarkable progress in enhancing general reasoning capabilities of Large Language Models (LLMs), yet still suffers from ineffective exploration confined to curent…

Artificial Intelligence · Computer Science 2026-03-23 Wenjian Zhang , Kongcheng Zhang , Jiaxin Qi , Baisheng Lai , Jianqiang Huang

Offline goal-conditioned reinforcement learning (GCRL) is challenging in long-horizon tasks, where distant state--goal pairs provide weak supervision and value estimates become vulnerable to accumulated bootstrapping errors. Hierarchical…

Machine Learning · Computer Science 2026-05-28 Kaiqiang Ke , Shenghong He , Chengdong Xu , Yuheng Luo , Xiangyuan Lan , Chao Yu

In this paper, we present a hierarchical path planning framework called SG-RL (subgoal graphs-reinforcement learning), to plan rational paths for agents maneuvering in continuous and uncertain environments. By "rational", we mean (1)…

Artificial Intelligence · Computer Science 2019-04-05 Junjie Zeng , Long Qin , Yue Hu , Cong Hu , Quanjun Yin

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

Artificial Intelligence · Computer Science 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang

Exploration in environments with sparse rewards remains a fundamental challenge in reinforcement learning (RL). Existing approaches such as curriculum learning and Go-Explore often rely on hand-crafted heuristics, while curiosity-driven…

Machine Learning · Computer Science 2026-02-03 Georgios Sotirchos , Zlatan Ajanović , Jens Kober

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Large Language Models (LLMs) have shown remarkable promise in reasoning and decision-making, yet their integration with Reinforcement Learning (RL) for complex robotic tasks remains underexplored. In this paper, we propose an LLM-guided…

Machine Learning · Computer Science 2025-03-26 Chak Lam Shek , Pratap Tokekar

The recommender system is an important form of intelligent application, which assists users to alleviate from information redundancy. Among the metrics used to evaluate a recommender system, the metric of conversion has become more and more…

Machine Learning · Computer Science 2019-03-25 Dongyang Zhao , Liang Zhang , Bo Zhang , Lizhou Zheng , Yongjun Bao , Weipeng Yan