English
Related papers

Related papers: Data-Efficient Hierarchical Goal-Conditioned Reinf…

200 papers

Offline Goal-Conditioned Reinforcement Learning (GCRL) holds great promise for domains such as autonomous navigation and locomotion, where collecting interactive data is costly and unsafe. However, it remains challenging in practice due to…

Machine Learning · Computer Science 2025-10-10 Vittorio Giammarino , Ruiqi Ni , Ahmed H. Qureshi

Goal-conditioned hierarchical reinforcement learning (HRL) decomposes complex reaching tasks into a sequence of simple subgoal-conditioned tasks, showing significant promise for addressing long-horizon planning in large-scale environments.…

Machine Learning · Computer Science 2025-04-15 Haoran Wang , Yaoru Sun , Zeshen Tang , Haibo Shi , Chenyuan Jiao

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Offline Goal-Conditioned RL (GCRL) offers a feasible paradigm for learning general-purpose policies from diverse and multi-task offline datasets. Despite notable recent progress, the predominant offline GCRL methods, mainly model-free, face…

Machine Learning · Computer Science 2024-05-17 Mianchu Wang , Rui Yang , Xi Chen , Hao Sun , Meng Fang , Giovanni Montana

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

Normalizing flows have recently demonstrated promising results for low-level vision tasks. For image super-resolution (SR), it learns to predict diverse photo-realistic high-resolution (HR) images from the low-resolution (LR) image rather…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Jingyun Liang , Andreas Lugmayr , Kai Zhang , Martin Danelljan , Luc Van Gool , Radu Timofte

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

Machine Learning · Computer Science 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

A novel class of advanced algorithms, termed Goal-Conditioned Weighted Supervised Learning (GCWSL), has recently emerged to tackle the challenges posed by sparse rewards in goal-conditioned reinforcement learning (RL). GCWSL consistently…

Machine Learning · Computer Science 2025-06-10 Xing Lei , Xuetao Zhang , Zifeng Zhuang , Donglin Wang

In advancing the understanding of natural decision-making processes, inverse reinforcement learning (IRL) methods have proven instrumental in reconstructing animal's intentions underlying complex behaviors. Given the recent development of a…

Machine Learning · Computer Science 2024-09-11 Hao Zhu , Brice De La Crompe , Gabriel Kalweit , Artur Schneider , Maria Kalweit , Ilka Diester , Joschka Boedecker

Most meta reinforcement learning (meta-RL) methods learn to adapt to new tasks by directly optimizing the parameters of policies over primitive action space. Such algorithms work well in tasks with relatively slight difference. However,…

Machine Learning · Computer Science 2020-03-05 Haotian Fu , Hongyao Tang , Jianye Hao , Wulong Liu , Chen Chen

Off-policy, value-based reinforcement learning methods such as Q-learning are appealing because they can learn from arbitrary experience, including data collected by older policies or other agents. In practice, however, bootstrapping makes…

Artificial Intelligence · Computer Science 2026-05-12 Armaan A. Abraham , Lucy Xiaoyang Shi , Chelsea Finn

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Image and video generative models that are pre-trained on Internet-scale data can greatly increase the generalization capacity of robot learning systems. These models can function as high-level planners, generating intermediate subgoals for…

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

Machine Learning · Computer Science 2023-12-20 Lisheng Wu , Ke Chen

Offline goal-conditioned reinforcement learning (GCRL) promises general-purpose skill learning in the form of reaching diverse goals from purely offline datasets. We propose $\textbf{Go}$al-conditioned $f$-$\textbf{A}$dvantage…

Machine Learning · Computer Science 2022-11-11 Yecheng Jason Ma , Jason Yan , Dinesh Jayaraman , Osbert Bastani

Hierarchical reinforcement learning (HRL) holds great potential for sample-efficient learning on challenging long-horizon tasks. In particular, letting a higher level assign subgoals to a lower level has been shown to enable fast learning…

Machine Learning · Computer Science 2021-12-07 Nico Gürtler , Dieter Büchler , Georg Martius

Offline goal-conditioned reinforcement learning (GCRL) aims at solving goal-reaching tasks with sparse rewards from an offline dataset. While prior work has demonstrated various approaches for agents to learn near-optimal policies, these…

Robotics · Computer Science 2024-03-05 Chenyang Cao , Zichen Yan , Renhao Lu , Junbo Tan , Xueqian Wang

Offline goal-conditioned reinforcement learning (GCRL) often struggles with long-horizon tasks, where errors in value estimation accumulate and produce unreliable policies. It is typically assumed that effective long-term planning is…

Machine Learning · Computer Science 2026-05-26 Evgenii Opryshko , Junwei Quan , Claas Voelcker , Yilun Du , Igor Gilitschenski

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Machine Learning · Computer Science 2024-06-25 Vivienne Huiling Wang , Tinghuai Wang , Wenyan Yang , Joni-Kristian Kämäräinen , Joni Pajarinen

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao