English
Related papers

Related papers: Test-Time Graph Search for Goal-Conditioned Reinfo…

200 papers

Many AI problems, in robotics and other domains, are goal-based, essentially seeking trajectories leading to various goal states. Reinforcement learning (RL), building on Bellman's optimality equation, naturally optimizes for a single goal,…

Artificial Intelligence · Computer Science 2020-12-22 Tom Jurgenson , Or Avner , Edward Groshev , Aviv Tamar

Reinforcement Learning (RL) algorithms often struggle with low training efficiency. A common approach to address this challenge is integrating model-based planning algorithms, such as Monte Carlo Tree Search (MCTS) or Value Iteration (VI),…

Machine Learning · Computer Science 2025-01-08 Zidu Yin , Zhen Zhang , Dong Gong , Stefano V. Albrecht , Javen Q. Shi

Goal-conditioned reinforcement learning (GCRL) with sparse rewards remains a fundamental challenge in reinforcement learning. While hindsight experience replay (HER) has shown promise by relabeling collected trajectories with achieved…

Machine Learning · Computer Science 2025-08-11 Xing Lei , Wenyan Yang , Kaiqiang Ke , Shentao Yang , Xuetao Zhang , Joni Pajarinen , Donglin Wang

Offline Goal-Conditioned Reinforcement Learning (GCRL) holds great promise for domains such as autonomous navigation and locomotion, where collecting interactive data is costly and unsafe. However, it remains challenging in practice due to…

Machine Learning · Computer Science 2025-10-10 Vittorio Giammarino , Ruiqi Ni , Ahmed H. Qureshi

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Offline goal-conditioned reinforcement learning remains challenging for long-horizon tasks. While hierarchical approaches mitigate this issue by decomposing tasks, most existing methods rely on separate high- and low-level networks and…

Machine Learning · Computer Science 2026-02-04 Jinwoo Choi , Sang-Hyun Lee , Seung-Woo Seo

Offline goal-conditioned reinforcement learning (GCRL) can be challenging due to overfitting to the given dataset. To generalize agents' skills outside the given dataset, we propose a goal-swapping procedure that generates additional…

Machine Learning · Computer Science 2023-02-20 Wenyan Yang , Huiling Wang , Dingding Cai , Joni Pajarinen , Joni-Kristen Kämäräinen

Operating in the real-world often requires agents to learn about a complex environment and apply this understanding to achieve a breadth of goals. This problem, known as goal-conditioned reinforcement learning (GCRL), becomes especially…

Machine Learning · Computer Science 2021-11-19 Christopher Hoang , Sungryull Sohn , Jongwook Choi , Wilka Carvalho , Honglak Lee

Self-supervision has the potential to transform reinforcement learning (RL), paralleling the breakthroughs it has enabled in other areas of machine learning. While self-supervised learning in other domains aims to find patterns in a fixed…

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

Goal-conditioned and Multi-Task Reinforcement Learning (GCRL and MTRL) address numerous problems related to robot learning, including locomotion, navigation, and manipulation scenarios. Recent works focusing on language-defined robotic…

Computation and Language · Computer Science 2023-06-21 Julien Perez , Denys Proux , Claude Roux , Michael Niemaz

Recent advancements in reasoning abilities of Large Language Models (LLM) has promoted their usage in problems that require high-level planning for robots and artificial agents. However, current techniques that utilize LLMs for such…

Artificial Intelligence · Computer Science 2023-10-17 Yash Shukla , Wenchang Gao , Vasanth Sarathy , Alvaro Velasquez , Robert Wright , Jivko Sinapov

We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale,…

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Reinforcement Learning has received wide interest due to its success in competitive games. Yet, its adoption in everyday applications is limited (e.g. industrial, home, healthcare, etc.). In this paper, we address this limitation by…

Robotics · Computer Science 2023-06-26 Ben-ya Halevy , Yehudit Aperstein , Dotan Di Castro

Hierarchical goal-conditioned reinforcement learning (H-GCRL) provides a powerful framework for tackling complex, long-horizon tasks by decomposing them into structured subgoals. However, its practical adoption is hindered by poor data…

Robotics · Computer Science 2026-02-12 Shaswat Garg , Matin Moezzi , Brandon Da Silva

Large language models (LLMs) excel in tasks like question answering and dialogue, but complex tasks requiring interaction, such as negotiation and persuasion, require additional long-horizon reasoning and planning. Reinforcement learning…

Computation and Language · Computer Science 2025-12-04 Joey Hong , Anca Dragan , Sergey Levine

Meta-reinforcement learning (RL) methods can meta-train policies that adapt to new tasks with orders of magnitude less data than standard RL, but meta-training itself is costly and time-consuming. If we can meta-train on offline data, then…

Machine Learning · Computer Science 2022-07-08 Vitchyr H. Pong , Ashvin Nair , Laura Smith , Catherine Huang , Sergey Levine

Offline Goal-Conditioned Reinforcement Learning (GCRL) is tasked with learning to achieve multiple goals in an environment purely from offline datasets using sparse reward functions. Offline GCRL is pivotal for developing generalist agents…

Machine Learning · Computer Science 2024-03-01 Harshit Sikchi , Rohan Chitnis , Ahmed Touati , Alborz Geramifard , Amy Zhang , Scott Niekum

Goal-conditioned (GC) policy learning often faces a challenge arising from the sparsity of rewards, when confronting long-horizon goals. To address the challenge, we explore skill-based GC policy learning in offline settings, where skills…

Machine Learning · Computer Science 2024-08-22 Donghoon Kim , Minjong Yoo , Honguk Woo