English
Related papers

Related papers: Hierarchical and Partially Observable Goal-driven …

200 papers

Effective governance and steering of behavior in complex multi-agent systems (MAS) are essential for managing system-wide outcomes, particularly in environments where interactions are structured by dynamic networks. In many applications,…

Machine Learning · Computer Science 2024-11-01 Qiliang Chen , Babak Heydari

Recently, graph-based planning algorithms have gained much attention to solve goal-conditioned reinforcement learning (RL) tasks: they provide a sequence of subgoals to reach the target-goal, and the agents learn to execute…

Machine Learning · Computer Science 2023-03-21 Junsu Kim , Younggyo Seo , Sungsoo Ahn , Kyunghwan Son , Jinwoo Shin

We present a two-step hybrid reinforcement learning (RL) policy that is designed to generate interpretable and robust hierarchical policies on the RL problem with graph-based input. Unlike prior deep reinforcement learning policies…

Machine Learning · Computer Science 2022-10-20 Tongzhou Mu , Kaixiang Lin , Feiyang Niu , Govind Thattai

Deep reinforcement learning provides a promising approach for text-based games in studying natural language communication between humans and artificial agents. However, the generalization still remains a big challenge as the agents depend…

Computation and Language · Computer Science 2021-09-22 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Chengqi Zhang

In many real-world scenarios, an autonomous agent often encounters various tasks within a single complex environment. We propose to build a graph abstraction over the environment structure to accelerate the learning of these tasks. Here,…

Machine Learning · Computer Science 2019-07-02 Wenling Shang , Alex Trott , Stephan Zheng , Caiming Xiong , Richard Socher

The goal of object navigation is to reach the expected objects according to visual information in the unseen environments. Previous works usually implement deep models to train an agent to predict actions in real-time. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Sixian Zhang , Xinhang Song , Yubing Bai , Weijie Li , Yakui Chu , Shuqiang Jiang

Robots have been successfully used to perform tasks with high precision. In real-world environments with sparse rewards and multiple goals, learning is still a major challenge and Reinforcement Learning (RL) algorithms fail to learn good…

Robotics · Computer Science 2023-08-21 Tejaswini Manjunath , Mozhgan Navardi , Prakhar Dixit , Bharat Prakash , Tinoosh Mohsenin

The integration of graphs with Goal-conditioned Hierarchical Reinforcement Learning (GCHRL) has recently gained attention, as intermediate goals (subgoals) can be effectively sampled from graphs that naturally represent the overall task…

Machine Learning · Computer Science 2025-11-17 Shuyuan Zhang , Zihan Wang , Xiao-Wen Chang , Doina Precup

Visual relations form the basis of understanding our compositional world, as relationships between visual objects capture key information in a scene. It is then advantageous to learn relations automatically from the data, as learning with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Daniel Zeng , Tailin Wu , Jure Leskovec

Real-world tasks are often highly structured. Hierarchical reinforcement learning (HRL) has attracted research interest as an approach for leveraging the hierarchical structure of a given task in reinforcement learning (RL). However,…

Machine Learning · Computer Science 2019-03-08 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

Graph representation learning has drawn increasing attention in recent years, especially for learning the low dimensional embedding at both node and graph level for classification and recommendations tasks. To enable learning the…

Machine Learning · Computer Science 2022-01-20 Tiehua Zhang , Yuze Liu , Xin Chen , Xiaowei Huang , Feng Zhu , Xi Zheng

The 3D scene graph models spatial relationships between objects, enabling the agent to efficiently navigate in a partially observable environment and predict the location of the target object.This paper proposes an original framework named…

Robotics · Computer Science 2025-06-06 Nikita Oskolkov , Huzhenyu Zhang , Dmitry Makarov , Dmitry Yudin , Aleksandr Panov

Objects rarely sit in isolation in human environments. As such, we'd like our robots to reason about how multiple objects relate to one another and how those relations may change as the robot interacts with the world. To this end, we…

Robotics · Computer Science 2023-03-20 Yixuan Huang , Adam Conkey , Tucker Hermans

Offline goal-conditioned reinforcement learning (GCRL) often struggles with long-horizon tasks, where errors in value estimation accumulate and produce unreliable policies. It is typically assumed that effective long-term planning is…

Machine Learning · Computer Science 2026-05-26 Evgenii Opryshko , Junwei Quan , Claas Voelcker , Yilun Du , Igor Gilitschenski

Hierarchical reinforcement learning has been a compelling approach for achieving goal directed behavior over long sequences of actions. However, it has been challenging to implement in realistic or open-ended environments. A main challenge…

Machine Learning · Computer Science 2023-09-22 Arun Ahuja , Kavya Kopparapu , Rob Fergus , Ishita Dasgupta

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Machine Learning · Computer Science 2024-06-25 Vivienne Huiling Wang , Tinghuai Wang , Wenyan Yang , Joni-Kristian Kämäräinen , Joni Pajarinen

Offline goal-conditioned reinforcement learning (GCRL) is a promising approach for pretraining generalist policies on large datasets of reward-free trajectories, akin to the self-supervised objectives used to train foundation models for…

Machine Learning · Computer Science 2026-01-05 John L. Zhou , Jonathan C. Kao

We propose a novel framework to identify sub-goals useful for exploration in sequential decision making tasks under partial observability. We utilize the variational intrinsic control framework (Gregor et.al., 2016) which maximizes…

Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless collaboration among agents, often represented by an underlying relation graph. Existing methods for learning this graph primarily focus on agent-pair relations,…

Machine Learning · Computer Science 2026-04-13 Wei Duan , Jie Lu , Junyu Xuan

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang