中文
相关论文

相关论文: Probabilistic Subgoal Representations for Hierarch…

200 篇论文

We propose a hierarchical entity-centric framework for offline Goal-Conditioned Reinforcement Learning (GCRL) that combines subgoal decomposition with factored structure to solve long-horizon tasks in domains with multiple entities.…

机器学习 · 计算机科学 2026-02-04 Dan Haramati , Carl Qi , Tal Daniel , Amy Zhang , Aviv Tamar , George Konidaris

In this work, we introduce dual goal representations for goal-conditioned reinforcement learning (GCRL). A dual goal representation characterizes a state by "the set of temporal distances from all other states"; in other words, it encodes a…

机器学习 · 计算机科学 2026-02-17 Seohong Park , Deepinder Mann , Sergey Levine

We present a novel two-layer hierarchical reinforcement learning approach equipped with a Goals Relational Graph (GRG) for tackling the partially observable goal-driven task, such as goal-driven visual navigation. Our GRG captures the…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Xin Ye , Yezhou Yang

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning (RL). Nevertheless, it is unclear how improved representation learning can…

计算与语言 · 计算机科学 2024-10-25 Vaskar Nath , Dylan Slack , Jeff Da , Yuntao Ma , Hugh Zhang , Spencer Whitehead , Sean Hendryx

The optimal policy in various real-world strategic decision-making problems depends both on the environmental configuration and exogenous events. For these settings, we introduce Contextual Bilevel Reinforcement Learning (CB-RL), a…

最优化与控制 · 数学 2024-12-10 Vinzenz Thoma , Barna Pasztor , Andreas Krause , Giorgia Ramponi , Yifan Hu

Large Language Models (LLMs) have shown remarkable promise in reasoning and decision-making, yet their integration with Reinforcement Learning (RL) for complex robotic tasks remains underexplored. In this paper, we propose an LLM-guided…

机器学习 · 计算机科学 2025-03-26 Chak Lam Shek , Pratap Tokekar

Offline goal-conditioned reinforcement learning remains challenging for long-horizon tasks. While hierarchical approaches mitigate this issue by decomposing tasks, most existing methods rely on separate high- and low-level networks and…

机器学习 · 计算机科学 2026-02-04 Jinwoo Choi , Sang-Hyun Lee , Seung-Woo Seo

Advances in the field of inverse reinforcement learning (IRL) have led to sophisticated inference frameworks that relax the original modeling assumption of observing an agent behavior that reflects only a single intention. Instead of…

机器学习 · 计算机科学 2018-12-03 Adrian Šošić , Elmar Rueckert , Jan Peters , Abdelhak M. Zoubir , Heinz Koeppl

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

机器学习 · 计算机科学 2019-02-19 Saket Tiwari , M. Prannoy

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

人工智能 · 计算机科学 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang

Representation learning is a fundamental task in machine learning, aiming at uncovering structures from data to facilitate subsequent tasks. However, what is a good representation for planning and reasoning in a stochastic world remains an…

机器学习 · 计算机科学 2024-03-19 Meng Song

Reinforcement learning from human feedback (RLHF) has become a cornerstone for aligning large language models with human preferences. However, the heterogeneity of human feedback, driven by diverse individual contexts and preferences, poses…

机器学习 · 统计学 2026-03-05 Seong Jin Lee , Will Wei Sun , Yufeng Liu

The search for interpretable reinforcement learning policies is of high academic and industrial interest. Especially for industrial systems, domain experts are more likely to deploy autonomously learned controllers if they are…

人工智能 · 计算机科学 2018-04-05 Daniel Hein , Steffen Udluft , Thomas A. Runkler

Offline goal-conditioned reinforcement learning (GCRL) provides a practical framework for obtaining goal-reaching policies from fixed datasets. However, learning a reliable goal-conditioned value function in long-horizon tasks remains…

机器学习 · 计算机科学 2026-05-26 Hyungkyu Kang , Byeongchan Kim , Min-hwan Oh

Hierarchical reinforcement learning (HRL) enables agents to solve complex, long-horizon tasks by decomposing them into manageable sub-tasks. However, HRL methods face two fundamental challenges: (i) non-stationarity caused by the evolving…

In reinforcement learning (RL), it is easier to solve a task if given a good representation. While deep RL should automatically acquire such good representations, prior work often finds that learning representations in an end-to-end fashion…

机器学习 · 计算机科学 2023-02-21 Benjamin Eysenbach , Tianjun Zhang , Ruslan Salakhutdinov , Sergey Levine

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

机器学习 · 计算机科学 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

In many practical reinforcement learning tasks, feedback is only provided at the end of a long horizon, leading to sparse and delayed rewards. Existing reward redistribution methods typically assume that per-step rewards are independent,…

机器学习 · 计算机科学 2025-11-18 Minheng Xiao , Xian Yu

Video prediction models combined with planning algorithms have shown promise in enabling robots to learn to perform many vision-based tasks through only self-supervision, reaching novel goals in cluttered scenes with unseen objects.…

机器学习 · 计算机科学 2019-09-13 Suraj Nair , Chelsea Finn

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

机器人学 · 计算机科学 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li