中文
相关论文

相关论文: Algorithms for Batch Hierarchical Reinforcement Le…

200 篇论文

Hierarchical Reinforcement Learning (HRL) enhances the scalability of decision-making in long-horizon tasks by introducing temporal abstraction through options-policies that span multiple timesteps. Despite its theoretical appeal, the…

机器学习 · 计算机科学 2025-10-30 Hemanath Arumugam , Falong Fan , Bo Liu

Hierarchical Imitation Learning (HIL) has been proposed to recover highly-complex behaviors in long-horizon tasks from expert demonstrations by modeling the task hierarchy with the option framework. Existing methods either overlook the…

机器学习 · 计算机科学 2023-05-29 Jiayu Chen , Tian Lan , Vaneet Aggarwal

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

机器学习 · 计算机科学 2024-09-02 Talha Bozkus , Urbashi Mitra

We introduce Hierarchical Transformers for Meta-Reinforcement Learning (HTrMRL), a powerful online meta-reinforcement learning approach. HTrMRL aims to address the challenge of enabling reinforcement learning agents to perform effectively…

机器学习 · 计算机科学 2024-02-12 Gresa Shala , André Biedenkapp , Josif Grabocka

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

机器学习 · 计算机科学 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

How do people decide how long to continue in a task, when to switch, and to which other task? Understanding the mechanisms that underpin task interleaving is a long-standing goal in the cognitive sciences. Prior work suggests greedy…

人工智能 · 计算机科学 2020-01-08 Christoph Gebhardt , Antti Oulasvirta , Otmar Hilliges

Deep reinforcement learning (DRL) is capable of learning high-performing policies on a variety of complex high-dimensional tasks, ranging from video games to robotic manipulation. However, standard DRL methods often suffer from poor sample…

机器学习 · 计算机科学 2020-03-04 Caleb Chuck , Supawit Chockchowwat , Scott Niekum

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

机器学习 · 计算机科学 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

机器学习 · 计算机科学 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

机器学习 · 计算机科学 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Reinforcement Learning (RL) based methods have been increasingly explored for robot learning. However, RL based methods often suffer from low sampling efficiency in the exploration phase, especially for long-horizon manipulation tasks, and…

机器人学 · 计算机科学 2024-12-31 Hao Zhang , Hao Wang , Xiucai Huang , Wenrui Chen , Zhen Kan

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

多智能体系统 · 计算机科学 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Hierarchical reinforcement learning (HRL) proposes to solve difficult tasks by performing decision-making and control at successively higher levels of temporal abstraction. However, off-policy HRL often suffers from the problem of a…

机器学习 · 计算机科学 2023-03-14 Vivienne Huiling Wang , Joni Pajarinen , Tinghuai Wang , Joni-Kristian Kämäräinen

Meta-Reinforcement Learning (Meta-RL) enables fast adaptation to new testing tasks. Despite recent advancements, it is still challenging to learn performant policies across multiple complex and high-dimensional tasks. To address this, we…

机器学习 · 计算机科学 2024-12-17 Minjae Cho , Chuangchuang Sun

Hierarchical Reinforcement Learning (HRL) exploits temporally extended actions, or options, to make decisions from a higher-dimensional perspective to alleviate the sparse reward problem, one of the most challenging problems in…

机器学习 · 计算机科学 2019-05-15 Libo Xing

In this work we present a novel approach to hierarchical reinforcement learning for linearly-solvable Markov decision processes. Our approach assumes that the state space is partitioned, and the subtasks consist in moving between the…

机器学习 · 计算机科学 2024-06-04 Guillermo Infante , Anders Jonsson , Vicenç Gómez

Hierarchical Modular Reinforcement Learning (HMRL), consists of 2 layered learning where Profit Sharing works to plan a prey position in the higher layer and Q-learning method trains the state-actions to the target in the lower layer. In…

机器学习 · 计算机科学 2018-04-10 Takumi Ichimura , Daisuke Igaue

Hierarchical Reinforcement Learning (HRL) has made notable progress in complex control tasks by leveraging temporal abstraction. However, previous HRL algorithms often suffer from serious data inefficiency as environments get large. The…

机器学习 · 计算机科学 2022-11-22 Seungjae Lee , Jigang Kim , Inkyu Jang , H. Jin Kim

Markov Decision Processes (MDPs) often exhibit significant redundancy due to symmetries and shared structure across state-goal pairs in real-world Goal-Conditioned Reinforcement Learning (GCRL). While hierarchical policies have been…

机器学习 · 计算机科学 2026-05-22 Clarisse Wibault , Alexander Goldie , Antonio Villares , Maike Osborne , Jakob Foerster

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

机器学习 · 计算机科学 2019-08-22 Tiancheng Yu , Suvrit Sra