English
Related papers

Related papers: Hierarchical Reinforcement Learning via Advantage-…

200 papers

Hierarchical Imitation Learning (HIL) has been proposed to recover highly-complex behaviors in long-horizon tasks from expert demonstrations by modeling the task hierarchy with the option framework. Existing methods either overlook the…

Machine Learning · Computer Science 2023-05-29 Jiayu Chen , Tian Lan , Vaneet Aggarwal

Recommending novel content, which expands user horizons by introducing them to new interests, has been shown to improve users' long-term experience on recommendation platforms \cite{chen2021values}. Users however are not constantly looking…

Information Retrieval · Computer Science 2023-06-05 Pan Li , Yuyan Wang , Ed H. Chi , Minmin Chen

Learning in high-dimensional action spaces is a key challenge in applying reinforcement learning (RL) to real-world systems. In this paper, we study the possibility of controlling power networks using RL methods. Power networks are critical…

Machine Learning · Computer Science 2023-11-07 Blazej Manczak , Jan Viebahn , Herke van Hoof

Hierarchical reinforcement learning (HRL) is hypothesized to be able to leverage the inherent hierarchy in learning tasks where traditional reinforcement learning (RL) often fails. In this research, HRL is evaluated and contrasted with…

Artificial Intelligence · Computer Science 2025-08-20 Brendon Johnson , Alfredo Weitzenfeld

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

Hierarchical Reinforcement Learning (HRL) approaches have shown successful results in solving a large variety of complex, structured, long-horizon problems. Nevertheless, a full theoretical understanding of this empirical evidence is…

Machine Learning · Computer Science 2025-02-05 Gianluca Drappo , Alberto Maria Metelli , Marcello Restelli

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

It has been a challenge to learning skills for an agent from long-horizon unannotated demonstrations. Existing approaches like Hierarchical Imitation Learning(HIL) are prone to compounding errors or suboptimal solutions. In this paper, we…

Machine Learning · Computer Science 2021-06-14 Mingxuan Jing , Wenbing Huang , Fuchun Sun , Xiaojian Ma , Tao Kong , Chuang Gan , Lei Li

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

Robotics · Computer Science 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

Hierarchical policies enable strong performance in many sequential decision-making problems, such as those with high-dimensional action spaces, those requiring long-horizon planning, and settings with sparse rewards. However, learning…

Machine Learning · Computer Science 2025-03-19 Carolin Schmidt , Daniele Gammelli , James Harrison , Marco Pavone , Filipe Rodrigues

How do people decide how long to continue in a task, when to switch, and to which other task? Understanding the mechanisms that underpin task interleaving is a long-standing goal in the cognitive sciences. Prior work suggests greedy…

Artificial Intelligence · Computer Science 2020-01-08 Christoph Gebhardt , Antti Oulasvirta , Otmar Hilliges

Hierarchical reinforcement learning (HRL) helps address large-scale and sparse reward issues in reinforcement learning. In HRL, the policy model has an inner representation structured in levels. With this structure, the reinforcement…

Artificial Intelligence · Computer Science 2020-02-07 Wen-Ji Zhou , Yang Yu

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Option-critic learning is a general-purpose reinforcement learning (RL) framework that aims to address the issue of long term credit assignment by leveraging temporal abstractions. However, when dealing with extended timescales, discounting…

Machine Learning · Computer Science 2019-11-21 Akshay Dharmavaram , Matthew Riemer , Shalabh Bhatnagar

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a…

Machine Learning · Computer Science 2020-05-15 Alexander C. Li , Carlos Florensa , Ignasi Clavera , Pieter Abbeel

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

Hierarchical Reinforcement Learning (HRL) enhances the scalability of decision-making in long-horizon tasks by introducing temporal abstraction through options-policies that span multiple timesteps. Despite its theoretical appeal, the…

Machine Learning · Computer Science 2025-10-30 Hemanath Arumugam , Falong Fan , Bo Liu

Adequate strategizing of agents behaviors is essential to solving cooperative MARL problems. One intuitively beneficial yet uncommon method in this domain is predicting agents future behaviors and planning accordingly. Leveraging this…

Machine Learning · Computer Science 2022-12-15 Majd Ibrahim , Ammar Fayad