English
Related papers

Related papers: Learning to Plan Hierarchically from Curriculum

200 papers

We consider the problem of unsupervised skill segmentation and hierarchical structure discovery in reinforcement learning. While recent approaches have sought to segment trajectories into reusable skills or options, most rely on action…

Machine Learning · Computer Science 2026-05-29 Damion Harvey , Geraud Nangue Tasse , Benjamin Rosman , Branden Ingram , Steven James

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a novel framework for…

Artificial Intelligence · Computer Science 2017-12-21 Tianmin Shu , Caiming Xiong , Richard Socher

Automated planning remains one of the most general paradigms in Artificial Intelligence, providing means of solving problems coming from a wide variety of domains. One of the key factors restricting the applicability of planning is its…

Artificial Intelligence · Computer Science 2017-07-24 Pawel Gomoluch , Dalal Alrajeh , Alessandra Russo , Antonio Bucchiarone

Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver…

Machine Learning · Computer Science 2024-10-28 Yigit Gurses , Kaan Buyukdemirci , Yildiray Yildiz

E-learning systems are capable of providing more adaptive and efficient learning experiences for students than the traditional classroom setting. A key component of such systems is the learning strategy, the algorithm that designs the…

Machine Learning · Computer Science 2018-10-15 Xiao Li , Hanchen Xu , Jinming Zhang , Hua-hua Chang

An effective approach to solving long-horizon tasks in robotics domains with continuous state and action spaces is bilevel planning, wherein a high-level search over an abstraction of an environment is used to guide low-level…

Artificial Intelligence · Computer Science 2023-09-06 Nishanth Kumar , Willie McClinton , Rohan Chitnis , Tom Silver , Tomás Lozano-Pérez , Leslie Pack Kaelbling

We introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with…

Machine Learning · Computer Science 2020-06-15 John Winder , Stephanie Milani , Matthew Landen , Erebus Oh , Shane Parr , Shawn Squire , Marie desJardins , Cynthia Matuszek

In a warehouse environment, tasks appear dynamically. Consequently, a task management system that matches them with the workforce too early (e.g., weeks in advance) is necessarily sub-optimal. Also, the rapidly increasing size of the action…

Machine Learning · Computer Science 2022-03-08 Diogo S. Carvalho , Biswa Sengupta

We propose a modular architecture for the lifelong learning of hierarchically structured tasks. Specifically, we prove that our architecture is theoretically able to learn tasks that can be solved by functions that are learnable given…

Machine Learning · Computer Science 2021-12-22 Zihao Deng , Zee Fryer , Brendan Juba , Rina Panigrahy , Xin Wang

Reinforcement learning practitioners often avoid hierarchical policies, especially in image-based observation spaces. Typically, the single-task performance improvement over flat-policy counterparts does not justify the additional…

Machine Learning · Computer Science 2024-07-30 Tudor Cristea-Platon , Bogdan Mazoure , Josh Susskind , Walter Talbott

We propose a new approach for solving planning problems with a hierarchical structure, fusing reinforcement learning and MPC planning. Our formulation tightly and elegantly couples the two planning paradigms. It leverages reinforcement…

Machine Learning · Computer Science 2026-04-17 Toshiaki Hori , Jonathan DeCastro , Deepak Gopinath , Avinash Balachandran , Guy Rosman

Designing effective practice schedules for high-dimensional motor learning tasks remains a challenge, especially when skill states are unobservable and task performance may not reflect the true learning. We propose an automated curriculum…

Systems and Control · Electrical Eng. & Systems 2026-05-15 Ankur Kamboj , Rajiv Ranganathan , Xiaobo Tan , Vaibhav Srivastava

Learning a well-informed heuristic function for hard task planning domains is an elusive problem. Although there are known neural network architectures to represent such heuristic knowledge, it is not obvious what concrete information is…

Artificial Intelligence · Computer Science 2021-12-06 Leah Chrestien , Tomas Pevny , Antonin Komenda , Stefan Edelkamp

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo

This paper proposes a novel learning architecture for acquiring generalizable high-level symbolic skills from a few unlabeled low-level skill trajectory demonstrations. The architecture involves neural networks for symbol discovery and…

Robotics · Computer Science 2026-03-03 Hakan Aktas , Yigit Yildirim , Ahmet Firat Gamsiz , Deniz Bilge Akkoc , Erhan Oztop , Emre Ugur

A typical way in which a machine acquires knowledge from humans is by programming. Compared to learning from demonstrations or experiences, programmatic learning allows the machine to acquire a novel skill as soon as the program is written,…

Artificial Intelligence · Computer Science 2023-10-19 Leonardo Hernandez Cano , Yewen Pu , Robert D. Hawkins , Josh Tenenbaum , Armando Solar-Lezama

In swarm robotics, confrontation scenarios, including strategic confrontations, require efficient decision-making that integrates discrete commands and continuous actions. Traditional task and motion planning methods separate…

Robotics · Computer Science 2025-08-28 Qizhen Wu , Lei Chen , Kexin Liu , Jinhu Lu

We propose a method to systematically represent both the static and the dynamic components of environments, i.e. objects and agents, as well as the changes that are happening in the environment, i.e. the actions and skills performed by…

Artificial Intelligence · Computer Science 2024-09-16 Andrei Costinescu , Luis Figueredo , Darius Burschka

Despite of achieving great success in real-world applications, Deep Reinforcement Learning (DRL) is still suffering from three critical issues, i.e., data efficiency, lack of the interpretability and transferability. Recent research shows…

Artificial Intelligence · Computer Science 2023-07-10 Hankz Hankui Zhuo , Shuting Deng , Mu Jin , Zhihao Ma , Kebing Jin , Chen Chen , Chao Yu

Effective planning in the real world requires not only world knowledge, but the ability to leverage that knowledge to build the right representation of the task at hand. Decades of hierarchical planning techniques have used domain-specific…

Artificial Intelligence · Computer Science 2023-12-15 Lionel Wong , Jiayuan Mao , Pratyusha Sharma , Zachary S. Siegel , Jiahai Feng , Noa Korneev , Joshua B. Tenenbaum , Jacob Andreas