English
Related papers

Related papers: Learning to Plan Hierarchically from Curriculum

200 papers

This paper introduces an automated skill acquisition framework in reinforcement learning which involves identifying a hierarchical description of the given task in terms of abstract states and extended actions between abstract states.…

Machine Learning · Computer Science 2020-09-23 Aravind Srinivas , Ramnandan Krishnamurthy , Peeyush Kumar , Balaraman Ravindran

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations would be very useful…

Artificial Intelligence · Computer Science 2021-02-02 Saksham Consul , Lovis Heindrich , Jugoslav Stojcheski , Falk Lieder

By dynamic planning, we refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. A recent paradigm, active inference, brings fundamental insights into the adaptation of biological…

Artificial Intelligence · Computer Science 2024-11-13 Matteo Priorelli , Ivilin Peev Stoianov

We describe a task and motion planning architecture for highly dynamic systems that combines a domain-independent sampling-based deliberative planning algorithm with a global reactive planner. We leverage the recent development of a…

The learning order of semantic classes significantly impacts unsupervised domain adaptation for semantic segmentation, especially under adverse weather conditions. Most existing curricula rely on handcrafted heuristics (e.g., fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Shiqin Wang , Haoyang Chen , Huaizhou Huang , Yinkan He , Dongfang Sun , Xiaoqing Chen , Xingyu Liu , Zheng Wang , Kaiyan Zhao

We propose a novel framework and algorithm for hierarchical planning based on the principle of delegation. This framework, the Markov Intent Process, features a collection of skills which are each specialised to perform a single task well.…

Artificial Intelligence · Computer Science 2020-10-27 Tin Lai , Philippe Morere

Intelligent agents need to select long sequences of actions to solve complex tasks. While humans easily break down tasks into subgoals and reach them through millions of muscle commands, current artificial intelligence is limited to tasks…

Artificial Intelligence · Computer Science 2022-06-10 Danijar Hafner , Kuang-Huei Lee , Ian Fischer , Pieter Abbeel

Reinforcement learning and symbolic planning have both been used to build intelligent autonomous agents. Reinforcement learning relies on learning from interactions with real world, which often requires an unfeasibly large amount of…

Machine Learning · Computer Science 2018-06-07 Fangkai Yang , Daoming Lyu , Bo Liu , Steven Gustafson

In this paper we study the problem of learning multi-step dynamics prediction models (jumpy models) from unlabeled experience and their utility for fast inference of (high-level) plans in downstream tasks. In particular we propose to learn…

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

Robotics · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

Hierarchical learning has been successful at learning generalizable locomotion skills on walking robots in a sample-efficient manner. However, the low-dimensional "latent" action used to communicate between two layers of the hierarchy is…

Robotics · Computer Science 2021-03-19 Tianyu Li , Roberto Calandra , Deepak Pathak , Yuandong Tian , Franziska Meier , Akshara Rai

A common paradigm in classical planning is heuristic forward search. Forward search planners often rely on simple best-first search which remains fixed throughout the search process. In this paper, we introduce a novel search framework…

Artificial Intelligence · Computer Science 2019-04-12 Pawel Gomoluch , Dalal Alrajeh , Alessandra Russo

Practising and honing skills forms a fundamental component of how humans learn, yet artificial agents are rarely specifically trained to perform them. Instead, they are usually trained end-to-end, with the hope being that useful skills will…

Machine Learning · Computer Science 2022-08-17 Michael Matthews , Mikayel Samvelyan , Jack Parker-Holder , Edward Grefenstette , Tim Rocktäschel

We present a differentiable framework capable of learning a wide variety of compositions of simple policies that we call skills. By recursively composing skills with themselves, we can create hierarchies that display complex behavior. Skill…

Artificial Intelligence · Computer Science 2017-12-01 Himanshu Sahni , Saurabh Kumar , Farhan Tejani , Charles Isbell

Reinforcement learning has been successful in many tasks ranging from robotic control, games, energy management etc. In complex real world environments with sparse rewards and long task horizons, sample efficiency is still a major…

Artificial Intelligence · Computer Science 2021-10-12 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Building systems that autonomously create temporal abstractions from data is a key challenge in scaling learning and planning in reinforcement learning. One popular approach for addressing this challenge is the options framework (Sutton et…

Machine Learning · Computer Science 2020-01-01 Matthew Riemer , Miao Liu , Gerald Tesauro

In order to solve complex, long-horizon tasks, intelligent robots need to carry out high-level, abstract planning and reasoning in conjunction with motion planning. However, abstract models are typically lossy and plans or policies computed…

Robotics · Computer Science 2022-05-27 Naman Shah , Siddharth Srivastava

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

When learning to act in a stochastic, partially observable environment, an intelligent agent should be prepared to anticipate a change in its belief of the environment state, and be capable of adapting its actions on-the-fly to changing…

Machine Learning · Computer Science 2022-04-14 Ugo Lecerf , Christelle Yemdji-Tchassi , Pietro Michiardi