English
Related papers

Related papers: Robust Hierarchical Planning with Policy Delegatio…

200 papers

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a…

Machine Learning · Computer Science 2020-05-15 Alexander C. Li , Carlos Florensa , Ignasi Clavera , Pieter Abbeel

In human-robot collaboration, shared control presents an opportunity to teleoperate robotic manipulation to improve the efficiency of manufacturing and assembly processes. Robots are expected to assist in executing the user's intentions. To…

Robotics · Computer Science 2024-04-01 Mingyu Cai , Karankumar Patel , Soshi Iba , Songpo Li

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

Machine Learning · Computer Science 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

We present a principled and efficient planning algorithm for collaborative multiagent dynamical systems. All computation, during both the planning and the execution phases, is distributed among the agents; each agent only needs to model and…

Artificial Intelligence · Computer Science 2013-01-07 Carlos E. Guestrin , Geoffrey Gordon

We propose a novel approach for planning agents to compose abstract skills via observing and learning from historical interactions with the world. Our framework operates in a Markov state-space model via a set of actions under unknown…

Artificial Intelligence · Computer Science 2022-07-19 Tin Lai

Task allocation is a key combinatorial optimization problem, crucial for modern applications such as multi-robot cooperation and resource scheduling. Decision makers must allocate entities to tasks reasonably across different scenarios.…

Machine Learning · Computer Science 2024-07-02 Aicheng Gong , Kai Yang , Jiafei Lyu , Xiu Li

In this work we present a novel approach to hierarchical reinforcement learning for linearly-solvable Markov decision processes. Our approach assumes that the state space is partitioned, and the subtasks consist in moving between the…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , Anders Jonsson , Vicenç Gómez

The authors present an overview of a hierarchical framework for coordinating task- and motion-level operations in multirobot systems. Their framework is based on the idea of using simple temporal networks to simultaneously reason about…

Artificial Intelligence · Computer Science 2018-04-03 Hang Ma , Wolfgang Hönig , Liron Cohen , Tansel Uras , Hong Xu , T. K. Satish Kumar , Nora Ayanian , Sven Koenig

In order to solve complex, long-horizon tasks, intelligent robots need to carry out high-level, abstract planning and reasoning in conjunction with motion planning. However, abstract models are typically lossy and plans or policies computed…

Robotics · Computer Science 2022-05-27 Naman Shah , Siddharth Srivastava

In this paper, we provide a novel algorithm for solving planning and learning problems of Markov decision processes. The proposed algorithm follows a policy iteration-type update by using a rank-one approximation of the transition…

Optimization and Control · Mathematics 2025-10-23 Arman Sharifi Kolarijani , Tolga Ok , Peyman Mohajerin Esfahani , Mohamad Amin Sharif Kolarijani

In mobile robot shared control, effectively understanding human motion intention is critical for seamless human-robot collaboration. This paper presents a novel shared control framework featuring planning-level intention prediction. A path…

Robotics · Computer Science 2025-11-13 Jinyu Zhang , Lijun Han , Feng Jian , Lingxi Zhang , Hesheng Wang

We investigate planning in time-critical domains represented as Markov Decision Processes, showing that search based techniques can be a very powerful method for finding close to optimal plans. To reduce the computational cost of planning…

Artificial Intelligence · Computer Science 2013-02-28 Richard Dearden , Craig Boutilier

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We propose to leverage…

Machine Learning · Computer Science 2023-07-20 Haotian Fu , Shangqun Yu , Saket Tiwari , Michael Littman , George Konidaris

General purpose agents will require large repertoires of skills. Empowerment -- the maximum mutual information between skills and states -- provides a pathway for learning large collections of distinct skills, but mutual information is…

Machine Learning · Computer Science 2023-10-05 Andrew Levy , Sreehari Rammohan , Alessandro Allievi , Scott Niekum , George Konidaris

We describe a task and motion planning architecture for highly dynamic systems that combines a domain-independent sampling-based deliberative planning algorithm with a global reactive planner. We leverage the recent development of a…

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a novel framework for…

Artificial Intelligence · Computer Science 2017-12-21 Tianmin Shu , Caiming Xiong , Richard Socher

What is a useful skill hierarchy for an autonomous agent? We propose an answer based on a graphical representation of how the interaction between an agent and its environment may unfold. Our approach uses modularity maximisation as a…

Machine Learning · Computer Science 2024-01-18 Joshua B. Evans , Özgür Şimşek

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo