English
Related papers

Related papers: Meta Learning Shared Hierarchies

200 papers

This paper presents an Impedance Primitive-augmented hierarchical reinforcement learning framework for efficient robotic manipulation in sequential contact tasks. We leverage this hierarchical structure to sequentially execute behavior…

Robotics · Computer Science 2025-08-28 Amin Berjaoui Tahmaz , Ravi Prakash , Jens Kober

Robotic shepherding problem considers the control and navigation of a group of coherent agents (e.g., a flock of bird or a fleet of drones) through the motion of an external robot, called shepherd. Machine learning based methods have…

Robotics · Computer Science 2020-05-20 Jixuan Zhi , Jyh-Ming Lien

Humans routinely rely on memory to perform tasks, yet most robot policies lack this capability; our goal is to endow robot policies with the same ability. Naively conditioning on long observation histories is computationally expensive and…

Robotics · Computer Science 2025-10-24 Ajay Sridhar , Jennifer Pan , Satvik Sharma , Chelsea Finn

We study the problem of efficiently estimating policies that simultaneously optimize multiple objectives in reinforcement learning (RL). Given $n$ objectives (or tasks), we seek the optimal partition of these objectives into $k \ll n$…

Machine Learning · Computer Science 2026-02-24 Zhenshuo Zhang , Minxuan Duan , Youran Ye , Hongyang R. Zhang

Many dynamic decision problems, such as robotic control, involve a series of tasks, many of which are unknown at training time. Typical approaches for these problems, such as multi-task and meta reinforcement learning, do not generalize…

Machine Learning · Computer Science 2025-05-28 Luise Ge , Michael Lanier , Anindya Sarkar , Bengisu Guresti , Chongjie Zhang , Yevgeniy Vorobeychik

Meta-learning considers the problem of learning an efficient learning process that can leverage its past experience to accurately solve new tasks. However, the efficacy of meta-learning crucially depends on the distribution of tasks…

Computation and Language · Computer Science 2021-11-03 Trapit Bansal , Karthick Gunasekaran , Tong Wang , Tsendsuren Munkhdalai , Andrew McCallum

In meta-learning an agent extracts knowledge from observed tasks, aiming to facilitate learning of novel future tasks. Under the assumption that future tasks are 'related' to previous tasks, the accumulated knowledge should be learned in a…

Machine Learning · Statistics 2019-05-21 Ron Amit , Ron Meir

This work addresses the problem of multi-robot coordination under unknown robot transition models, ensuring that tasks specified by Time Window Temporal Logic are satisfied with user-defined probability thresholds. We present a bi-level…

Robotics · Computer Science 2025-02-17 Xiaoshan Lin , Roberto Tron

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

Learning interpretable and transferable subpolicies and performing task decomposition from a single, complex task is difficult. Some traditional hierarchical reinforcement learning techniques enforce this decomposition in a top-down manner,…

Machine Learning · Computer Science 2019-03-06 Bohan Wu , Jayesh K. Gupta , Mykel J. Kochenderfer

In this work, we propose a distributed hierarchical locomotion control strategy for whole-body cooperation and demonstrate the potential for migration into large numbers of agents. Our method utilizes a hierarchical structure to break down…

Robotics · Computer Science 2024-10-29 Chuye Hong , Kangyao Huang , Huaping Liu

We draw upon a previously largely untapped literature on human collective intelligence as a source of inspiration for improving deep learning. Implicit in many algorithms that attempt to solve Deep Reinforcement Learning (DRL) tasks is the…

Artificial Intelligence · Computer Science 2019-02-18 Dhaval Adjodah , Dan Calacci , Yan Leng , Peter Krafft , Esteban Moro , Alex Pentland

Meta-learning has enabled learning statistical models that can be quickly adapted to new prediction tasks. Motivated by use-cases in personalized federated learning, we study the often overlooked aspect of the modern meta-learning…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Liam Li , Eric Xing , Ameet Talwalkar

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

We propose a new splitting criterion for a meta-learning approach to multiclass classifier design that adaptively merges the classes into a tree-structured hierarchy of increasingly difficult binary classification problems. The…

Machine Learning · Computer Science 2017-11-10 Gerrit J. J. van den Burg , Alfred O. Hero

In robotics, it is often not possible to learn useful policies using pure model-free reinforcement learning without significant reward shaping or curriculum learning. As a consequence, many researchers rely on expert demonstrations to guide…

Robotics · Computer Science 2021-04-20 Ondrej Biza , Dian Wang , Robert Platt , Jan-Willem van de Meent , Lawson L. S. Wong

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

In this paper, we propose a distributed multi-stage optimization method for planning complex missions for heterogeneous multi-robot teams. This class of problems involves tasks that can be executed in different ways and are associated with…

Robotics · Computer Science 2021-09-22 Barbara Arbanas Ferreira , Tamara Petrović , Stjepan Bogdan

Hierarchical learning has been successful at learning generalizable locomotion skills on walking robots in a sample-efficient manner. However, the low-dimensional "latent" action used to communicate between two layers of the hierarchy is…

Robotics · Computer Science 2021-03-19 Tianyu Li , Roberto Calandra , Deepak Pathak , Yuandong Tian , Franziska Meier , Akshara Rai

Learning actions that are relevant to decision-making and can be executed effectively is a key problem in autonomous robotics. Current state-of-the-art action representations in robotics lack proper effect-driven learning of the robot's…

Robotics · Computer Science 2024-04-04 Marko Zaric , Jakob Hollenstein , Justus Piater , Erwan Renaudo