English
Related papers

Related papers: Using Deep Learning to Bootstrap Abstractions for …

200 papers

Long-horizon embodied planning is challenging because the world does not only change through an agent's actions: exogenous processes (e.g., water heating, dominoes cascading) unfold concurrently with the agent's actions. We propose a…

The ability to plan at many different levels of abstraction enables agents to envision the long-term repercussions of their decisions and thus enables sample-efficient learning. This becomes particularly beneficial in complex environments…

Artificial Intelligence · Computer Science 2023-10-17 Thomas Jiralerspong , Flemming Kondrup , Doina Precup , Khimya Khetarpal

We introduce the use of hierarchical clustering for relaxed, deterministic coordination and control of multiple robots. Traditionally an unsupervised learning method, hierarchical clustering offers a formalism for identifying and…

Robotics · Computer Science 2015-07-08 Omur Arslan , Dan P. Guralnik , Daniel E. Koditschek

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli

Deliberating on large or continuous state spaces have been long standing challenges in reinforcement learning. Temporal Abstraction have somewhat made this possible, but efficiently planing using temporal abstraction still remains an issue.…

Artificial Intelligence · Computer Science 2017-03-21 Peeyush Kumar , Doina Precup

Video prediction models combined with planning algorithms have shown promise in enabling robots to learn to perform many vision-based tasks through only self-supervision, reaching novel goals in cluttered scenes with unseen objects.…

Machine Learning · Computer Science 2019-09-13 Suraj Nair , Chelsea Finn

In human-robot collaboration, shared control presents an opportunity to teleoperate robotic manipulation to improve the efficiency of manufacturing and assembly processes. Robots are expected to assist in executing the user's intentions. To…

Robotics · Computer Science 2024-04-01 Mingyu Cai , Karankumar Patel , Soshi Iba , Songpo Li

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

Learning a robot motor skill from scratch is impractically slow; so much so that in practice, learning must be bootstrapped using a good skill policy obtained from human demonstration. However, relying on human demonstration necessarily…

Robotics · Computer Science 2021-01-14 Ben Abbatematteo , Eric Rosen , Stefanie Tellex , George Konidaris

A robot's actions are inherently stochastic, as its sensors are noisy and its actions do not always have the intended effects. For this reason, the agent language Golog has been extended to models with degrees of belief and stochastic…

Artificial Intelligence · Computer Science 2023-03-02 Till Hofmann , Vaishak Belle

Planning coverage path for multiple robots in a decentralized way enhances robustness to coverage tasks handling uncertain malfunctions. To achieve high efficiency in a distributed manner for each single robot, a comprehensive understanding…

Robotics · Computer Science 2022-10-17 Yongkai Liu , Jiawei Hu , Wei Dong

We tackle the challenge of building embodied AI agents that can reliably solve long-horizon planning problems. Imitation learning from demonstrations has shown itself to be effective in training robots to solve a diversity of complex tasks…

Artificial Intelligence · Computer Science 2026-05-20 Dillon Z. Chen , Till Hofmann , Toryn Q. Klassen , Sheila A. McIlraith

Planning in realistic environments requires searching in large planning spaces. Affordances are a powerful concept to simplify this search, because they model what actions can be successful in a given situation. However, the classical…

Robotics · Computer Science 2021-06-24 Danfei Xu , Ajay Mandlekar , Roberto Martín-Martín , Yuke Zhu , Silvio Savarese , Li Fei-Fei

To assist with everyday human activities, robots must solve complex long-horizon tasks and generalize to new settings. Recent deep reinforcement learning (RL) methods show promise in fully autonomous learning, but they struggle to reach…

Artificial Intelligence · Computer Science 2023-08-23 Shuo Cheng , Danfei Xu

The objective of this work is to augment the basic abilities of a robot by learning to use new sensorimotor primitives to enable the solution of complex long-horizon problems. Solving long-horizon problems in complex domains requires…

Robotics · Computer Science 2018-08-14 Zi Wang , Caelan Reed Garrett , Leslie Pack Kaelbling , Tomás Lozano-Pérez

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

Robotics · Computer Science 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Abstraction is a commonly used process to represent some low-level system by a more coarse specification with the goal to omit unnecessary details while preserving important aspects. While recent work on abstraction in the situation…

Artificial Intelligence · Computer Science 2023-03-02 Till Hofmann , Vaishak Belle

Planning for multi-robot teams in complex environments is a challenging problem, especially when these teams must coordinate to accomplish a common objective. In general, optimal solutions to these planning problems are computationally…

Robotics · Computer Science 2024-03-07 Cora A. Dimmig , Kevin C. Wolfe , Joseph Moore

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

In the face of difficult exploration problems in reinforcement learning, we study whether giving an agent an object-centric mapping (describing a set of items and their attributes) allow for more efficient learning. We found this problem is…

Machine Learning · Computer Science 2025-04-15 Anthony GX-Chen , Kenneth Marino , Rob Fergus