English
Related papers

Related papers: Learning Task Decomposition with Ordered Memory Po…

200 papers

This work studies the problem of batch off-policy evaluation for Reinforcement Learning in partially observable environments. Off-policy evaluation under partial observability is inherently prone to bias, with risk of arbitrarily large…

Machine Learning · Computer Science 2019-11-26 Guy Tennenholtz , Shie Mannor , Uri Shalit

We propose automatically learning probabilistic Hierarchical Task Networks (pHTNs) in order to capture a user's preferences on plans, by observing only the user's behavior. HTNs are a common choice of representation for a variety of…

Artificial Intelligence · Computer Science 2010-06-03 Nan Li , William Cushing , Subbarao Kambhampati , Sungwook Yoon

We propose a novel problem formulation of learning a single task when the data are provided in different feature spaces. Each such space is called an outlook, and is assumed to contain both labeled and unlabeled data. The objective is to…

Machine Learning · Computer Science 2011-06-15 Maayan Harel , Shie Mannor

Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capabilities often…

Machine Learning · Computer Science 2021-10-27 Daniel Weitekamp , Christopher MacLellan , Erik Harpstead , Kenneth Koedinger

As the range of tasks performed by a general vision system expands, executing multiple tasks accurately and efficiently in a single network has become an important and still open problem. Recent computer vision approaches address this…

Machine Learning · Computer Science 2020-11-02 Hila Levi , Shimon Ullman

Building models of the world from observation, i.e., induction, is one of the major challenges in machine learning. In order to be useful, models need to maintain accuracy when used in novel situations, i.e., generalize. In addition, they…

Machine Learning · Computer Science 2026-02-10 Gabriel Stella , Dmitri Loguinov

While robots can learn models to solve many manipulation tasks from raw visual input, they cannot usually use these models to solve new problems. On the other hand, symbolic planning methods such as STRIPS have long been able to solve new…

Robotics · Computer Science 2020-03-10 Kei Kase , Chris Paxton , Hammad Mazhar , Tetsuya Ogata , Dieter Fox

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

Machine Learning · Computer Science 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Option discovery and skill acquisition frameworks are integral to the functioning of a Hierarchically organized Reinforcement learning agent. However, such techniques often yield a large number of options or skills, which can potentially be…

Machine Learning · Computer Science 2020-07-06 Arjun Manoharan , Rahul Ramesh , Balaraman Ravindran

We present HiDe, a novel hierarchical reinforcement learning architecture that successfully solves long horizon control tasks and generalizes to unseen test scenarios. Functional decomposition between planning and low-level control is…

Machine Learning · Computer Science 2021-10-08 Sammy Christen , Lukas Jendele , Emre Aksan , Otmar Hilliges

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

Robotics · Computer Science 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki

Recurrent feedback connections in the mammalian visual system have been hypothesized to play a role in synthesizing input in the theoretical framework of analysis by synthesis. The comparison of internally synthesized representation with…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Hao Wang , Xingyu Lin , Yimeng Zhang , Tai Sing Lee

We introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with…

Machine Learning · Computer Science 2020-06-15 John Winder , Stephanie Milani , Matthew Landen , Erebus Oh , Shane Parr , Shawn Squire , Marie desJardins , Cynthia Matuszek

Graph neural networks (GNN) have achieved state-of-the-art performance on various industrial tasks. However, the poor efficiency of GNN inference and frequent Out-Of-Memory (OOM) problem limit the successful application of GNN on edge…

Machine Learning · Computer Science 2021-04-13 Ao Zhou , Jianlei Yang , Yeqi Gao , Tong Qiao , Yingjie Qi , Xiaoyi Wang , Yunli Chen , Pengcheng Dai , Weisheng Zhao , Chunming Hu

We tackle the problem of generalization to unseen configurations for dynamic tasks in the real world while learning from high-dimensional image input. The family of nonlinear dynamical system-based methods have successfully demonstrated…

Machine Learning · Computer Science 2021-07-13 Shikhar Bahl , Abhinav Gupta , Deepak Pathak

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

Humans' innate ability to decompose scenes into objects allows for efficient understanding, predicting, and planning. In light of this, Object-Centric Learning (OCL) attempts to endow networks with similar capabilities, learning to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Junhong Zou , Xiangyu Zhu , Zhaoxiang Zhang , Zhen Lei