English
Related papers

Related papers: Object-oriented state editing for HRL

200 papers

Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable…

Artificial Intelligence · Computer Science 2021-06-07 Parand Alizadeh Alamdari , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

Embodied AI agents in large scenes often need to navigate to find objects. In this work, we study a naturally emerging variant of the object navigation task, hierarchical relational object navigation (HRON), where the goal is to find…

Artificial Intelligence · Computer Science 2023-06-27 Michael Lingelbach , Chengshu Li , Minjune Hwang , Andrey Kurenkov , Alan Lou , Roberto Martín-Martín , Ruohan Zhang , Li Fei-Fei , Jiajun Wu

Given a text description, most existing semantic parsers synthesize a program in one shot. However, it is quite challenging to produce a correct program solely based on the description, which in reality is often ambiguous or incomplete. In…

Computation and Language · Computer Science 2018-11-15 Ziyu Yao , Xiujun Li , Jianfeng Gao , Brian Sadler , Huan Sun

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Planning agents are ill-equipped to act in novel situations in which their domain model no longer accurately represents the world. We introduce an approach for such agents operating in open worlds that detects the presence of novelties and…

Artificial Intelligence · Computer Science 2023-03-28 Wiktor Piotrowski , Roni Stern , Yoni Sher , Jacob Le , Matthew Klenk , Johan deKleer , Shiwali Mohan

We consider the problem of reconstructing the state of a network of nonlinear dynamical systems in the presence of directed higher-order interactions. Grounded on analytical convergence results, we propose an algorithmic observer design…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Roberto Rizzello , Davide Salzano , Stefano Boccaletti , Pietro De Lellis

Hierarchical Reinforcement Learning (HRL) allows interactive agents to decompose complex problems into a hierarchy of sub-tasks. Higher-level tasks can invoke the solutions of lower-level tasks as if they were primitive actions. In this…

Common-sense physical reasoning in the real world requires learning about the interactions of objects and their dynamics. The notion of an abstract object, however, encompasses a wide variety of physical objects that differ greatly in terms…

Machine Learning · Computer Science 2020-12-16 Aleksandar Stanić , Sjoerd van Steenkiste , Jürgen Schmidhuber

In the face of difficult exploration problems in reinforcement learning, we study whether giving an agent an object-centric mapping (describing a set of items and their attributes) allow for more efficient learning. We found this problem is…

Machine Learning · Computer Science 2025-04-15 Anthony GX-Chen , Kenneth Marino , Rob Fergus

Efficient numerical optimization methods can improve performance and reduce the environmental impact of computing in many applications. This work presents a proof-of-concept study combining primitive state representations and…

Machine Learning · Computer Science 2025-01-30 R. Sala

We consider the problem of estimating the states of a distributed network of nodes (targets) through a team of cooperating agents (sensors) persistently visiting the nodes so that an overall measure of estimation error covariance evaluated…

Systems and Control · Electrical Eng. & Systems 2021-10-14 Shirantha Welikala , Christos G. Cassandras

Object-centric representations have recently enabled significant progress in tackling relational reasoning tasks. By building a strong object-centric inductive bias into neural architectures, recent efforts have improved generalization and…

Machine Learning · Computer Science 2021-04-20 Wenling Shang , Lasse Espeholt , Anton Raichuk , Tim Salimans

Object-centric representation (OCR) has recently become a subject of interest in the computer vision community for learning a structured representation of images and videos. It has been several times presented as a potential way to improve…

Artificial Intelligence · Computer Science 2025-06-25 Alexandre Chapin , Emmanuel Dellandrea , Liming Chen

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

Autonomous agents need large repertoires of skills to act reasonably on new tasks that they have not seen before. However, acquiring these skills using only a stream of high-dimensional, unstructured, and unlabeled observations is a tricky…

Machine Learning · Computer Science 2021-02-09 Andrii Zadaianchuk , Maximilian Seitzer , Georg Martius

Most previous studies on multi-agent reinforcement learning focus on deriving decentralized and cooperative policies to maximize a common reward and rarely consider the transferability of trained policies to new tasks. This prevents such…

Machine Learning · Computer Science 2019-11-28 Heechang Ryu , Hayong Shin , Jinkyoo Park

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

The performance of a trained object detection neural network depends a lot on the image quality. Generally, images are pre-processed before feeding them into the neural network and domain knowledge about the image dataset is used to choose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Siddharth Nayak , Balaraman Ravindran

The definition of symbolic descriptions that consistently represent relevant geometrical aspects in manipulation tasks is a challenging problem that has received little attention in the robotic community. This definition is usually done…

Artificial Intelligence · Computer Science 2020-07-17 Alejandro Agostini , Dongheui Lee

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen