English
Related papers

Related papers: Option Encoder: A Framework for Discovering a Poli…

200 papers

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a novel framework for…

Artificial Intelligence · Computer Science 2017-12-21 Tianmin Shu , Caiming Xiong , Richard Socher

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

Machine Learning · Computer Science 2019-02-19 Saket Tiwari , M. Prannoy

We propose a hierarchical reinforcement learning method, HIDIO, that can learn task-agnostic options in a self-supervised manner while jointly learning to utilize them to solve sparse-reward tasks. Unlike current hierarchical RL approaches…

Machine Learning · Computer Science 2022-08-10 Jesse Zhang , Haonan Yu , Wei Xu

Picking cluttered general objects is a challenging task due to the complex geometries and various stacking configurations. Many prior works utilize pose estimation for picking, but pose estimation is difficult on cluttered objects. In this…

Robotics · Computer Science 2023-04-21 Hoang-Giang Cao , Weihao Zeng , I-Chen Wu

Standard reinforcement learning algorithms with a single policy perform poorly on tasks in complex environments involving sparse rewards, diverse behaviors, or long-term planning. This led to the study of algorithms that incorporate…

Machine Learning · Computer Science 2024-07-23 Ranga Shaarad Ayyagari , Anurita Ghosh , Ambedkar Dukkipati

The options framework is a popular approach for building temporally extended actions in reinforcement learning. In particular, the option-critic architecture provides general purpose policy gradient theorems for learning actions from…

Machine Learning · Computer Science 2020-02-07 Matthew Riemer , Ignacio Cases , Clemens Rosenbaum , Miao Liu , Gerald Tesauro

This work contributes a novel deep navigation policy that enables collision-free flight of aerial robots based on a modular approach exploiting deep collision encoding and reinforcement learning. The proposed solution builds upon a deep…

Robotics · Computer Science 2024-02-07 Mihir Kulkarni , Kostas Alexis

The online advertising market, with its thousands of auctions run per second, presents a daunting challenge for advertisers who wish to optimize their spend under a budget constraint. Thus, advertising platforms typically provide automated…

Machine Learning · Computer Science 2023-10-17 Dmytro Korenkevych , Frank Cheng , Artsiom Balakir , Alex Nikulkov , Lingnan Gao , Zhihao Cen , Zuobing Xu , Zheqing Zhu

Foundation models have recently expanded into robotics after excelling in computer vision and natural language processing. The models are accessible in two ways: open-source or paid, closed-source options. Users with access to both face a…

Robotics · Computer Science 2024-02-14 Po-han Li , Oyku Selin Toprak , Aditya Narayanan , Ufuk Topcu , Sandeep Chinchali

Many of the challenges facing today's reinforcement learning (RL) algorithms, such as robustness, generalization, transfer, and computational efficiency are closely related to compression. Prior work has convincingly argued why minimizing…

Machine Learning · Computer Science 2021-09-08 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Encoding a sequence of observations is an essential task with many applications. The encoding can become highly efficient when the observations are generated by a dynamical system. A dynamical system imposes regularities on the observations…

Machine Learning · Statistics 2018-05-29 Arash Mehrjou , Friedrich Solowjow , Sebastian Trimpe , Bernhard Schölkopf

Autonomous learning of robotic skills can allow general-purpose robots to learn wide behavioral repertoires without requiring extensive manual engineering. However, robotic skill learning methods typically make one of several trade-offs to…

Machine Learning · Computer Science 2016-10-07 William Montgomery , Anurag Ajay , Chelsea Finn , Pieter Abbeel , Sergey Levine

We study the problem of learning a good set of policies, so that when combined together, they can solve a wide variety of unseen reinforcement learning tasks with no or very little new data. Specifically, we consider the framework of…

Machine Learning · Computer Science 2022-03-16 Safa Alver , Doina Precup

We present a representation-driven framework for reinforcement learning. By representing policies as estimates of their expected values, we leverage techniques from contextual bandits to guide exploration and exploitation. Particularly,…

Machine Learning · Computer Science 2026-01-23 Ofir Nabati , Guy Tennenholtz , Shie Mannor

Behavior Trees are commonly used to model agents for robotics and games, where constrained behaviors must be designed by human experts in order to guarantee that these agents will execute a specific chain of actions given a specific set of…

Artificial Intelligence · Computer Science 2015-06-09 Renato de Pontes Pereira , Paulo Martins Engel

Batch reinforcement learning enables policy learning without direct interaction with the environment during training, relying exclusively on previously collected sets of interactions. This approach is, therefore, well-suited for high-risk…

Machine Learning · Computer Science 2024-11-18 Amna Najib , Stefan Depeweg , Phillip Swazinna

In order to speed-up classification models when facing a large number of categories, one usual approach consists in organizing the categories in a particular structure, this structure being then used as a way to speed-up the prediction…

Machine Learning · Computer Science 2015-11-26 Aurélia Léon , Ludovic Denoyer

Decision transformers recast reinforcement learning as a conditional sequence generation problem, offering a simple but effective alternative to traditional value or policy-based methods. A recent key development in this area is the…

Machine Learning · Computer Science 2024-12-16 Zhe Wang , Haozhu Wang , Yanjun Qi

We propose a novel framework to controller design in environments with a two-level structure: a known high-level graph ("map") in which each vertex is populated by a Markov decision process, called a "room". The framework "separates…

Artificial Intelligence · Computer Science 2025-03-11 Florent Delgrange , Guy Avni , Anna Lukina , Christian Schilling , Ann Nowé , Guillermo A. Pérez