English
Related papers

Related papers: Goal-Conditioned Reinforcement Learning with Imagi…

200 papers

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

Machine Learning · Computer Science 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

Learning robot manipulation through deep reinforcement learning in environments with sparse rewards is a challenging task. In this paper we address this problem by introducing a notion of imaginary object goals. For a given manipulation…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Building autonomous machines that can explore open-ended environments, discover possible interactions and build repertoires of skills is a general objective of artificial intelligence. Developmental approaches argue that this can only be…

Machine Learning · Computer Science 2026-01-30 Cédric Colas , Tristan Karch , Olivier Sigaud , Pierre-Yves Oudeyer

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

Goal-conditioned Reinforcement Learning (RL) aims at learning optimal policies, given goals encoded in special command inputs. Here we study goal-conditioned neural nets (NNs) that learn to generate deep NN policies in form of…

Machine Learning · Computer Science 2022-07-05 Francesco Faccio , Vincent Herrmann , Aditya Ramesh , Louis Kirsch , Jürgen Schmidhuber

Robotic agents performing domestic chores by natural language directives are required to master the complex job of navigating environment and interacting with objects in the environments. The tasks given to the agents are often composite…

Robotics · Computer Science 2024-03-14 Suvaansh Bhambri , Byeonghwi Kim , Jonghyun Choi

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Goals for reinforcement learning problems are typically defined through hand-specified rewards. To design such problems, developers of learning algorithms must inherently be aware of what the task goals are, yet we often require agents to…

Machine Learning · Computer Science 2018-03-29 Ashley D. Edwards , Laura Downs , James C. Davidson

Goal-conditioned hierarchical reinforcement learning (HRL) has shown promising results for solving complex and long-horizon RL tasks. However, the action space of high-level policy in the goal-conditioned HRL is often large, so it results…

Machine Learning · Computer Science 2021-12-07 Junsu Kim , Younggyo Seo , Jinwoo Shin

To successfully tackle challenging manipulation tasks, autonomous agents must learn a diverse set of skills and how to combine them. Recently, self-supervised agents that set their own abstract goals by exploiting the discovered structure…

Machine Learning · Computer Science 2022-02-01 Andrii Zadaianchuk , Georg Martius , Fanny Yang

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

Machine Learning · Computer Science 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Recently, a simple yet effective algorithm -- goal-conditioned supervised-learning (GCSL) -- was proposed to tackle goal-conditioned reinforcement-learning. GCSL is based on the principle of hindsight learning: by observing states visited…

Machine Learning · Computer Science 2023-05-18 Tom Jurgenson , Aviv Tamar

Multi-agent robotic systems are increasingly operating in real-world environments in close proximity to humans, yet are largely controlled by policy models with inscrutable deep neural network representations. We introduce a method for…

Machine Learning · Computer Science 2023-02-24 Renos Zabounidis , Joseph Campbell , Simon Stepputtis , Dana Hughes , Katia Sycara

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

Humans are able to understand and perform complex tasks by strategically structuring the tasks into incremental steps or subgoals. For a robot attempting to learn to perform a sequential task with critical subgoal states, such states can…

Human-Computer Interaction · Computer Science 2018-06-25 Xinlei Pan , Eshed Ohn-Bar , Nicholas Rhinehart , Yan Xu , Yilin Shen , Kris M. Kitani

Social navigation has been gaining attentions with the growth in machine intelligence. Since reinforcement learning can select an action in the prediction phase at a low computational cost, it has been formulated in a social navigation…

Robotics · Computer Science 2021-04-15 Takato Okudo , Seiji Yamada

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Machine Learning · Computer Science 2024-06-25 Vivienne Huiling Wang , Tinghuai Wang , Wenyan Yang , Joni-Kristian Kämäräinen , Joni Pajarinen

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

Hierarchical reinforcement learning (HRL) learns to make decisions on multiple levels of temporal abstraction. A key challenge in HRL is that the low-level policy changes over time, making it difficult for the high-level policy to generate…

Machine Learning · Computer Science 2025-05-29 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

In the real world, linguistic agents are also embodied agents: they perceive and act in the physical world. The notion of Language Grounding questions the interactions between language and embodiment: how do learning agents connect or…

Machine Learning · Computer Science 2020-06-15 Cédric Colas , Ahmed Akakzia , Pierre-Yves Oudeyer , Mohamed Chetouani , Olivier Sigaud