English
Related papers

Related papers: When Is Generalizable Reinforcement Learning Tract…

200 papers

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities…

Artificial Intelligence · Computer Science 2017-11-02 Alexey A. Melnikov , Adi Makmal , Vedran Dunjko , Hans J. Briegel

The Overfitted Brain hypothesis suggests dreams happen to allow generalization in the human brain. Here, we ask if the same is true for reinforcement learning agents as well. Given limited experience in a real environment, we use…

Machine Learning · Computer Science 2024-03-14 Giorgio Franceschelli , Mirco Musolesi

Social learning is a key component of human and animal intelligence. By taking cues from the behavior of experts in their environment, social learners can acquire sophisticated behavior and rapidly adapt to new circumstances. This paper…

Machine Learning · Computer Science 2021-06-24 Kamal Ndousse , Douglas Eck , Sergey Levine , Natasha Jaques

Reinforcement learning agents tend to develop habits that are effective only under specific policies. Following an initial exploration phase where agents try out different actions, they eventually converge onto a particular policy. As this…

Machine Learning · Computer Science 2024-06-25 Miguel Suau , Matthijs T. J. Spaan , Frans A. Oliehoek

Reinforcement learning (RL) algorithms aim to learn optimal decisions in unknown environments through experience of taking actions and observing the rewards gained. In some cases, the environment is not influenced by the actions of the RL…

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

Machine Learning · Computer Science 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

Text-based games (TBG) have emerged as promising environments for driving research in grounded language understanding and studying problems like generalization and sample efficiency. Several deep reinforcement learning (RL) methods with…

Computation and Language · Computer Science 2022-03-30 Mattia Atzeni , Shehzaad Dhuliawala , Keerthiram Murugesan , Mrinmaya Sachan

Reinforcement learning (RL) has become an increasingly active area of research in recent years. Although there are many algorithms that allow an agent to solve tasks efficiently, they often ignore the possibility that prior experience…

Artificial Intelligence · Computer Science 2020-01-07 Francisco M. Garcia , Chris Nota , Philip S. Thomas

Despite the significant progress of deep reinforcement learning (RL) in solving sequential decision making problems, RL agents often overfit to training environments and struggle to adapt to new, unseen environments. This prevents robust…

Machine Learning · Computer Science 2020-08-04 Xingyu Lu , Kimin Lee , Pieter Abbeel , Stas Tiomkin

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

Machine Learning · Computer Science 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

As humans and animals learn in the natural world, they encounter distributions of entities, situations and events that are far from uniform. Typically, a relatively small set of experiences are encountered frequently, while many important…

Machine Learning · Computer Science 2022-08-09 Stephanie C. Y. Chan , Andrew K. Lampinen , Pierre H. Richemond , Felix Hill

Reinforcement Learning (RL) agents are often unable to generalise well to environment variations in the state space that were not observed during training. This issue is especially problematic for image-based RL, where a change in just one…

Machine Learning · Computer Science 2023-02-28 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Deep reinforcement learning has become an important paradigm for constructing agents that can enter complex multi-agent situations and improve their policies through experience. One commonly used technique is reactive training - applying…

Artificial Intelligence · Computer Science 2017-12-11 Alexander Peysakhovich , Adam Lerer

Reinforcement Learning agents are expected to eventually perform well. Typically, this takes the form of a guarantee about the asymptotic behavior of an algorithm given some assumptions about the environment. We present an algorithm for a…

Machine Learning · Computer Science 2020-04-02 Michael K. Cohen , Elliot Catt , Marcus Hutter

In real world settings, numerous constraints are present which are hard to specify mathematically. However, for the real world deployment of reinforcement learning (RL), it is critical that RL agents are aware of these constraints, so that…

Machine Learning · Computer Science 2021-05-24 Usman Anwar , Shehryar Malik , Alireza Aghasi , Ali Ahmed