English
Related papers

Related papers: Ask & Explore: Grounded Question Answering for Cur…

200 papers

Common approaches for task-agnostic exploration learn tabula-rasa --the agent assumes isolated environments and no prior knowledge or experience. However, in the real world, agents learn in many environments and always come with prior…

Machine Learning · Computer Science 2021-11-29 Simone Parisi , Victoria Dean , Deepak Pathak , Abhinav Gupta

We introduce a large scale crowdsourced text adventure game as a research platform for studying grounded dialogue. In it, agents can perceive, emote, and act whilst conducting dialogue with other agents. Models and humans can both act as…

Humans integrate multiple sensory modalities (e.g. visual and audio) to build a causal understanding of the physical world. In this work, we propose a novel type of intrinsic motivation for Reinforcement Learning (RL) that encourages the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chuang Gan , Xiaoyu Chen , Phillip Isola , Antonio Torralba , Joshua B. Tenenbaum

Autonomous reinforcement learning agents, like children, do not have access to predefined goals and reward functions. They must discover potential goals, learn their own reward functions and engage in their own learning trajectory.…

Machine Learning · Computer Science 2019-11-11 Nicolas Lair , Cédric Colas , Rémy Portelas , Jean-Michel Dussoux , Peter Ford Dominey , Pierre-Yves Oudeyer

We propose a curiosity reward based on information theory principles and consistent with the animal instinct to maintain certain critical parameters within a bounded range. Our experimental validation shows the added value of the additional…

Artificial Intelligence · Computer Science 2018-02-08 Ildefons Magrans de Abril , Ryota Kanai

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

How to incentivize self-interested agents to explore when they prefer to exploit? Consider a population of self-interested agents that make decisions under uncertainty. They "explore" to acquire new information and "exploit" this…

Computer Science and Game Theory · Computer Science 2024-10-23 Aleksandrs Slivkins

Consider the problem of exploration in sparse-reward or reward-free environments, such as in Montezuma's Revenge. In the curiosity-driven paradigm, the agent is rewarded for how much each realized outcome differs from their predicted…

Machine Learning · Statistics 2023-07-21 Daniel Jarrett , Corentin Tallec , Florent Altché , Thomas Mesnard , Rémi Munos , Michal Valko

Efficient exploration is necessary to achieve good sample efficiency for reinforcement learning in general. From small, tabular settings such as gridworlds to large, continuous and sparse reward settings such as robotic object manipulation…

Machine Learning · Computer Science 2019-06-20 Zhaohan Daniel Guo , Emma Brunskill

Hierarchical abstraction and curiosity-driven exploration are two common paradigms in current reinforcement learning approaches to break down difficult problems into a sequence of simpler ones and to overcome reward sparsity. However, there…

Machine Learning · Computer Science 2020-08-18 Frank Röder , Manfred Eppe , Phuong D. H. Nguyen , Stefan Wermter

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

Machine Learning · Computer Science 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

This paper provides a roadmap that explores the question of how to imbue learning agents with the ability to understand and generate contextually relevant natural language in service of achieving a goal. We hypothesize that two key…

Artificial Intelligence · Computer Science 2021-03-19 Prithviraj Ammanabrolu , Mark O. Riedl

This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natural language and…

Curiosity is a general method for augmenting an environment reward with an intrinsic reward, which encourages exploration and is especially useful in sparse reward settings. As curiosity is calculated using next state prediction error, the…

Machine Learning · Computer Science 2021-05-19 Auguste Lehuger , Matthew Crosby

Reward design is a critical part of the application of reinforcement learning, the performance of which strongly depends on how well the reward signal frames the goal of the designer and how well the signal assesses progress in reaching…

Machine Learning · Computer Science 2022-08-01 Yixiang Wang , Yujing Hu , Feng Wu , Yingfeng Chen

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

We investigate the use of attentional neural network layers in order to learn a `behavior characterization' which can be used to drive novelty search and curiosity-based policies. The space is structured towards answering a particular…

Artificial Intelligence · Computer Science 2018-06-04 Nicholas Guttenberg , Martin Biehl , Nathaniel Virgo , Ryota Kanai

Human intelligence can remarkably adapt quickly to new tasks and environments. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by following provided…

In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases,…

Artificial Intelligence · Computer Science 2014-03-07 Manuel Lopes , Luis Montesano