We propose a curiosity reward based on information theory principles and consistent with the animal instinct to maintain certain critical parameters within a bounded range. Our experimental validation shows the added value of the additional homeostatic drive to enhance the overall information gain of a reinforcement learning agent interacting with a complex environment using continuous actions. Our method builds upon two ideas: i) To take advantage of a new Bellman-like equation of information gain and ii) to simplify the computation of the local rewards by avoiding the approximation of complex distributions over continuous states and actions.
@article{arxiv.1801.07440,
title = {Curiosity-driven reinforcement learning with homeostatic regulation},
author = {Ildefons Magrans de Abril and Ryota Kanai},
journal= {arXiv preprint arXiv:1801.07440},
year = {2018}
}
Comments
Presented at the NIPS 2017 Workshop: Cognitively Informed Artificial Intelligence: Insights From Natural Intelligence