English
Related papers

Related papers: Intrinsic motivation as constrained entropy maximi…

200 papers

Biological and psychological concepts have inspired reinforcement learning algorithms to create new complex behaviors that expand agents' capacity. These behaviors can be seen in the rise of techniques like goal decomposition, curriculum,…

Artificial Intelligence · Computer Science 2025-06-09 Rodney Sanchez , Ferat Sahin , Alexander Ororbia , Jamison Heard

We extend the framework of efficient coding, which has been used to model the development of sensory processing in isolation, to model the development of the perception/action cycle. Our extension combines sparse coding and reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2014-02-26 Chong Zhang , Yu Zhao , Jochen Triesch , Bertram E. Shi

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…

Games are challenging for Reinforcement Learning~(RL) agents due to their reward-sparsity, as rewards are only obtainable after long sequences of deliberate actions. Intrinsic Motivation~(IM) methods -- which introduce exploration rewards…

Artificial Intelligence · Computer Science 2025-07-29 Leonardo Villalobos-Arias , Grant Forbes , Jianxun Wang , David L Roberts , Arnav Jhala

In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a…

Data Analysis, Statistics and Probability · Physics 2015-05-20 Ariel Caticha

We study the problem of a principal who wants to influence an agent's observable action, subject to an ex-post budget. The agent has a private type determining their cost function. This paper endogenizes the value of the resource driving…

Theoretical Economics · Economics 2024-04-25 Nicole Immorlica , Nicholas Wu , Brendan Lucier

Combining model-based and model-free deep reinforcement learning has shown great promise for improving sample efficiency on complex control tasks while still retaining high performance. Incorporating imagination is a recent effort in this…

Machine Learning · Computer Science 2019-10-11 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

The study of intelligent systems explains behaviour in terms of economic rationality. This results in an optimization principle involving a function or utility, which states that the system will evolve until the configuration of maximum…

Information Theory · Computer Science 2024-06-18 Pedro Hack

Exploration in sparse reward environments remains one of the key challenges of model-free reinforcement learning. Instead of solely relying on extrinsic rewards provided by the environment, many state-of-the-art methods use intrinsic…

Machine Learning · Computer Science 2020-03-03 Roberta Raileanu , Tim Rocktäschel

How do incentive levels affect strategic behaviour? We address this with an experiment that separately identifies own- and opponent-incentive effects in two dominance-solvable games that differ in strategic complexity. Higher own incentives…

Theoretical Economics · Economics 2026-03-30 Teresa Esteban-Casanelles , Duarte Gonçalves

Complex behaviors are often driven by an internal model, which integrates sensory information over time and facilitates long-term planning. Inferring an agent's internal model is a crucial ingredient in social interactions (theory of mind),…

Machine Learning · Computer Science 2019-06-13 Zhengwei Wu , Paul Schrater , Xaq Pitkow

Exploration in sparse reward reinforcement learning remains an open challenge. Many state-of-the-art methods use intrinsic motivation to complement the sparse extrinsic reward signal, giving the agent more opportunities to receive feedback…

Machine Learning · Computer Science 2019-06-24 Jingwei Zhang , Niklas Wetzel , Nicolai Dorka , Joschka Boedecker , Wolfram Burgard

This work presents an architecture that generates curiosity-driven goal-directed exploration behaviours for an image sensor of a microfarming robot. A combination of deep neural networks for offline unsupervised learning of low-dimensional…

Artificial Intelligence · Computer Science 2020-06-09 Guido Schillaci , Antonio Pico Villalpando , Verena Vanessa Hafner , Peter Hanappe , David Colliaux , Timothée Wintz

We focus on how individual behavior that complies with social norms interferes with performance-based incentive mechanisms in organizations with multiple distributed decision-making agents. We model social norms to emerge from interactions…

General Economics · Economics 2021-02-25 Ravshanbek Khodzhimatov , Stephan Leitner , Friederike Wall

Exploration is essential in reinforcement learning as an agent relies on trial and error to learn an optimal policy. However, when rewards are sparse, naive exploration strategies, like noise injection, are often insufficient. Intrinsic…

Machine Learning · Computer Science 2026-01-30 Minjae Cho , Huy Trong Tran

It is of significance for an agent to learn a widely applicable and general-purpose policy that can achieve diverse goals including images and text descriptions. Considering such perceptually-specific goals, the frontier of deep…

Machine Learning · Computer Science 2021-12-14 Jinxin Liu , Donglin Wang , Qiangxing Tian , Zhengyu Chen

Integrated information theory (IIT) argues that the substrate of consciousness is a maximally irreducible complex of units. Together, subsets of the complex specify a cause-effect structure, composed of distinctions and their relations,…

Neurons and Cognition · Quantitative Biology 2025-01-03 William G. P. Mayner , Bjørn Erik Juel , Giulio Tononi

Recent technology advances have enabled firms to flexibly process and analyze sophisticated employee performance data at a reduced and yet significant cost. We develop a theory of optimal incentive contracting where the monitoring…

Theoretical Economics · Economics 2019-11-22 Anqi Li , Ming Yang

In this paper we introduce a new unsupervised reinforcement learning method for discovering the set of intrinsic options available to an agent. This set is learned by maximizing the number of different states an agent can reliably reach, as…

Machine Learning · Computer Science 2016-11-23 Karol Gregor , Danilo Jimenez Rezende , Daan Wierstra

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions, i.e. environments more general than (PO)MDPs. The task for an agent is to attain…

Machine Learning · Computer Science 2009-12-30 Daniil Ryabko , Marcus Hutter