English
Related papers

Related papers: Motivating Effort with Information about Future Re…

200 papers

Humans and animals explore their environment and acquire useful skills even in the absence of clear goals, exhibiting intrinsic motivation. The study of intrinsic motivation in artificial agents is concerned with the following question:…

Machine Learning · Computer Science 2021-12-08 Nicholas Rhinehart , Jenny Wang , Glen Berseth , John D. Co-Reyes , Danijar Hafner , Chelsea Finn , Sergey Levine

In principal-agent models, a principal offers a contract to an agent to perform a certain task. The agent exerts a level of effort that maximizes her utility. The principal is oblivious to the agent's chosen level of effort, and conditions…

Computer Science and Game Theory · Computer Science 2022-07-14 Alon Cohen , Moran Koren , Argyrios Deligkas

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

We study how to optimally design selection mechanisms, accounting for agents' investment incentives. A principal wishes to allocate a resource of homogeneous quality to a heterogeneous population of agents. The principal commits to a…

Theoretical Economics · Economics 2025-11-11 Victor Augias , Eduardo Perez-Richet

We study strategic classification in binary decision-making settings where agents can modify their features in order to improve their classification outcomes. Importantly, our work considers the causal structure across different features,…

Computer Science and Game Theory · Computer Science 2025-02-11 Valia Efthymiou , Chara Podimata , Diptangshu Sen , Juba Ziani

We study a repeated Principal Agent problem between a long lived Principal and Agent pair in a prior free setting. In our setting, the sequence of realized states of nature may be adversarially chosen, the Agent is non-myopic, and the…

Computer Science and Game Theory · Computer Science 2023-11-15 Natalie Collina , Aaron Roth , Han Shao

I study dynamic contracting where Sender privately observes a Markovian state and seeks to motivate Receiver, who acts. Sender provides incentives in two ways: payments, which alter payoffs ex-post, and (Bayesian) persuasion, which shapes…

Theoretical Economics · Economics 2026-05-22 Daniel Luo

We study a dynamic information design problem in a finite-horizon setting consisting of two strategic and long-term optimizing agents, namely a principal (he) and a detector (she). The principal observes the evolution of a Markov chain that…

Computer Science and Game Theory · Computer Science 2020-03-19 Farzaneh Farhadi , Demosthenis Teneketzis

Motivated by applications such as cloud platforms allocating GPUs to users or governments deploying mobile health units across competing regions, we study the dynamic allocation of a reusable resource to strategic agents with private…

Computer Science and Game Theory · Computer Science 2025-07-15 Yan Dai , Negin Golrezaei , Patrick Jaillet

We study the design of information acquisition games-environments where a designer contracts their action on Sender's choice of experiment and the realized signals about some state-and identify which predictions can be made absent knowledge…

Theoretical Economics · Economics 2026-01-22 Eric Gao , Daniel Luo

Incentives are more likely to elicit desired outcomes when they are designed based on accurate models of agents' strategic behavior. A growing literature, however, suggests that people do not quite behave like standard economic agents in a…

Computer Science and Game Theory · Computer Science 2014-06-09 Arpita Ghosh , Robert Kleinberg

In cooperative multiagent planning, it can often be beneficial for an agent to make commitments about aspects of its behavior to others, allowing them in turn to plan their own behaviors without taking the agent's detailed behavior into…

Artificial Intelligence · Computer Science 2017-03-16 Qi Zhang , Satinder Singh , Edmund Durfee

We consider a ubiquitous scenario in the Internet economy when individual decision-makers (henceforth, agents) both produce and consume information as they make strategic choices in an uncertain environment. This creates a three-way…

Computer Science and Game Theory · Computer Science 2021-04-09 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis , Zhiwei Steven Wu

To survive in dynamic and uncertain environments, individuals must develop effective decision strategies that balance information gathering and decision commitment. Models of such strategies often prioritize either optimizing tangible…

Artificial Intelligence · Computer Science 2025-03-26 Nicholas W. Barendregt , Joshua I. Gold , Krešimir Josić , Zachary P. Kilpatrick

Recently, Frazier et al. proposed a natural model for crowdsourced exploration of different a priori unknown options: a principal is interested in the long-term welfare of a population of agents who arrive one by one in a multi-armed bandit…

Computer Science and Game Theory · Computer Science 2015-12-29 Li Han , David Kempe , Ruixin Qiang

Learning to cooperate with friends and compete with foes is a key component of multi-agent reinforcement learning. Typically to do so, one requires access to either a model of or interaction with the other agent(s). Here we show how to…

Artificial Intelligence · Computer Science 2019-01-03 DJ Strouse , Max Kleiman-Weiner , Josh Tenenbaum , Matt Botvinick , David Schwab

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large number of reachable next…

Machine Learning · Computer Science 2020-01-09 Felix Leibfried , Sergio Pascual-Diaz , Jordi Grau-Moya

We study the design of optimal allocation mechanisms in an environment where agents and goods arrive stochastically. Agents have private types that determine the principal payoff. Either agents or goods can be held in a queue at a flow cost…

Theoretical Economics · Economics 2026-02-05 Zihao Li , Xuandong Chen

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

Machine Learning · Computer Science 2012-09-06 Christos Dimitrakakis

This work studies a dynamic mechanism design problem in which a principal delegates decision makings to a group of privately-informed agents without the monetary transfer or burning. We consider that the principal privately possesses…

Computer Science and Game Theory · Computer Science 2022-01-19 Tao Zhang , Quanyan Zhu