English
Related papers

Related papers: Heterogeneously Perceived Incentives in Dynamic En…

200 papers

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

Humans are interactive agents driven to seek out situations with interesting physical dynamics. Here we formalize the functional form of physical intrinsic motivation. We first collect ratings of how interesting humans find a variety of…

Artificial Intelligence · Computer Science 2023-08-09 Julio Martinez , Felix Binder , Haoliang Wang , Nick Haber , Judith Fan , Daniel L. K. Yamins

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportional to exponentiated…

Artificial Intelligence · Computer Science 2021-10-07 David Tolpin , Tomer Dobkin

We consider a two-road dynamic routing game where the state of one of the roads (the "risky road") is stochastic and may change over time. This generates room for experimentation. A central planner may wish to induce some of the (finite…

Computer Science and Game Theory · Computer Science 2020-01-13 Emily Meigs , Francesca Parise , Asuman Ozdaglar , Daron Acemoglu

We consider a finite-horizon discrete-time dynamic system jointly controlled by a designer and one or more agents, where the designer can influence the agents' actions through selective information disclosure. At each time step, the…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Renyan Sun , Ashutosh Nayyar

This paper analyzes a dynamic interaction between a fully rational, privately informed sender and a boundedly rational, uninformed receiver with memory constraints. The sender controls the flow of information, while the receiver designs a…

Theoretical Economics · Economics 2025-11-12 Qingmin Liu , Yuyang Miao

This paper studies the optimal mechanism to motivate effort in a dynamic principal-agent model without transfers. An agent is engaged in a task with uncertain future rewards and can quit at any time. The principal knows the reward and…

Theoretical Economics · Economics 2026-01-16 Chang Liu

When information acquisition is costly but flexible, a principal may rationally acquire information that favors one group over another. The former group faces incentives to invest in becoming productive, while the latter is discouraged from…

Theoretical Economics · Economics 2024-09-10 Federico Echenique , Anqi Li

In this paper we study the problem of information sharing among rational self-interested agents as a dynamic game of asymmetric information. We assume that the agents imperfectly observe a Markov chain and they are called to decide whether…

Computer Science and Game Theory · Computer Science 2021-03-30 Konstantinos Ntemos , George Pikramenos , Nicholas Kalouptsidis

The dominant theories of rational choice assume logical omniscience. That is, they assume that when facing a decision problem, an agent can perform all relevant computations and determine the truth value of all relevant logical/mathematical…

Artificial Intelligence · Computer Science 2023-07-12 Caspar Oesterheld , Abram Demski , Vincent Conitzer

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2015-03-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

An analyst observes an agent take a sequence of actions. The analyst does not have access to the agent's information and ponders whether the observed actions could be justified through a rational Bayesian model with a known utility…

Theoretical Economics · Economics 2025-04-08 Henrique de Oliveira , Rohit Lamba

Automated decision-making tools increasingly assess individuals to determine if they qualify for high-stakes opportunities. A recent line of research investigates how strategic agents may respond to such scoring tools to receive favorable…

Machine Learning · Computer Science 2021-10-28 Keegan Harris , Hoda Heidari , Zhiwei Steven Wu

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

Agents in real-world scenarios like automated driving deal with uncertainty in their environment, in particular due to perceptual uncertainty. Although, reinforcement learning is dedicated to autonomous decision-making under uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Natalie Grabowsky , Annika Mütze , Joshua Wendland , Nils Jansen , Matthias Rottmann

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

Recently, significant attention has been dedicated to the models of opinion dynamics in which opinions are described by real numbers, and agents update their opinions synchronously by averaging their neighbors' opinions. The neighbors of…

Dynamical Systems · Mathematics 2011-04-08 Anahita Mirtabatabaei , Francesco Bullo

We examine the tuning of cooperative behavior in repeated multi-agent games using an analytically tractable, continuous-time, nonlinear model of opinion dynamics. Each modeled agent updates its real-valued opinion about each available…

Physics and Society · Physics 2021-11-24 Shinkyu Park , Anastasia Bizyaeva , Mari Kawakatsu , Alessio Franci , Naomi Ehrich Leonard

In this work, we analyse the relationship between heterogeneity and cooperation. Previous investigations suggest that this relation is nontrivial, as some authors found that heterogeneity sustains cooperation, while others obtained…

Physics and Society · Physics 2020-06-25 Marco A. Amaral , Marco A. Javarone