English
Related papers

Related papers: Bayesian Persuasion in Sequential Decision-Making

200 papers

We consider an agent who represents uncertainty about the environment via a possibly misspecified model. Each period, the agent takes an action, observes a consequence, and uses Bayes' rule to update her belief about the environment. This…

Theoretical Economics · Economics 2019-10-24 Ignacio Esponda , Demian Pouzo , Yuichi Yamamoto

We study a social learning model in which agents iteratively update their beliefs about the true state of the world using private signals and the beliefs of other agents in a non-Bayesian manner. Some agents are stubborn, meaning they…

Social and Information Networks · Computer Science 2022-09-21 Daniel Vial , Vijay Subramanian

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportional to exponentiated…

Artificial Intelligence · Computer Science 2021-10-07 David Tolpin , Tomer Dobkin

In this technical note, we consider a collaborative learning framework with principal-agent setting, in which the principal at each time-step determines a set of appropriate aggregation coefficients based on how the current parameter…

Machine Learning · Statistics 2024-09-25 Getachew K Befekadu

We study a setting in which a principal selects an agent to execute a collection of tasks according to a specified priority sequence. Agents, however, have their own individual priority sequences according to which they wish to execute the…

Computer Science and Game Theory · Computer Science 2024-10-30 Donya G. Dobakhshari , Lav R. Varshney , Vijay Gupta

We study a model of consensus decision making, in which a finite group of Bayesian agents has to choose between one of two courses of action. Each member of the group has a private and independent signal at his or her disposal, giving some…

Statistics Theory · Mathematics 2018-04-24 Elchanan Mossel , Omer Tamuz

Complex learning agents are increasingly deployed alongside existing experts, such as human operators or previously trained agents. However, it remains unclear how should learners optimally incorporate certain forms of expert data, which…

Machine Learning · Computer Science 2025-10-10 Daniel Jarne Ornia , Joel Dyer , Nicholas Bishop , Anisoara Calinescu , Michael Wooldridge

This work investigates a dynamic variant of Bayesian persuasion, in which a strategic sender seeks to influence a receiver's belief over time through controlling the timing of the information disclosure, under resource constraints. We…

Information Theory · Computer Science 2025-12-05 Ahmet Bugra Gundogan , Melih Bastopcu

Automated decision-making tools increasingly assess individuals to determine if they qualify for high-stakes opportunities. A recent line of research investigates how strategic agents may respond to such scoring tools to receive favorable…

Machine Learning · Computer Science 2021-10-28 Keegan Harris , Hoda Heidari , Zhiwei Steven Wu

Classical reinforcement learning assumes the agent interacts with a fixed environment whose behavior does not depend on the agent's policy. This assumption breaks down in non-realizable settings where other actors might anticipate the…

We study the classic principal-agent model when the signal observed by the principal is chosen by the agent. We fully characterize the optimal information structure from an agent's perspective in a general moral hazard setting with limited…

Theoretical Economics · Economics 2023-07-25 Majid Mahzoon , Ali Shourideh , Ariel Zetlin-Jones

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

Machine Learning · Computer Science 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

The problem of making sequential decisions in unknown probabilistic environments is studied. In cycle $t$ action $y_t$ results in perception $x_t$ and reward $r_t$, where all quantities in general may depend on the complete history. The…

Artificial Intelligence · Computer Science 2007-05-23 Marcus Hutter

We study the problem of agent selection in causal strategic learning under multiple decision makers and address two key challenges that come with it. Firstly, while much of prior work focuses on studying a fixed pool of agents that remains…

Artificial Intelligence · Computer Science 2024-02-06 Kiet Q. H. Vo , Muneeb Aadil , Siu Lun Chau , Krikamol Muandet

A principal delegates choice to an agent whose decision depends on both beliefs and tastes. The principal can steer the delegated decision using two costly instruments: (i) an information policy that determines a Bayes--plausible…

Theoretical Economics · Economics 2026-02-12 Kemal Ozbek

We study how a principal can jointly shape an agent's timing and action through information. We develop a revelation principle: with intertemporal commitment, the problem simplifies to choosing a joint distribution over stopping times and…

Theoretical Economics · Economics 2025-11-26 Andrew Koh , Sivakorn Sanguanmoo , Weijie Zhong

Real-world applications of reinforcement learning for recommendation and experimentation faces a practical challenge: the relative reward of different bandit arms can evolve over the lifetime of the learning agent. To deal with these…

Machine Learning · Computer Science 2022-06-29 Srivas Chennu , Andrew Maher , Jamie Martin , Subash Prabanantham

We examine the strategic interaction between an expert (principal) maximizing engagement and an agent seeking swift information. Our analysis reveals: When priors align, relative patience determines optimal disclosure -- impatient agents…

Theoretical Economics · Economics 2024-07-30 Maryam Saeedi , Yikang Shen , Ali Shourideh

We frame dynamic persuasion in a partial observation stochastic control Leader-Follower game with an ergodic criterion. The Receiver controls the dynamics of a multidimensional unobserved state process. Information is provided to the…

Optimization and Control · Mathematics 2025-06-23 René Aïd , Ofelia Bonesini , Giorgia Callegaro , Luciano Campi

If a sender in a persuasion game can use a sequence of experiments rather than a single experiment, does this change the sender's value? We show that the sender can benefit more from dynamic persuasion than from static persuasion when the…

Theoretical Economics · Economics 2026-04-20 Masanori Kobayashi