English
Related papers

Related papers: Markov Persuasion Processes: Learning to Persuade …

200 papers

We study a game of strategic information design between a sender, who chooses state-dependent information structures, a mediator who can then garble the signals generated from these structures, and a receiver who takes an action after…

Theoretical Economics · Economics 2020-12-07 Andrew Kosenko

In the autonomous driving area, interaction between vehicles is still a piece of puzzle which has not been fully resolved. The ability to intelligently and safely interact with other vehicles can not only improve self driving quality but…

Optimization and Control · Mathematics 2018-09-27 Cheng Peng , Masayoshi Tomizuka

Bayesian persuasion and its derived information design problem has been one of the main research agendas in the economics and computation literature over the past decade. However, when attempting to apply its model and theory, one is often…

Computer Science and Game Theory · Computer Science 2023-03-21 Bonan Ni , Weiran Shen , Pingzhong Tang

We focus on the scenario in which an agent can exploit his information advantage to manipulate the outcome of an election. In particular, we study district-based elections with two candidates, in which the winner of the election is the…

Computer Science and Game Theory · Computer Science 2020-12-11 Matteo Castiglioni , Nicola Gatti

In many interactive decision-making settings, there is latent and unobserved information that remains fixed. Consider, for example, a dialogue system, where complete information about a user, such as the user's preferences, is not given. In…

Machine Learning · Computer Science 2023-10-12 Jeongyeol Kwon , Yonathan Efroni , Shie Mannor , Constantine Caramanis

In this paper, we study axiomatic foundations of Bayesian persuasion, where a principal (i.e., sender) delegates the task of choice making after informing a biased agent (i.e., receiver) about the payoff relevant uncertain state (see, e.g.,…

Theoretical Economics · Economics 2025-12-30 Youichiro Higashi , Kemal Ozbek , Norio Takeoka

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…

Optimization and Control · Mathematics 2015-07-07 Mahmoud El Chamie , Behcet Acikmese

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

In many real-world problems, there is the possibility to configure, to a limited extent, some environmental parameters to improve the performance of a learning agent. In this paper, we propose a novel framework, Configurable Markov Decision…

Artificial Intelligence · Computer Science 2018-06-15 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

We frame dynamic persuasion in a partial observation stochastic control Leader-Follower game with an ergodic criterion. The Receiver controls the dynamics of a multidimensional unobserved state process. Information is provided to the…

Optimization and Control · Mathematics 2025-06-23 René Aïd , Ofelia Bonesini , Giorgia Callegaro , Luciano Campi

A fundamental assumption of reinforcement learning in Markov decision processes (MDPs) is that the relevant decision process is, in fact, Markov. However, when MDPs have rich observations, agents typically learn by way of an abstract state…

Machine Learning · Computer Science 2024-03-18 Cameron Allen , Neev Parikh , Omer Gottesman , George Konidaris

In Bayesian networks, exact belief propagation is achieved through message passing algorithms. These algorithms (ex: inward and outward) provide only a recursive definition of the corresponding messages. In contrast, when working on hidden…

Probability · Mathematics 2012-01-24 G. Nuel

We propose a dynamic product adoption persuasion model involving an impatient partially informed sender who gradually learns the state. In this model, the sender gathers information over time, and hence her posteriors' sequence forms a…

Computer Science and Game Theory · Computer Science 2024-07-22 Itai Arieli , Yakov Babichenko , Dimitry Shaiderman , Xianwen Shi

We present a general framework for applying learning algorithms and heuristical guidance to the verification of Markov decision processes (MDPs). The primary goal of our techniques is to improve performance by avoiding an exhaustive…

We explore whether ambiguous communication can be beneficial to the sender in a persuasion problem, when the receiver (and possibly the sender) is ambiguity averse. Our analysis highlights the necessity of using a collection of experiments…

Theoretical Economics · Economics 2026-02-19 Xiaoyu Cheng , Peter Klibanoff , Sujoy Mukerji , Ludovic Renou

We consider the problem of communicating exogenous information by means of Markov decision process trajectories. This setting, which we call a Markov coding game (MCG), generalizes both source coding and a large class of referential games.…

We investigate a two-period Bayesian persuasion game, where the receiver faces a decision, akin to a one-armed bandit problem: to undertake an action, gaining noisy information and a corresponding positive or negative payoff, or to refrain.…

Optimization and Control · Mathematics 2024-01-11 Massimo DAntoni , Ehud Lehrer , Avraham Tabbach , Eilon Solan

We study computational questions in a game-theoretic model that, in particular, aims to capture advertising/persuasion applications such as viral marketing. Specifically, we consider a multi-agent Bayesian persuasion model where an informed…

Computer Science and Game Theory · Computer Science 2016-03-07 Yakov Babichenko , Siddharth Barman

In most applications of model-based Markov decision processes, the parameters for the unknown underlying model are often estimated from the empirical data. Due to noise, the policy learnedfrom the estimated model is often far from the…

Machine Learning · Computer Science 2022-09-22 Samarth Gupta , Daniel N. Hill , Lexing Ying , Inderjit Dhillon

I describe a Bayesian persuasion problem where Receiver has a private type representing a cutoff for choosing Sender's preferred action, and Sender has maxmin preferences over all Receiver type distributions with known mean and bounds. This…

Theoretical Economics · Economics 2025-09-03 Eitan Sapiro-Gheiler