English
Related papers

Related papers: Markov Persuasion Processes with Endogenous Agent …

200 papers

We study a model of persuasion in which the receiver is a `conservative Bayesian' whose updated belief is a convex combination of the prior and the correct Bayesian posterior. While in the classic Bayesian case providing information…

Theoretical Economics · Economics 2025-08-14 Yaron Azrieli , Rachana Das

Consider a typical organization whose worker agents seek to collectively cooperate for its general betterment. However, each individual agent simultaneously seeks to act to secure a larger chunk than its co-workers of the annual increment…

Machine Learning · Computer Science 2020-10-19 Keyang He , Bikramjit Banerjee , Prashant Doshi

We study the problem of designing an optimal sequence of incentives that a principal should offer to an agent so that the agent's optimal behavior under the incentives realizes the principal's objective expressed as a temporal logic…

Optimization and Control · Mathematics 2019-03-20 Yagiz Savas , Vijay Gupta , Melkior Ornik , Lillian J. Ratliff , Ufuk Topcu

We propose a dynamic product adoption persuasion model involving an impatient partially informed sender who gradually learns the state. In this model, the sender gathers information over time, and hence her posteriors' sequence forms a…

Computer Science and Game Theory · Computer Science 2024-07-22 Itai Arieli , Yakov Babichenko , Dimitry Shaiderman , Xianwen Shi

An important question in the field of AI is the extent to which successful behaviour requires an internal representation of the world. In this work, we quantify the amount of information an optimal policy provides about the underlying…

Artificial Intelligence · Computer Science 2026-02-16 Alfred Harwood , Jose Faustino , Alex Altair

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems cannot be solved by a…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Merrick , Jiankun Hu

We study a dynamic model in which a principal monitors agents based on historical data of infractions. This data informs when and at what intensity to monitor; the monitoring decision, in turn, selects the collected data, shaping the…

Theoretical Economics · Economics 2026-05-15 Yeon-Koo Che , Jinwoo Kim , Konrad Mierendorff

We study learning dynamics induced by strategic agents who repeatedly play a game with an unknown payoff-relevant parameter. In each step, an information system estimates a belief distribution of the parameter based on the players'…

Systems and Control · Electrical Eng. & Systems 2020-10-20 Manxi Wu , Saurabh Amin , Asuman Ozdaglar

Our work aims at developing reinforcement learning algorithms that do not rely on the Markov assumption. We consider the class of Non-Markov Decision Processes where histories can be abstracted into a finite set of states while preserving…

Machine Learning · Computer Science 2022-05-19 Alessandro Ronca , Gabriel Paludo Licks , Giuseppe De Giacomo

We study the problem of optimizing the decisions of a preemptively capable transmitter to minimize the Age of Incorrect Information (AoII) when the communication channel has a random delay. We consider a slotted-time system where a…

Information Theory · Computer Science 2023-02-21 Yutao Chen , Anthony Ephremides

We study the design of autonomous agents that are capable of deceiving outside observers about their intentions while carrying out tasks in stochastic, complex environments. By modeling the agent's behavior as a Markov decision process, we…

Artificial Intelligence · Computer Science 2021-09-15 Yagiz Savas , Christos K. Verginis , Ufuk Topcu

Machine learning algorithms have been applied to predict agent behaviors in real-world dynamic systems, such as advertiser behaviors in sponsored search and worker behaviors in crowdsourcing. The behavior data in these systems are generated…

Machine Learning · Computer Science 2014-07-14 Fei Tian , Haifang Li , Wei Chen , Tao Qin , Enhong Chen , Tie-Yan Liu

The main goal of this paper is to investigate continuous-time distributed dynamic programming (DP) algorithms for networked multi-agent Markov decision problems (MAMDPs). In our study, we adopt a distributed multi-agent framework where…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Donghwan Lee , Han-Dong Lim , Do Wan Kim

Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing…

Machine Learning · Statistics 2020-06-26 Daniel Jarrett , Mihaela van der Schaar

We consider the problem of communicating exogenous information by means of Markov decision process trajectories. This setting, which we call a Markov coding game (MCG), generalizes both source coding and a large class of referential games.…

Game theory serves as a powerful tool for distributed optimization in multi-agent systems in different applications. In this paper we consider multi-agent systems that can be modeled by means of potential games whose potential function…

Optimization and Control · Mathematics 2018-04-13 Tatiana Tatarenko

This paper proposes a formal approach to online learning and planning for agents operating in a priori unknown, time-varying environments. The proposed method computes the maximally likely model of the environment, given the observations…

Machine Learning · Computer Science 2021-02-09 Melkior Ornik , Ufuk Topcu

The analysis of high-dimensional time series data has become increasingly important across a wide range of fields. Recently, a method for constructing the minimum information Markov kernel on finite state spaces was established. In this…

Methodology · Statistics 2026-01-13 Issey Sukeda , Tomonari Sei

We compare different selection criteria to choose the number of latent states of a multivariate latent Markov model for longitudinal data. This model is based on an underlying Markov chain to represent the evolution of a latent…

Methodology · Statistics 2012-12-04 Silvia Bacci , Silvia Pandolfi , Fulvia Pennoni

This paper formally models the strategic repeated interactions between a system, comprising of a machine learning (ML) model and associated explanation method, and an end-user who is seeking a prediction/label and its explanation for a…

Computer Science and Game Theory · Computer Science 2022-08-24 Kavita Kumari , Murtuza Jadliwala , Sumit Kumar Jha , Anindya Maiti