English
Related papers

Related papers: Incentivized Learning in Principal-Agent Bandit Ga…

200 papers

This paper considers the hidden-action model of the principal-agent problem, in which a principal incentivizes an agent to work on a project using a contract. We investigate whether contracts with bounded payments are learnable and…

Computer Science and Game Theory · Computer Science 2024-02-23 Yurong Chen , Zhaohua Chen , Xiaotie Deng , Zhiyi Huang

Recent developments in digital platforms have highlighted the prevalence of open systems, where agents can arrive and depart over time. While bandit learning in open systems has recently received initial attention, existing work imposes…

Machine Learning · Computer Science 2026-05-08 Mengfan Xu

In classic principal-agent problems such as Stackelberg games, contract design, and Bayesian persuasion, the agent best responds to the principal's committed strategy. We study repeated generalized principal-agent problems under the…

Computer Science and Game Theory · Computer Science 2025-10-22 Tao Lin , Yiling Chen

Incentivized exploration in multi-armed bandits (MAB) has witnessed increasing interests and many progresses in recent years, where a principal offers bonuses to agents to do explorations on her behalf. However, almost all existing studies…

Machine Learning · Statistics 2021-10-28 Chengshuai Shi , Haifeng Xu , Wei Xiong , Cong Shen

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

Machine Learning · Statistics 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

In repeated games, such as auctions, players rely on autonomous learning agents to choose their actions. We study settings in which players have their agents make monetary transfers to other agents during play at their own expense, in order…

Computer Science and Game Theory · Computer Science 2026-02-12 Yoav Kolumbus , Joe Halpern , Éva Tardos

The staggering feats of AI systems have brought to attention the topic of AI Alignment: aligning a "superintelligent" AI agent's actions with humanity's interests. Many existing frameworks/algorithms in alignment study the problem on a…

Machine Learning · Computer Science 2024-10-22 Hong Jun Jeon , Benjamin Van Roy

Information is often stored in a distributed and proprietary form, and agents who own information are often self-interested and require incentives to reveal their information. Suitable mechanisms are required to elicit and aggregate such…

Multiagent Systems · Computer Science 2022-12-02 Wenlong Wang , Thomas Pfeiffer

Individual decision-makers consume information revealed by the previous decision makers, and produce information that may help in future decisions. This phenomenon is common in a wide range of scenarios in the Internet economy, as well as…

Computer Science and Game Theory · Computer Science 2019-05-06 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis

How to incentivize self-interested agents to explore when they prefer to exploit? Consider a population of self-interested agents that make decisions under uncertainty. They "explore" to acquire new information and "exploit" this…

Computer Science and Game Theory · Computer Science 2024-10-23 Aleksandrs Slivkins

We study a ubiquitous learning challenge in online principal-agent problems during which the principal learns the agent's private information from the agent's revealed preferences in historical interactions. This paradigm includes important…

Computer Science and Game Theory · Computer Science 2024-01-01 Minbiao Han , Michael Albert , Haifeng Xu

The usage of automated learning agents is becoming increasingly prevalent in many online economic applications such as online auctions and automated trading. Motivated by such applications, this paper is dedicated to fundamental modeling…

Computer Science and Game Theory · Computer Science 2023-01-04 Yoav Kolumbus , Noam Nisan

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We consider the…

Computer Science and Game Theory · Computer Science 2019-11-21 Tobias Baumann , Thore Graepel , John Shawe-Taylor

Fraud can pose a challenge in many resource allocation domains, including social service delivery and credit provision. For example, agents may misreport private information in order to gain benefits or access to credit. To mitigate this, a…

Computer Science and Game Theory · Computer Science 2026-04-29 Sanmay Das , Fang-Yi Yu , Yuang Zhang

We study the problem of designing replication-proof bandit mechanisms when agents strategically register or replicate their own arms to maximize their payoff. Specifically, we consider Bayesian agents who only know the distribution from…

Computer Science and Game Theory · Computer Science 2025-02-04 Suho Shin , Seyed A. Esmaeili , MohammadTaghi Hajiaghayi

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

Multiagent Systems · Computer Science 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

We study a setting in which a principal selects an agent to execute a collection of tasks according to a specified priority sequence. Agents, however, have their own individual priority sequences according to which they wish to execute the…

Computer Science and Game Theory · Computer Science 2024-10-30 Donya G. Dobakhshari , Lav R. Varshney , Vijay Gupta

In this paper, we introduce the notion of replicable policies in the context of stochastic bandits, one of the canonical problems in interactive learning. A policy in the bandit environment is called replicable if it pulls, with high…

Machine Learning · Computer Science 2023-02-16 Hossein Esfandiari , Alkis Kalavasis , Amin Karbasi , Andreas Krause , Vahab Mirrokni , Grigoris Velegkas

We consider a ubiquitous scenario in the Internet economy when individual decision-makers (henceforth, agents) both produce and consume information as they make strategic choices in an uncertain environment. This creates a three-way…

Computer Science and Game Theory · Computer Science 2021-04-09 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis , Zhiwei Steven Wu

In reinforcement learning, an agent interacts sequentially with an environment to maximize a reward, receiving only partial, probabilistic feedback. This creates a fundamental exploration-exploitation trade-off: the agent must explore to…

Quantum Physics · Physics 2026-03-27 Josep Lumbreras , Ruo Cheng Huang , Yanglin Hu , Marco Fanizza , Mile Gu