English
Related papers

Related papers: Learning to Incentivize Information Acquisition: P…

200 papers

The increasing deployment of AI is shaping the future landscape of the internet, which is set to become an integrated ecosystem of AI agents. Orchestrating the interaction among AI agents necessitates decentralized, self-sustaining…

Computer Science and Game Theory · Computer Science 2024-10-08 Dima Ivanov , Paul Dütting , Inbal Talgam-Cohen , Tonghan Wang , David C. Parkes

We consider a ubiquitous scenario in the Internet economy when individual decision-makers (henceforth, agents) both produce and consume information as they make strategic choices in an uncertain environment. This creates a three-way…

Computer Science and Game Theory · Computer Science 2021-04-09 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis , Zhiwei Steven Wu

In principal-agent models, a principal offers a contract to an agent to perform a certain task. The agent exerts a level of effort that maximizes her utility. The principal is oblivious to the agent's chosen level of effort, and conditions…

Computer Science and Game Theory · Computer Science 2022-07-14 Alon Cohen , Moran Koren , Argyrios Deligkas

A well-intentioned principal provides information to a rationally inattentive agent without internalizing the agent's cost of processing information. Whatever information the principal makes available, the agent may choose to ignore some.…

Theoretical Economics · Economics 2022-03-04 Elliot Lipnowski , Laurent Mathevet , Dong Wei

With advances in generative AI, decision-making agents can now dynamically create new actions during online learning, but action generation typically incurs costs that must be balanced against potential benefits. We study an online learning…

Machine Learning · Computer Science 2025-10-01 Jianyu Xu , Vidhi Jain , Bryan Wilder , Aarti Singh

We study Stackelberg games where a principal repeatedly interacts with a non-myopic long-lived agent, without knowing the agent's payoff function. Although learning in Stackelberg games is well-understood when the agent is myopic, dealing…

Computer Science and Game Theory · Computer Science 2025-05-29 Nika Haghtalab , Thodoris Lykouris , Sloan Nietert , Alexander Wei

This paper considers the hidden-action model of the principal-agent problem, in which a principal incentivizes an agent to work on a project using a contract. We investigate whether contracts with bounded payments are learnable and…

Computer Science and Game Theory · Computer Science 2024-02-23 Yurong Chen , Zhaohua Chen , Xiaotie Deng , Zhiyi Huang

We study how a principal can efficiently and effectively intervene on the rewards of a previously unseen learning agent in order to induce desirable outcomes. This is relevant to many real-world settings like auctions or taxation, where the…

Machine Learning · Computer Science 2024-01-11 Arundhati Banerjee , Soham Phade , Stefano Ermon , Stephan Zheng

I introduce a model of predictive scoring. A receiver wants to predict a sender's quality. An intermediary observes multiple features of the sender and aggregates them into a score. Based on the score, the receiver makes a decision. The…

Theoretical Economics · Economics 2024-05-17 Ian Ball

This work considers a novel information design problem and studies how the craft of payoff-relevant environmental signals solely can influence the behaviors of intelligent agents. The agents' strategic interactions are captured by a Markov…

Multiagent Systems · Computer Science 2021-06-15 Tao Zhang , Quanyan Zhu

Current imitation learning techniques are too restrictive because they require the agent and expert to share the same action space. However, oftentimes agents that act differently from the expert can solve the task just as good. For…

Machine Learning · Computer Science 2018-09-18 Nir Baram , Shie Mannor

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

Machine Learning · Computer Science 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan

All sequential decision-making agents explore so as to acquire knowledge about a particular target. It is often the responsibility of the agent designer to construct this target which, in rich and complex environments, constitutes a onerous…

Machine Learning · Computer Science 2021-10-28 Dilip Arumugam , Benjamin Van Roy

Agents are systems that optimize an objective function in an environment. Together, the goal and the environment induce secondary objectives, incentives. Modeling the agent-environment interaction using causal influence diagrams, we can…

Artificial Intelligence · Computer Science 2022-01-21 Tom Everitt , Pedro A. Ortega , Elizabeth Barnes , Shane Legg

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

We study the problem of decision-making in the setting of a scarcity of shared resources when the preferences of agents are unknown a priori and must be learned from data. Taking the two-sided matching market as a running example, we focus…

Computer Science and Game Theory · Computer Science 2021-11-24 Xiaowu Dai , Michael I. Jordan

In this paper we study a principal-agent problem in continuous time with multiple lump-sum payments (contracts) paid at different deterministic times. We reduce the non-zero sum Stackelberg game between the principal and agent to a standard…

Optimization and Control · Mathematics 2024-11-08 Guillermo Alonso Alvarez , Erhan Bayraktar , Ibrahim Ekren , Liwei Huang

We consider the problem of incentivising desirable behaviours in multi-agent systems by way of taxation schemes. Our study employs the concurrent games model: in this model, each agent is primarily motivated to seek the satisfaction of a…

Computer Science and Game Theory · Computer Science 2023-07-12 David Hyland , Julian Gutierrez , Michael Wooldridge

Machine learning systems have been widely used to make decisions about individuals who may behave strategically to receive favorable outcomes, e.g., they may genuinely improve the true labels or manipulate observable features directly to…

Artificial Intelligence · Computer Science 2024-10-30 Tian Xie , Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

This article studies the problem of evaluating the information that a Principal lacks when establishing an incentive contract with an Agent whose effort is not observable. The Principal ("she") pays a continuous rent to the Agent ("he"),…

Optimization and Control · Mathematics 2023-04-10 Ishak Hajjej , Caroline Hillairet , Mohamed Mnif