English
Related papers

Related papers: Learning in Stackelberg Games with Non-myopic Agen…

200 papers

We study a ubiquitous learning challenge in online principal-agent problems during which the principal learns the agent's private information from the agent's revealed preferences in historical interactions. This paradigm includes important…

Computer Science and Game Theory · Computer Science 2024-01-01 Minbiao Han , Michael Albert , Haifeng Xu

A Stackelberg game is played between a leader and a follower. The leader first chooses an action, then the follower plays his best response. The goal of the leader is to pick the action that will maximize his payoff given the follower's…

Data Structures and Algorithms · Computer Science 2015-11-19 Aaron Roth , Jonathan Ullman , Zhiwei Steven Wu

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

Machine Learning · Computer Science 2025-06-03 Junyan Liu , Lillian J. Ratliff

Guided cooperation allows intelligent agents with heterogeneous capabilities to work together by following a leader-follower type of interaction. However, the associated control problem becomes challenging when the leader agent does not…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Yuhan Zhao , Quanyan Zhu

We study a two-player Stackelberg game with incomplete information such that the follower's strategy belongs to a known family of parameterized functions with an unknown parameter vector. We design an adaptive learning approach to…

Computer Science and Game Theory · Computer Science 2021-01-12 Guosong Yang , Radha Poovendran , João P. Hespanha

Optimizing strategic decisions (a.k.a. computing equilibrium) is key to the success of many non-cooperative multi-agent applications. However, in many real-world situations, we may face the exact opposite of this game-theoretic problem --…

Computer Science and Game Theory · Computer Science 2022-10-05 Jibang Wu , Weiran Shen , Fei Fang , Haifeng Xu

We introduce a reinforcement learning framework for economic design where the interaction between the environment designer and the participants is modeled as a Stackelberg game. In this game, the designer (leader) sets up the rules of the…

Computer Science and Game Theory · Computer Science 2024-07-22 Gianluca Brero , Alon Eden , Darshan Chakrabarti , Matthias Gerstgrasser , Amy Greenwald , Vincent Li , David C. Parkes

Designing socially optimal policies in multi-agent environments is a fundamental challenge in both economics and artificial intelligence. This paper studies a general framework for learning Stackelberg equilibria in dynamic and uncertain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Jun He , Andrew L. Liu , Yihsu Chen

Real world applications such as economics and policy making often involve solving multi-agent games with two unique features: (1) The agents are inherently asymmetric and partitioned into leaders and followers; (2) The agents have different…

Machine Learning · Computer Science 2021-11-04 Yu Bai , Chi Jin , Huan Wang , Caiming Xiong

We consider a Stackelberg game in which a principal (she) establishes a two-stage contract with a non-myopic agent (he) whose type is unknown. The contract takes the form of an incentive function mapping the agent's first-stage action to…

Computer Science and Game Theory · Computer Science 2024-10-24 Munther A. Dahleh , Thibaut Horel , M. Umar B. Niazi

We consider a number of questions related to tradeoffs between reward and regret in repeated gameplay between two agents. To facilitate this, we introduce a notion of $\textit{generalized equilibrium}$ which allows for asymmetric regret…

Computer Science and Game Theory · Computer Science 2023-12-19 William Brown , Jon Schneider , Kiran Vodrahalli

In classic principal-agent problems such as Stackelberg games, contract design, and Bayesian persuasion, the agent best responds to the principal's committed strategy. We study repeated generalized principal-agent problems under the…

Computer Science and Game Theory · Computer Science 2025-10-22 Tao Lin , Yiling Chen

As machine learning algorithms increasingly influence critical decision making in different application areas, understanding human strategic behavior in response to these systems becomes vital. We explore individuals' choice between…

Machine Learning · Computer Science 2026-03-17 Sura Alhanouti , Parinaz Naghizadeh

In repeated stochastic games (RSGs), an agent must quickly adapt to the behavior of previously unknown associates, who may themselves be learning. This machine-learning problem is particularly challenging due, in part, to the presence of…

Computer Science and Game Theory · Computer Science 2018-01-22 Jacob W. Crandall

This work considers a repeated principal-agent bandit game, where the principal can only interact with her environment through the agent. The principal and the agent have misaligned objectives and the choice of action is only left to the…

We study an online learning problem in general-sum Stackelberg games, where players act in a decentralized and strategic manner. We study two settings depending on the type of information for the follower: (1) the limited information…

Machine Learning · Computer Science 2025-05-06 Yaolong Yu , Haipeng Chen

We study payoff manipulation in repeated multi-objective Stackelberg games, where a leader may strategically influence a follower's deterministic best response, e.g., by offering a share of their own payoff. We assume that the follower's…

Computer Science and Game Theory · Computer Science 2025-08-27 Phurinut Srisawad , Juergen Branke , Long Tran-Thanh

In Stackelberg security games when information about the attacker's payoffs is uncertain, algorithms have been proposed to learn the optimal defender commitment by interacting with the attacker and observing their best responses. In this…

Computer Science and Game Theory · Computer Science 2019-11-01 Jiarui Gan , Qingyu Guo , Long Tran-Thanh , Bo An , Michael Wooldridge

We study how a principal can efficiently and effectively intervene on the rewards of a previously unseen learning agent in order to induce desirable outcomes. This is relevant to many real-world settings like auctions or taxation, where the…

Machine Learning · Computer Science 2024-01-11 Arundhati Banerjee , Soham Phade , Stefano Ermon , Stephan Zheng

We study online learning in Bayesian Stackelberg games, where a leader repeatedly interacts with a follower whose unknown private type is independently drawn at each round from an unknown probability distribution. The goal is to design…

Computer Science and Game Theory · Computer Science 2026-02-03 Matteo Bollini , Francesco Bacchiocchi , Samuel Coutts , Matteo Castiglioni , Alberto Marchesi