English
Related papers

Related papers: The Sample Complexity of Stackelberg Games

200 papers

Model-based reinforcement learning (RL), which finds an optimal policy using an empirical model, has long been recognized as one of the corner stones of RL. It is especially suitable for multi-agent RL (MARL), as it naturally decouples the…

Machine Learning · Computer Science 2023-08-10 Kaiqing Zhang , Sham M. Kakade , Tamer Başar , Lin F. Yang

Game theory serves as a powerful tool for distributed optimization in multi-agent systems in different applications. In this paper we consider multi-agent systems that can be modeled by means of potential games whose potential function…

Optimization and Control · Mathematics 2018-04-13 Tatiana Tatarenko

In Stackelberg security games when information about the attacker's payoffs is uncertain, algorithms have been proposed to learn the optimal defender commitment by interacting with the attacker and observing their best responses. In this…

Computer Science and Game Theory · Computer Science 2019-11-01 Jiarui Gan , Qingyu Guo , Long Tran-Thanh , Bo An , Michael Wooldridge

A growing body of work in game theory extends the traditional Stackelberg game to settings with one leader and multiple followers who play a Nash equilibrium. Standard approaches for computing equilibria in these games reformulate the…

Computer Science and Game Theory · Computer Science 2021-12-07 Kai Wang , Lily Xu , Andrew Perrault , Michael K. Reiter , Milind Tambe

We address the question of repeatedly learning linear classifiers against agents who are strategically trying to game the deployed classifiers, and we use the Stackelberg regret to measure the performance of our algorithms. First, we show…

Computer Science and Game Theory · Computer Science 2020-11-17 Yiling Chen , Yang Liu , Chara Podimata

We study turn-based stochastic zero-sum games with lexicographic preferences over reachability and safety objectives. Stochastic games are standard models in control, verification, and synthesis of stochastic reactive systems that exhibit…

Computer Science and Game Theory · Computer Science 2022-07-21 Krishnendu Chatterjee , Joost-Pieter Katoen , Maximilian Weininger , Tobias Winkler

We study multi-player general-sum Markov games with one of the players designated as the leader and the other players regarded as followers. In particular, we focus on the class of games where the followers are myopic, i.e., they aim to…

Machine Learning · Computer Science 2021-12-28 Han Zhong , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

We study the computational complexity of finding Stackelberg Equilibria in general-sum games, where the set of pure strategies of the leader and the followers are exponentially large in a natrual representation of the problem. In…

Computer Science and Game Theory · Computer Science 2019-09-10 Avrim Blum , Nika Hagtalab , MohammadTaghi Hajiaghayi , Saeed Seddighin

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

We study a Stackelberg variant of the classical discrete-time Dynkin game, in which Player 1 (the leader) commits to a stopping strategy first and Player 2 (the follower) responds optimally. This leader-follower structure induces an optimal…

Optimization and Control · Mathematics 2026-05-26 Jingjie Zhang , Zhou Zhou

Strategic interaction in congested systems is commonly modelled using Stackelberg games, where competing leaders anticipate the behaviour of self-interested followers. A key limitation of existing models is that they typically ignore agents…

Multiagent Systems · Computer Science 2026-03-06 Niloofar Aminikalibar , Farzaneh Farhadi , Maria Chli

This paper introduces a simulation algorithm for evaluating the log-likelihood function of a large supermodular binary-action game. Covered examples include (certain types of) peer effect, technology adoption, strategic network formation,…

Econometrics · Economics 2023-07-25 Bryan S. Graham , Andrin Pelican

We address Stackelberg models of combinatorial congestion games (CCGs); we aim to optimize the parameters of CCGs so that the selfish behavior of non-atomic players attains desirable equilibria. This model is essential for designing such…

Computer Science and Game Theory · Computer Science 2021-10-19 Shinsaku Sakaue , Kengo Nakamura

Stackelberg planning is a recently introduced single-turn two-player adversarial planning model, where two players are acting in a joint classical planning task, the objective of the first player being hampering the second player from…

Artificial Intelligence · Computer Science 2024-03-27 Gregor Behnke , Marcel Steinmetz

Most models of Stackelberg security games assume that the attacker only knows the defender's mixed strategy, but is not able to observe (even partially) the instantiated pure strategy. Such partial observation of the deployed pure strategy…

Computer Science and Game Theory · Computer Science 2015-05-05 Haifeng Xu , Albert X. Jiang , Arunesh Sinha , Zinovi Rabinovich , Shaddin Dughmi , Milind Tambe

Graph games provide the foundation for modeling and synthesizing reactive processes. In the synthesis of stochastic reactive processes, the traditional model is perfect-information stochastic games, where some transitions of the game graph…

Logic in Computer Science · Computer Science 2016-04-22 Krishnendu Chatterjee , Laurent Doyen

We analyze the sample complexity of learning graphical games from purely behavioral data. We assume that we can only observe the players' joint actions and not their payoffs. We analyze the sufficient and necessary number of samples for the…

Computer Science and Game Theory · Computer Science 2018-11-16 Jean Honorio

When interacting with other decision-making agents in non-adversarial scenarios, it is critical for an autonomous agent to have inferable behavior: The agent's actions must convey their intention and strategy. We model the inferability…

Computer Science and Game Theory · Computer Science 2025-06-03 Mustafa O. Karabag , Sophia Smith , Negar Mehr , David Fridovich-Keil , Ufuk Topcu

Strategic classification studies the problem where self-interested individuals or agents manipulate their response to obtain favorable decision outcomes made by classifiers, typically turning to dishonest actions when they are less costly…

Machine Learning · Computer Science 2026-05-07 Ziyuan Huang , Lina Alkarmi , Mingyan Liu

In this paper, we consider a discrete-time Stackelberg mean field game with a leader and an infinite number of followers. The leader and the followers each observe types privately that evolve as conditionally independent controlled Markov…

Systems and Control · Electrical Eng. & Systems 2022-09-21 Deepanshu Vasal , Randall Berry