English
Related papers

Related papers: Convergence of Learning Dynamics in Stackelberg Ga…

200 papers

Learning in zero-sum games studies a situation where multiple agents competitively learn their strategy. In such multi-agent learning, we often see that the strategies cycle around their optimum, i.e., Nash equilibrium. When a game…

Computer Science and Game Theory · Computer Science 2025-03-06 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

Adversarial deep learning is to train robust DNNs against adversarial attacks, which is one of the major research focuses of deep learning. Game theory has been used to answer some of the basic questions about adversarial deep learning such…

Machine Learning · Computer Science 2022-07-19 Xiao-Shan Gao , Shuang Liu , Lijia Yu

Designing socially optimal policies in multi-agent environments is a fundamental challenge in both economics and artificial intelligence. This paper studies a general framework for learning Stackelberg equilibria in dynamic and uncertain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Jun He , Andrew L. Liu , Yihsu Chen

In this paper, we present an efficient algorithm to solve online Stackelberg games, featuring multiple followers, in a follower-agnostic manner. Unlike previous works, our approach works even when leader has no knowledge about the…

Optimization and Control · Mathematics 2024-03-28 Chinmay Maheshwari , James Cheng , S. Shankar Sasty , Lillian Ratliff , Eric Mazumdar

In this paper, we consider two-player zero-sum matrix and stochastic games and develop learning dynamics that are payoff-based, convergent, rational, and symmetric between the two players. Specifically, the learning dynamics for matrix…

Machine Learning · Computer Science 2024-09-06 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

The Stackelberg game depicts a leader-follower relationship wherein decisions are made sequentially, and the Stackelberg equilibrium represents an expected optimal solution when the leader can anticipate the rational response of the…

Systems and Control · Electrical Eng. & Systems 2024-01-17 Yue Chen , Peng Yi

In Stackelberg v/s Stackelberg games a collection of leaders compete in a Nash game constrained by the equilibrium conditions of another Nash game amongst the followers. The resulting equilibrium problems are plagued by the nonuniqueness of…

Optimization and Control · Mathematics 2016-11-18 Ankur A. Kulkarni , Uday V. Shanbhag

We present a new solution concept called evolutionarily stable Stackelberg equilibrium (SESS). We study the Stackelberg evolutionary game setting in which there is a single leading player and a symmetric population of followers. The leader…

Computer Science and Game Theory · Computer Science 2026-03-26 Sam Ganzfried

We propose projection-free sequential algorithms for linear-quadratic dynamics games. These policy gradient based algorithms are akin to Stackelberg leadership model and can be extended to model-free settings. We show that if the leader…

Systems and Control · Electrical Eng. & Systems 2019-11-13 Jingjing Bu , Lillian J. Ratliff , Mehran Mesbahi

We introduce a stochastic learning process called the dampened gradient approximation process. While learning models have almost exclusively focused on finite games, in this paper we design a learning process for games with continuous…

Computer Science and Game Theory · Computer Science 2018-07-02 Sebastian Bervoets , Mario Bravo , Mathieu Faure

The Stackelberg equilibrium solution concept describes optimal strategies to commit to: Player 1 (termed the leader) publicly commits to a strategy and Player 2 (termed the follower) plays a best response to this strategy (ties are broken…

Computer Science and Game Theory · Computer Science 2016-08-24 Branislav Bosansky , Simina Branzei , Kristoffer Arnsfelt Hansen , Peter Bro Miltersen , Troels Bjerre Sorensen

We study multi-player general-sum Markov games with one of the players designated as the leader and the other players regarded as followers. In particular, we focus on the class of games where the followers are myopic, i.e., they aim to…

Machine Learning · Computer Science 2021-12-28 Han Zhong , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

We initiate the study of structured Stackelberg games, a novel form of strategic interaction between a leader and a follower where contextual information can be predictive of the follower's (unknown) type. Motivated by applications such as…

Computer Science and Game Theory · Computer Science 2026-05-18 Maria-Florina Balcan , Kiriaki Fragkia , Keegan Harris

We formulate a general framework for competitive gradient-based learning that encompasses a wide breadth of multi-agent learning algorithms, and analyze the limiting behavior of competitive gradient-based learning algorithms using dynamical…

Machine Learning · Computer Science 2020-02-21 Eric Mazumdar , Lillian J. Ratliff , S. Shankar Sastry

Learning in games considers how multiple agents maximize their own rewards through repeated games. Memory, an ability that an agent changes his/her action depending on the history of actions in previous games, is often introduced into…

Computer Science and Game Theory · Computer Science 2024-02-19 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

Stackelberg games have been widely used to model interactive decision-making problems in a variety of domains such as energy systems, transportation, cybersecurity, and human-robot interaction. However, existing algorithms for solving…

Optimization and Control · Mathematics 2023-03-14 Yansong Li , Shuo Han

Min-max optimization problems (i.e., min-max games) have attracted a great deal of attention recently as their applicability to a wide range of machine learning problems has become evident. In this paper, we study min-max games with…

Computer Science and Game Theory · Computer Science 2022-08-23 Denizalp Goktas , Amy Greenwald

We study an online learning problem in general-sum Stackelberg games, where players act in a decentralized and strategic manner. We study two settings depending on the type of information for the follower: (1) the limited information…

Machine Learning · Computer Science 2025-05-06 Yaolong Yu , Haipeng Chen

We study a Stackelberg variant of the classical discrete-time Dynkin game, in which Player 1 (the leader) commits to a stopping strategy first and Player 2 (the follower) responds optimally. This leader-follower structure induces an optimal…

Optimization and Control · Mathematics 2026-05-26 Jingjie Zhang , Zhou Zhou

In this paper, we introduce a generalization of the standard Stackelberg Games (SGs) framework: Calibrated Stackelberg Games (CSGs). In CSGs, a principal repeatedly interacts with an agent who (contrary to standard SGs) does not have direct…

Computer Science and Game Theory · Computer Science 2023-06-07 Nika Haghtalab , Chara Podimata , Kunhe Yang