English
Related papers

Related papers: Stackelberg POMDP: A Reinforcement Learning Approa…

200 papers

We investigate a co-design problem, encompassing simultaneous design of system infrastructure and control, through a game-theoretical framework. To this end, we propose the co-design problem as a two-layer hierarchical strategic…

Systems and Control · Electrical Eng. & Systems 2025-08-18 Julian Barreiro-Gomez , Ye Wang

This paper introduces the new concept of (follower) satisfaction in Stackelberg games and compares the standard Stackelberg game with its satisfaction version. Simulation results are presented which suggest that the follower adopting…

Computer Science and Game Theory · Computer Science 2024-08-22 Langford White , Duong Nguyen , Hung Nguyen

We introduce and study incentive equilibria for multi-player meanpayoff games. Incentive equilibria generalise well-studied solution concepts such as Nash equilibria and leader equilibria (also known as Stackelberg equilibria). Recall that…

Computer Science and Game Theory · Computer Science 2015-11-03 Anshul Gupta , M. S. Krishna Deepak , Bharath Kumar Padarthi , Sven Schewe , Ashutosh Trivedi

This paper investigates the convergence of learning dynamics in Stackelberg games. In the class of games we consider, there is a hierarchical game being played between a leader and a follower with continuous action spaces. We establish a…

Computer Science and Game Theory · Computer Science 2024-12-07 Tanner Fiez , Benjamin Chasnov , Lillian J. Ratliff

Here we present a ground-breaking new postulate for game theory. The first part of this postulate contains the axiomatic observation that all games are created by a designer, whether they are: e.g., (dynamic/static) or…

Computer Science and Game Theory · Computer Science 2015-06-02 Jie Dong , Nicole Sawyer , David Smith

Algorithms for playing in Stackelberg games have been deployed in real-world domains including airport security, anti-poaching efforts, and cyber-crime prevention. However, these algorithms often fail to take into consideration the…

Computer Science and Game Theory · Computer Science 2024-10-15 Keegan Harris , Zhiwei Steven Wu , Maria-Florina Balcan

We study an online learning problem in general-sum Stackelberg games, where players act in a decentralized and strategic manner. We study two settings depending on the type of information for the follower: (1) the limited information…

Machine Learning · Computer Science 2025-05-06 Yaolong Yu , Haipeng Chen

Stackelberg equilibrium is a solution concept that describes optimal strategies to commit: Player 1 (the leader) first commits to a strategy that is publicly announced, then Player 2 (the follower) plays a best response to the leader's…

Computer Science and Game Theory · Computer Science 2021-11-04 Aditya Aradhye , Branislav Bošanský , Michael Hlaváček

We study a two-player Stackelberg game with incomplete information such that the follower's strategy belongs to a known family of parameterized functions with an unknown parameter vector. We design an adaptive learning approach to…

Computer Science and Game Theory · Computer Science 2021-01-12 Guosong Yang , Radha Poovendran , João P. Hespanha

In this paper, we are concerned with the stabilizatbility of Stackelberg game-based systems. In particular, two players are involved in the system where one is the follower to minimize the related cost function and the other is the leader…

Optimization and Control · Mathematics 2021-05-04 Yue Sun , Juanjuan Xu , Huanshui Zhang

We study policy optimization in Stackelberg mean field games (MFGs), a hierarchical framework for modeling the strategic interaction between a single leader and an infinitely large population of homogeneous followers. The objective can be…

Machine Learning · Computer Science 2025-11-27 Sihan Zeng , Benjamin Patrick Evans , Sujay Bhatt , Leo Ardon , Sumitra Ganesh , Alec Koppel

Large language model (LLM) agents have shown remarkable progress in social deduction games (SDGs). However, existing approaches primarily focus on information processing and strategy selection, overlooking the significance of persuasive…

Artificial Intelligence · Computer Science 2026-04-15 Zhang Zheng , Deheng Ye , Peilin Zhao , Hao Wang

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

Artificial Intelligence · Computer Science 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Many real-world strategic games involve interactions between multiple players. We study a hierarchical multi-player game structure, where players with asymmetric roles can be separated into leaders and followers, a setting often referred to…

Machine Learning · Computer Science 2022-10-25 Yaolong Yu , Haifeng Xu , Haipeng Chen

Inverse game theory is utilized to infer the cost functions of all players based on game outcomes. However, existing inverse game theory methods do not consider the learner as an active participant in the game, which could significantly…

Computer Science and Game Theory · Computer Science 2025-10-20 Jianguo Chen , Jinlong Lei , Biqiang Mu , Yiguang Hong , Hongsheng Qi

Autocurricular training is an important sub-area of multi-agent reinforcement learning~(MARL) that allows multiple agents to learn emergent skills in an unsupervised co-evolving scheme. The robotics community has experimented autocurricular…

Artificial Intelligence · Computer Science 2023-05-09 Boling Yang , Liyuan Zheng , Lillian J. Ratliff , Byron Boots , Joshua R. Smith

Stackelberg games are a classic example of bilevel optimization problems, which are often encountered in game theory and economics. These are complex problems with a hierarchical structure, where one optimization task is nested within the…

Computer Science and Game Theory · Computer Science 2013-07-25 Ankur Sinha , Pekka Malo , Anton Frantsev , Kalyanmoy Deb

Resource competition problems are often modeled using Colonel Blotto games, where players take simultaneous actions. However, many real-world scenarios involve sequential decision-making rather than simultaneous moves. To model these…

Computer Science and Game Theory · Computer Science 2025-05-13 Yan Liu , Bonan Ni , Weiran Shen , Zihe Wang , Jie Zhang

Dynamic Stackelberg games are a broad class of two-player games in which the leader acts first, and the follower chooses a response strategy to the leader's strategy. Unfortunately, only stylized Stackelberg games are explicitly solvable…

Optimization and Control · Mathematics 2024-11-15 Guillermo Alvarez , Ibrahim Ekren , Anastasis Kratsios , Xuwei Yang

We study payoff manipulation in repeated multi-objective Stackelberg games, where a leader may strategically influence a follower's deterministic best response, e.g., by offering a share of their own payoff. We assume that the follower's…

Computer Science and Game Theory · Computer Science 2025-08-27 Phurinut Srisawad , Juergen Branke , Long Tran-Thanh