English
Related papers

Related papers: Adaptive Learning in Two-Player Stackelberg Games …

200 papers

We study Stackelberg games where a principal repeatedly interacts with a non-myopic long-lived agent, without knowing the agent's payoff function. Although learning in Stackelberg games is well-understood when the agent is myopic, dealing…

Computer Science and Game Theory · Computer Science 2025-05-29 Nika Haghtalab , Thodoris Lykouris , Sloan Nietert , Alexander Wei

Batch reinforcement learning (RL) defines the task of learning from a fixed batch of data lacking exhaustive exploration. Worst-case optimality algorithms, which calibrate a value-function model class from logged experience and perform some…

Machine Learning · Statistics 2023-10-03 Wenzhuo Zhou , Annie Qu

We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We seek to design strategies for the learner to successfully interact with the opponent. While most previous…

Machine Learning · Computer Science 2020-07-13 Pier Giuseppe Sessa , Ilija Bogunovic , Maryam Kamgarpour , Andreas Krause

We study a repeated game between a supplier and a retailer who want to maximize their respective profits without full knowledge of the problem parameters. After characterizing the uniqueness of the Stackelberg equilibrium of the stage game…

Computer Science and Game Theory · Computer Science 2022-07-12 Nicolò Cesa-Bianchi , Tommaso Cesari , Takayuki Osogami , Marco Scarsini , Segev Wasserkrug

In this paper, we introduce a generalization of the standard Stackelberg Games (SGs) framework: Calibrated Stackelberg Games (CSGs). In CSGs, a principal repeatedly interacts with an agent who (contrary to standard SGs) does not have direct…

Computer Science and Game Theory · Computer Science 2023-06-07 Nika Haghtalab , Chara Podimata , Kunhe Yang

Trajectory guidance requires a leader robotic agent to assist a follower robotic agent to cooperatively reach the target destination. However, planning cooperation becomes difficult when the leader serves a family of different followers and…

Robotics · Computer Science 2024-03-19 Yuhan Zhao , Quanyan Zhu

Stackelberg games are a classic example of bilevel optimization problems, which are often encountered in game theory and economics. These are complex problems with a hierarchical structure, where one optimization task is nested within the…

Computer Science and Game Theory · Computer Science 2013-07-25 Ankur Sinha , Pekka Malo , Anton Frantsev , Kalyanmoy Deb

We study a Stackelberg variant of the classical discrete-time Dynkin game, in which Player 1 (the leader) commits to a stopping strategy first and Player 2 (the follower) responds optimally. This leader-follower structure induces an optimal…

Optimization and Control · Mathematics 2026-05-26 Jingjie Zhang , Zhou Zhou

Prior work has studied the computational complexity of computing optimal strategies to commit to in Stackelberg or leadership games, where a leader commits to a strategy which is observed by one or more followers. We extend this setting to…

Computer Science and Game Theory · Computer Science 2024-10-22 Nathaniel Sauerberg , Caspar Oesterheld

This contribution deals with a two-level discrete decision problem, a so-called Stackelberg strategic game: A Subset Sum setting is addressed with a set $N$ of items with given integer weights. One distinguished player, the leader, may…

Discrete Mathematics · Computer Science 2018-01-12 Ulrich Pferschy , Gaia Nicosia , Andrea Pacifici

Recent applications of Stackelberg Security Games (SSG), from wildlife crime to urban crime, have employed machine learning tools to learn and predict adversary behavior using available data about defender-adversary interactions. Given…

Artificial Intelligence · Computer Science 2015-11-23 Arunesh Sinha , Debarun Kar , Milind Tambe

We study payoff manipulation in repeated multi-objective Stackelberg games, where a leader may strategically influence a follower's deterministic best response, e.g., by offering a share of their own payoff. We assume that the follower's…

Computer Science and Game Theory · Computer Science 2025-08-27 Phurinut Srisawad , Juergen Branke , Long Tran-Thanh

We study policy optimization in Stackelberg mean field games (MFGs), a hierarchical framework for modeling the strategic interaction between a single leader and an infinitely large population of homogeneous followers. The objective can be…

Machine Learning · Computer Science 2025-11-27 Sihan Zeng , Benjamin Patrick Evans , Sujay Bhatt , Leo Ardon , Sumitra Ganesh , Alec Koppel

Shared control allows the human driver to collaborate with an assistive driving system while retaining the ability to make decisions and take control if necessary. However, human-vehicle teaming and planning are challenging due to…

Robotics · Computer Science 2024-03-19 Yuhan Zhao , Quanyan Zhu

Resource competition problems are often modeled using Colonel Blotto games, where players take simultaneous actions. However, many real-world scenarios involve sequential decision-making rather than simultaneous moves. To model these…

Computer Science and Game Theory · Computer Science 2025-05-13 Yan Liu , Bonan Ni , Weiran Shen , Zihe Wang , Jie Zhang

A growing body of work in game theory extends the traditional Stackelberg game to settings with one leader and multiple followers who play a Nash equilibrium. Standard approaches for computing equilibria in these games reformulate the…

Computer Science and Game Theory · Computer Science 2021-12-07 Kai Wang , Lily Xu , Andrew Perrault , Michael K. Reiter , Milind Tambe

We study a two-player dynamic Stackelberg game where the follower's intention is unknown to the leader. Classical formulations of the Stackelberg equilibrium (SE) assume that the follower's best response (BR) function is known to the…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Cayetana Salinas-Rodriguez , Jonathan Rogers , Sarah H. Q. Li

In this paper, we address the problem of a two-player linear quadratic differential game with incomplete information, a scenario commonly encountered in multi-agent control, human-robot interaction (HRI), and approximation methods for…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Seyed Yousef Soltanian , Wenlong Zhang

This paper introduces the new concept of (follower) satisfaction in Stackelberg games and compares the standard Stackelberg game with its satisfaction version. Simulation results are presented which suggest that the follower adopting…

Computer Science and Game Theory · Computer Science 2024-08-22 Langford White , Duong Nguyen , Hung Nguyen

There has been significant recent interest in game-theoretic approaches to security, with much of the recent research focused on utilizing the leader-follower Stackelberg game model. Among the major applications are the ARMOR program…

Computer Science and Game Theory · Computer Science 2014-01-17 Dmytro Korzhyk , Zhengyu Yin , Christopher Kiekintveld , Vincent Conitzer , Milind Tambe