English
Related papers

Related papers: Learning in Stackelberg Games with Non-myopic Agen…

200 papers

In this work, we introduce and study contextual search in general principal-agent games, where a principal repeatedly interacts with agents by offering contracts based on contextual information and historical feedback, without knowing the…

Computer Science and Game Theory · Computer Science 2025-10-22 Yiding Feng , Mengfan Ma , Bo Peng , Zongqi Wan

The study of repeated interactions between a learner and a utility-maximizing optimizer has yielded deep insights into the manipulability of learning algorithms. However, existing literature primarily focuses on independent, unlinked…

Computer Science and Game Theory · Computer Science 2026-04-10 Giannis Fikioris , Balasubramanian Sivan , Éva Tardos

We study a continuous-time stochastic Stackelberg game in which a leader seeks to accomplish a primary objective while inferring a hidden parameter of a rational follower. The follower solves an entropy-regularized tracking problem and…

Optimization and Control · Mathematics 2025-10-08 Ruimeng Hu , Daniel Ralston , Xu Yang , Haosheng Zhou

We introduce a stochastic principal-agent model. A principal and an agent interact in a stochastic environment, each privy to observations about the state not available to the other. The principal has the power of commitment, both to elicit…

Computer Science and Game Theory · Computer Science 2024-09-13 Jiarui Gan , Rupak Majumdar , Debmalya Mandal , Goran Radanovic

Stackelberg equilibria arise naturally in a range of popular learning problems, such as in security games or indirect mechanism design, and have received increasing attention in the reinforcement learning literature. We present a general…

Computer Science and Game Theory · Computer Science 2023-06-05 Matthias Gerstgrasser , David C. Parkes

Many real-world strategic games involve interactions between multiple players. We study a hierarchical multi-player game structure, where players with asymmetric roles can be separated into leaders and followers, a setting often referred to…

Machine Learning · Computer Science 2022-10-25 Yaolong Yu , Haifeng Xu , Haipeng Chen

We extend the formalism of Conjectural Variations games to Stackelberg games involving multiple leaders and a single follower. To solve these nonconvex games, a common assumption is that the leaders compute their strategies having perfect…

Computer Science and Game Theory · Computer Science 2025-07-24 Francesco Morri , Hélène Le Cadre , Luce Brotcorne

We study multi-player general-sum Markov games with one of the players designated as the leader and the other players regarded as followers. In particular, we focus on the class of games where the followers are myopic, i.e., they aim to…

Machine Learning · Computer Science 2021-12-28 Han Zhong , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

This paper studies a stochastic robotic surveillance problem where a mobile robot moves randomly on a graph to capture a potential intruder that strategically attacks a location on the graph. The intruder is assumed to be omniscient: it…

Optimization and Control · Mathematics 2020-11-17 Xiaoming Duan , Dario Paccagnan , Francesco Bullo

Agents rarely act in isolation -- their behavioral history, in particular, is public to others. We seek a non-asymptotic understanding of how a leader agent should shape this history to its maximal advantage, knowing that follower agent(s)…

Computer Science and Game Theory · Computer Science 2019-05-29 Vidya Muthukumar , Anant Sahai

Neural networks are typically trained with a single learning rate across all layers. While recent empirical evidence suggests that assigning layer-specific learning rates can accelerate training, a principled understanding of the conditions…

Machine Learning · Computer Science 2026-05-26 Sihan Zeng , Sujay Bhatt , Sumitra Ganesh

We study an online learning version of the generalized principal-agent model, where a principal interacts repeatedly with a strategic agent possessing private types, private rewards, and taking unobservable actions. The agent is non-myopic,…

Machine Learning · Computer Science 2025-06-11 Yuchen Wu , Xinyi Zhong , Zhuoran Yang

We study the problem of online learning in a two-player decentralized cooperative Stackelberg game. In each round, the leader first takes an action, followed by the follower who takes their action after observing the leader's move. The goal…

Machine Learning · Computer Science 2023-04-13 Geng Zhao , Banghua Zhu , Jiantao Jiao , Michael I. Jordan

In this paper, we consider a sequential stochastic Stackelberg game with two players, a leader and a follower. The follower has access to the state of the system while the leader does not. Assuming that the players act in their respective…

Optimization and Control · Mathematics 2021-02-08 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

The present survey aims at presenting the current machine learning techniques employed in security games domains. Specifically, we focused on papers and works developed by the Teamcore of University of Southern California, which deepened…

Computer Science and Game Theory · Computer Science 2016-09-30 Giuseppe De Nittis , Francesco Trovò

In stochastic games with incomplete information, the uncertainty is evoked by the lack of knowledge about a player's own and the other players' types, i.e. the utility function and the policy space, and also the inherent stochasticity of…

Machine Learning · Computer Science 2022-03-21 Hannes Eriksson , Debabrota Basu , Mina Alibeigi , Christos Dimitrakakis

Principal-agent problems model scenarios where a principal incentivizes an agent to take costly, unobservable actions through the provision of payments. Such problems are ubiquitous in several real-world applications, ranging from…

Computer Science and Game Theory · Computer Science 2025-02-27 Francesco Bacchiocchi , Jiarui Gan , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Model-based reinforcement learning (MBRL) has recently gained immense interest due to its potential for sample efficiency and ability to incorporate off-policy data. However, designing stable and efficient MBRL algorithms using rich…

Machine Learning · Computer Science 2021-03-12 Aravind Rajeswaran , Igor Mordatch , Vikash Kumar

Game-theoretic inverse learning is the problem of inferring a player's objectives from their actions. We formulate an inverse learning problem in a Stackelberg game between a leader and a follower, where each player's action is the…

Computer Science and Game Theory · Computer Science 2024-10-15 William Ward , Yue Yu , Jacob Levy , Negar Mehr , David Fridovich-Keil , Ufuk Topcu

Large language model (LLM) agents have shown remarkable progress in social deduction games (SDGs). However, existing approaches primarily focus on information processing and strategy selection, overlooking the significance of persuasive…

Artificial Intelligence · Computer Science 2026-04-15 Zhang Zheng , Deheng Ye , Peilin Zhao , Hao Wang