中文
相关论文

相关论文: Robust No-Regret Learning in Min-Max Stackelberg G…

200 篇论文

With the constraint of a no regret follower, will the players in a two-player Stackelberg game still reach Stackelberg equilibrium? We first show when the follower strategy is either reward-average or transform-reward-average, the two…

计算机科学与博弈论 · 计算机科学 2024-08-27 Xiangge Huang , Jingyuan Li , Jiaqing Xie

We revisit the problem of solving two-player zero-sum games in the decentralized setting. We propose a simple algorithmic framework that simultaneously achieves the best rates for honest regret as well as adversarial regret, and in addition…

计算机科学与博弈论 · 计算机科学 2018-06-07 Ehsan Asadi Kangarshahi , Ya-Ping Hsieh , Mehmet Fatih Sahin , Volkan Cevher

This work is dedicated to the algorithm design in a competitive framework, with the primary goal of learning a stable equilibrium. We consider the dynamic price competition between two firms operating within an opaque marketplace, where…

计算机科学与博弈论 · 计算机科学 2023-05-30 Mengzi Amy Guo , Donghao Ying , Javad Lavaei , Zuo-Jun Max Shen

We consider the problem of learning to exploit learning algorithms through repeated interactions in games. Specifically, we focus on the case of repeated two player, finite-action games, in which an optimizer aims to steer a no-regret…

计算机科学与博弈论 · 计算机科学 2025-05-29 Yizhou Zhang , Yi-An Ma , Eric Mazumdar

This paper considers repeated games in which one player has more information about the game than the other players. In particular, we investigate repeated two-player zero-sum games where only the column player knows the payoff matrix A of…

计算机科学与博弈论 · 计算机科学 2023-02-16 Le Cong Dinh , Long Tran-Thanh , Tri-Dung Nguyen , Alain B. Zemkoho

Different types of dynamics have been studied in repeated game play, and one of them which has received much attention recently consists of those based on "no-regret" algorithms from the area of machine learning. It is known that dynamics…

计算机科学与博弈论 · 计算机科学 2016-10-14 Po-An Chen , Chi-Jen Lu

We study Stackelberg equilibria in finitely repeated games, where the leader commits to a strategy that picks actions in each round and can be adaptive to the history of play (i.e. they commit to an algorithm). In particular, we study…

计算机科学与博弈论 · 计算机科学 2024-03-08 Natalie Collina , Eshwar Ram Arunachaleswaran , Michael Kearns

In this paper, we investigate the existence of online learning algorithms with bandit feedback that simultaneously guarantee $O(1)$ regret compared to a given comparator strategy, and $\tilde{O}(\sqrt{T})$ regret compared to any fixed…

机器学习 · 计算机科学 2025-06-05 Adrian Müller , Jon Schneider , Stratis Skoulakis , Luca Viano , Volkan Cevher

We introduce the application of online learning in a Stackelberg game pertaining to a system with two learning agents in a dyadic exchange network, consisting of a supplier and retailer, specifically where the parameters of the demand…

计算工程、金融与科学 · 计算机科学 2024-10-15 Larkin Liu , Yuming Rong

We study the problem of online learning in a two-player decentralized cooperative Stackelberg game. In each round, the leader first takes an action, followed by the follower who takes their action after observing the leader's move. The goal…

机器学习 · 计算机科学 2023-04-13 Geng Zhao , Banghua Zhu , Jiantao Jiao , Michael I. Jordan

No-regret self-play learning dynamics have become one of the premier ways to solve large-scale games in practice. Accelerating their convergence via improving the regret of the players over the naive $O(\sqrt{T})$ bound after $T$ rounds has…

机器学习 · 计算机科学 2025-02-26 Shinji Ito , Haipeng Luo , Taira Tsuchiya , Yue Wu

Online gradient descent (OGD) is well known to be doubly optimal under strong convexity or monotonicity assumptions: (1) in the single-agent setting, it achieves an optimal regret of $\Theta(\log T)$ for strongly convex cost functions; and…

计算机科学与博弈论 · 计算机科学 2024-04-01 Michael I. Jordan , Tianyi Lin , Zhengyuan Zhou

We consider the problem of efficiently learning to play single-leader multi-follower Stackelberg games when the leader lacks knowledge of the lower-level game. Such games arise in hierarchical decision-making problems involving…

系统与控制 · 电气工程与系统科学 2025-12-11 Anna Maddux , Marko Maljkovic , Nikolas Geroliminis , Maryam Kamgarpour

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

计算机科学与博弈论 · 计算机科学 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

The literature on game-theoretic equilibrium finding predominantly focuses on single games or their repeated play. Nevertheless, numerous real-world scenarios feature playing a game sampled from a distribution of similar, but not identical…

计算机科学与博弈论 · 计算机科学 2024-02-21 David Sychrovský , Michal Šustr , Elnaz Davoodi , Michael Bowling , Marc Lanctot , Martin Schmid

Learning from repeated play in a fixed two-player zero-sum game is a classic problem in game theory and online learning. We consider a variant of this problem where the game payoff matrix changes over time, possibly in an adversarial…

机器学习 · 计算机科学 2022-02-01 Mengxiao Zhang , Peng Zhao , Haipeng Luo , Zhi-Hua Zhou

When deployed in the world, a learning agent such as a recommender system or a chatbot often repeatedly interacts with another learning agent (such as a user) over time. In many such two-agent systems, each agent learns separately and the…

机器学习 · 计算机科学 2024-06-24 Kate Donahue , Nicole Immorlica , Meena Jagadeesan , Brendan Lucier , Aleksandrs Slivkins

This paper investigates the convergence of learning dynamics in Stackelberg games. In the class of games we consider, there is a hierarchical game being played between a leader and a follower with continuous action spaces. We establish a…

计算机科学与博弈论 · 计算机科学 2024-12-07 Tanner Fiez , Benjamin Chasnov , Lillian J. Ratliff

Regret has been established as a foundational concept in online learning, and likewise has important applications in the analysis of learning dynamics in games. Regret quantifies the difference between a learner's performance against a…

计算机科学与博弈论 · 计算机科学 2021-06-29 Georgios Piliouras , Mark Rowland , Shayegan Omidshafiei , Romuald Elie , Daniel Hennes , Jerome Connor , Karl Tuyls

We investigate the interplay between passivity, no-regret, and convergence in contractive games for various learning dynamic models and their higher-order variants. Our setting is continuous time. Building on prior work for replicator…

系统与控制 · 电气工程与系统科学 2025-04-01 Hassan Abdelraouf , Georgios Piliouras , Jeff S. Shamma