English
Related papers

Related papers: Two-Player Zero-Sum Games with Bandit Feedback

200 papers

The problem of two-sided matching markets is well-studied in computer science and economics, owing to its diverse applications across numerous domains. Since market participants are usually uncertain about their preferences in various…

Machine Learning · Computer Science 2025-12-09 Zilong Wang , Shuai Li

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

Machine Learning · Statistics 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

Two-sided matching markets have been widely studied in the literature due to their rich applications. Since participants are usually uncertain about their preferences, online algorithms have recently been adopted to learn them through…

Machine Learning · Computer Science 2024-06-04 Fang Kong , Shuai Li

The Nash Equilibrium (NE) assumes rational play in imperfect-information Extensive-Form Games (EFGs) but fails to ensure optimal strategies for off-equilibrium branches of the game tree, potentially leading to suboptimal outcomes in…

Computer Science and Game Theory · Computer Science 2025-08-12 Hang Ren , Xiaozhen Sun , Tianzi Ma , Jiajia Zhang , Xuan Wang

The problem of matching markets has been studied for a long time in the literature due to its wide range of applications. Finding a stable matching is a common equilibrium objective in this problem. Since market participants are usually…

Machine Learning · Computer Science 2023-07-21 Fang Kong , Shuai Li

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

Computer Science and Game Theory · Computer Science 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

This work tackles the complexities of multi-player scenarios in \emph{unknown games}, where the primary challenge lies in navigating the uncertainty of the environment through bandit feedback alongside strategic decision-making. We…

Machine Learning · Computer Science 2024-02-27 Yingru Li , Liangqi Liu , Wenqiang Pu , Hao Liang , Zhi-Quan Luo

We revisit the problem of learning in two-player zero-sum Markov games, focusing on developing an algorithm that is uncoupled, convergent, and rational, with non-asymptotic convergence rates. We start from the case of stateless matrix game…

Computer Science and Game Theory · Computer Science 2023-11-10 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

A variety of practical problems can be modeled by the decision-making process in multi-player games where a group of self-interested players aim at optimizing their own local objectives, while the objectives depend on the actions taken by…

Optimization and Control · Mathematics 2023-01-09 Yuanhanqing Huang , Jianghai Hu

We study the open question of how players learn to play a social optimum pure-strategy Nash equilibrium (PSNE) through repeated interactions in general-sum coordination games. A social optimum of a game is the stable Pareto-optimal state…

Computer Science and Game Theory · Computer Science 2023-07-26 Duong Nguyen , Langford White , Hung Nguyen

This paper investigates stochastic and adversarial combinatorial multi-armed bandit problems. In the stochastic setting under semi-bandit feedback, we derive a problem-specific regret lower bound, and discuss its scaling with the dimension…

Machine Learning · Computer Science 2015-11-09 Richard Combes , M. Sadegh Talebi , Alexandre Proutiere , Marc Lelarge

Motivated by the challenges of edge inference, we study a variant of the cascade bandit model in which each arm corresponds to an inference model with an associated accuracy and error probability. We analyse four decision-making…

Machine Learning · Computer Science 2026-03-30 R Sri Prakash , Nikhil Karamchandani , Sharayu Moharir

Learning in games refers to scenarios where multiple players interact in a shared environment, each aiming to minimize their regret. An equilibrium can be computed at a fast rate of $O(1/T)$ when all players follow the optimistic…

Computer Science and Game Theory · Computer Science 2025-02-18 Taira Tsuchiya , Shinji Ito , Haipeng Luo

While single-agent policy optimization in a fixed environment has attracted a lot of research attention recently in the reinforcement learning community, much less is known theoretically when there are multiple agents playing in a…

Machine Learning · Computer Science 2022-07-27 Shuang Qiu , Xiaohan Wei , Jieping Ye , Zhaoran Wang , Zhuoran Yang

Motivated by Generative Adversarial Networks, we study the computation of Nash equilibrium in concave network zero-sum games (NZSGs), a multiplayer generalization of two-player zero-sum games first proposed with linear payoffs. Extending…

Machine Learning · Computer Science 2020-07-13 Amit Kadan , Hu Fu

Real world applications such as economics and policy making often involve solving multi-agent games with two unique features: (1) The agents are inherently asymmetric and partitioned into leaders and followers; (2) The agents have different…

Machine Learning · Computer Science 2021-11-04 Yu Bai , Chi Jin , Huan Wang , Caiming Xiong

We investigate learning the equilibria in non-stationary multi-agent systems and address the challenges that differentiate multi-agent learning from single-agent learning. Specifically, we focus on games with bandit feedback, where testing…

Machine Learning · Computer Science 2024-05-06 Haozhe Jiang , Qiwen Cui , Zhihan Xiong , Maryam Fazel , Simon S. Du

This paper investigates when one can efficiently recover an approximate Nash Equilibrium (NE) in offline congestion games. The existing dataset coverage assumption in offline general-sum games inevitably incurs a dependency on the number of…

Computer Science and Game Theory · Computer Science 2024-10-07 Haozhe Jiang , Qiwen Cui , Zhihan Xiong , Maryam Fazel , Simon S. Du

We study a general version of the adversarial online learning problem. We are given a decision set $\mathcal{X}$ in a reflexive Banach space $X$ and a sequence of reward vectors in the dual space of $X$. At each iteration, we choose an…

Machine Learning · Computer Science 2016-06-07 Maximilian Balandat , Walid Krichene , Claire Tomlin , Alexandre Bayen

We investigate optimal decision making under imperfect recall, that is, when an agent forgets information it once held before. An example is the absentminded driver game, as well as team games in which the members have limited communication…

Computer Science and Game Theory · Computer Science 2024-06-25 Emanuel Tewolde , Brian Hu Zhang , Caspar Oesterheld , Manolis Zampetakis , Tuomas Sandholm , Paul W. Goldberg , Vincent Conitzer