English
Related papers

Related papers: Two-Player Zero-Sum Games with Bandit Feedback

200 papers

Many efficient algorithms have been designed to recover Nash equilibria of various classes of finite games. Special classes of continuous games with infinite strategy spaces, such as polynomial games, can be solved by semidefinite…

Computer Science and Game Theory · Computer Science 2020-10-01 Lukáš Adam , Rostislav Horčík , Tomáš Kasl , Tomáš Kroupa

Regret minimization is a powerful method for finding Nash equilibria in Normal-Form Games (NFGs) and Extensive-Form Games (EFGs), but it typically guarantees convergence only for the average strategy. However, computing the average strategy…

Computer Science and Game Theory · Computer Science 2025-09-18 Hang Ren , Yulin Wu , Shuhan Qi , Jiajia Zhang , Xiaozhen Sun , Tianzi Ma , Xuan Wang

The double oracle algorithm is a popular method of solving games, because it is able to reduce computing equilibria to computing a series of best responses. However, its theoretical properties are not well understood. In this paper, we…

Computer Science and Game Theory · Computer Science 2024-05-14 Brian Hu Zhang , Tuomas Sandholm

We introduce a simple extensive-form algorithm for finding equilibria of two-player, zero-sum games. The algorithm is realization equivalent to a generalized form of Fictitious Play. We compare its performance to that of a similar…

Computer Science and Game Theory · Computer Science 2023-10-17 Tim P. Schulze

This paper investigates the challenge of learning in black-box games, where the underlying utility function is unknown to any of the agents. While there is an extensive body of literature on the theoretical analysis of algorithms for…

Machine Learning · Computer Science 2024-11-15 Minbiao Han , Fengxue Zhang , Yuxin Chen

A long line of works characterizes the sample complexity of regret minimization in sequential decision-making by min-max programs. In the corresponding saddle-point game, the min-player optimizes the sampling distribution against an…

Machine Learning · Computer Science 2024-03-18 Johannes Kirschner , Seyed Alireza Bakhtiari , Kushagra Chandak , Volodymyr Tkachuk , Csaba Szepesvári

We study the problem of learning a Nash equilibrium (NE) in an imperfect information game (IIG) through self-play. Precisely, we focus on two-player, zero-sum, episodic, tabular IIG under the perfect-recall assumption where the only…

Machine Learning · Statistics 2021-06-14 Tadashi Kozuno , Pierre Ménard , Rémi Munos , Michal Valko

Driven by recent successes in two-player, zero-sum game solving and playing, artificial intelligence work on games has increasingly focused on algorithms that produce equilibrium-based strategies. However, this approach has been less…

Computer Science and Game Theory · Computer Science 2022-06-24 Dustin Morrill , Ryan D'Orazio , Reca Sarfati , Marc Lanctot , James R. Wright , Amy Greenwald , Michael Bowling

We consider a cooperative multiplayer bandit learning problem where the players are only allowed to agree on a strategy beforehand, but cannot communicate during the learning process. In this problem, each player simultaneously selects an…

Machine Learning · Computer Science 2023-11-13 William Chang , Yuanhao Lu

In the combinatorial semi-bandit (CSB) problem, a player selects an action from a combinatorial action set and observes feedback from the base arms included in the action. While CSB is widely applicable to combinatorial optimization…

Machine Learning · Computer Science 2025-09-15 Shintaro Nakamura , Yuko Kuroki , Wei Chen

We study the problem of sensor scheduling for an intrusion detection task. We model this as a two-player zero-sum game over a graph, where the defender (Player 1) seeks to identify the optimal strategy for scheduling sensor orientations to…

Systems and Control · Electrical Eng. & Systems 2025-04-22 Jayanth Bhargav , Shreyas Sundaram , Mahsa Ghasemi

This paper studies distributed online bandit learning of generalized Nash equilibria for online game, where cost functions of all players and coupled constraints are time-varying. The values rather than full information of cost and local…

Optimization and Control · Mathematics 2022-04-21 Min Meng , Xiuxian Li , Jie Chen

We study a target coverage problem in which a team of sensing agents, operating under limited communication, must collaboratively monitor targets that may be adaptively repositioned by an attacker. We model this interaction as a zero-sum…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Jayanth Bhargav , Zirui Xu , Vasileios Tzoumas , Mahsa Ghasemi , Shreyas Sundaram

This paper examines the convergence of no-regret learning in Cournot games with continuous actions. Cournot games are the essential model for many socio-economic systems, where players compete by strategically setting their output quantity.…

Computer Science and Game Theory · Computer Science 2020-02-12 Yuanyuan Shi , Baosen Zhang

In this work, we investigate a security game between an attacker and a defender, originally proposed in \cite{emadi2019security}. As is well known, the combinatorial nature of security games leads to a large cost matrix. Therefore,…

Computer Science and Game Theory · Computer Science 2020-07-30 HAmid Emadi , Sourabh Bhattacharya

In zero-sum games, the optimal strategy is well-defined by the Nash equilibrium. However, it is overly conservative when playing against suboptimal opponents and it can not exploit their weaknesses. Limited look-ahead game solving in…

Computer Science and Game Theory · Computer Science 2024-04-04 David Milec , Ondřej Kubíček , Viliam Lisý

Motivated by cognitive radios, stochastic multi-player multi-armed bandits gained a lot of interest recently. In this class of problems, several players simultaneously pull arms and encounter a collision - with 0 reward - if some of them…

Machine Learning · Computer Science 2020-06-22 Etienne Boursier , Vianney Perchet

We provide, to the best of our knowledge, the first computational study of extensive-form adversarial team games. These games are sequential, zero-sum games in which a team of players, sharing the same utility function, faces an adversary.…

Artificial Intelligence · Computer Science 2017-11-21 Andrea Celli , Nicola Gatti

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

Machine Learning · Computer Science 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

We study a multiplayer stochastic multi-armed bandit problem in which players cannot communicate, and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider the challenging…

Machine Learning · Statistics 2020-03-23 Etienne Boursier , Emilie Kaufmann , Abbas Mehrabian , Vianney Perchet