English
Related papers

Related papers: Learning Equilibria in Adversarial Team Markov Gam…

200 papers

Concurrent multi-player games with $\omega$-regular objectives are a standard model for systems that consist of several interacting components, each with its own objective. The standard solution concept for such games is Nash Equilibrium,…

Computer Science and Game Theory · Computer Science 2022-09-28 Shaull Almagor , Shai Guendelman

Coordination in multiplayer games enables players to avoid the lose-lose outcome that often arises at Nash equilibria. However, designing a coordination mechanism typically requires the consideration of the joint actions of all players,…

Computer Science and Game Theory · Computer Science 2026-03-23 Jaehan Im , Yue Yu , David Fridovich-Keil , Ufuk Topcu

Adversarial training is a standard technique for training adversarially robust models. In this paper, we study adversarial training as an alternating best-response strategy in a 2-player zero-sum game. We prove that even in a simple…

Machine Learning · Computer Science 2023-03-01 Maria-Florina Balcan , Rattana Pukdee , Pradeep Ravikumar , Hongyang Zhang

In this work, we study potential games and Markov potential games under stochastic cost and bandit feedback. We propose a variant of the Frank-Wolfe algorithm with sufficient exploration and recursive gradient estimation, which provably…

Computer Science and Game Theory · Computer Science 2024-04-11 Jing Dong , Baoxiang Wang , Yaoliang Yu

Nash equilibrium} (NE) can be stated as a formal theorem on a multilinear form, free of game theory terminology. On the other hand, inspired by this formalism, we state and prove a {\it multilinear minimax theorem}, a generalization of von…

Computer Science and Game Theory · Computer Science 2024-01-01 Bahman Kalantari

In this paper, we consider two-player zero-sum matrix and stochastic games and develop learning dynamics that are payoff-based, convergent, rational, and symmetric between the two players. Specifically, the learning dynamics for matrix…

Machine Learning · Computer Science 2024-09-06 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

Although it has been known since the 1970s that a globally optimal strategy profile in a common-payoff game is a Nash equilibrium, global optimality is a strict requirement that limits the result's applicability. In this work, we show that…

Computer Science and Game Theory · Computer Science 2022-07-08 Scott Emmons , Caspar Oesterheld , Andrew Critch , Vincent Conitzer , Stuart Russell

Multi-agent reinforcement learning (MARL) is increasingly used to design learning-enabled agents that interact in shared environments. However, training MARL algorithms in general-sum games remains challenging: learning dynamics can become…

Machine Learning · Computer Science 2026-04-07 Addison Kalanther , Sanika Bharvirkar , Shankar Sastry , Chinmay Maheshwari

The goal of agents in multi-agent environments is to maximize total reward against the opposing agents that are encountered. Following a game-theoretic solution concept, such as Nash equilibrium, may obtain a strong performance in some…

Computer Science and Game Theory · Computer Science 2026-01-05 Sam Ganzfried

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

Optimization and Control · Mathematics 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

The Team-maxmin equilibrium prescribes the optimal strategies for a team of rational players sharing the same goal and without the capability of correlating their strategies in strategic games against an adversary. This solution concept can…

Artificial Intelligence · Computer Science 2016-11-21 Nicola Basilico , Andrea Celli , Giuseppe De Nittis , Nicola Gatti

Mean field games (MFG) and mean field control problems (MFC) are frameworks to study Nash equilibria or social optima in games with a continuum of agents. These problems can be used to approximate competitive or cooperative games with a…

Optimization and Control · Mathematics 2021-06-28 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Lauriere

Standard multi-agent reinforcement learning (MARL) algorithms are vulnerable to sim-to-real gaps. To address this, distributionally robust Markov games (RMGs) have been proposed to enhance robustness in MARL by optimizing the worst-case…

Machine Learning · Computer Science 2025-02-03 Laixi Shi , Jingchu Gai , Eric Mazumdar , Yuejie Chi , Adam Wierman

Motivated by the increasing attention to overall social benefits in networked multi-agent systems, this paper investigates an optimization problem building on noncooperative games under high-level regulation, which can be formulated in a…

Optimization and Control · Mathematics 2025-12-02 Kaixin Du , Min Meng , Xiaoming Hu

Multi-agent reinforcement learning (MARL) has been shown effective for cooperative games in recent years. However, existing state-of-the-art methods face challenges related to sample complexity, training instability, and the risk of…

Multiagent Systems · Computer Science 2025-03-14 Jiarong Liu , Yifan Zhong , Siyi Hu , Haobo Fu , Qiang Fu , Xiaojun Chang , Yaodong Yang

We consider the problem of computing Nash equilibria in potential games where each player's strategy set is subject to private uncoupled constraints. This scenario is frequently encountered in real-world applications like road network…

Computer Science and Game Theory · Computer Science 2024-02-13 Nikolas Patris , Stelios Stavroulakis , Fivos Kalogiannis , Rose Zhang , Ioannis Panageas

Generative adversarial networks (GANs) represent a zero-sum game between two machine players, a generator and a discriminator, designed to learn the distribution of data. While GANs have achieved state-of-the-art performance in several…

Machine Learning · Computer Science 2020-02-24 Farzan Farnia , Asuman Ozdaglar

We develop an algorithmic framework for solving convex optimization problems using no-regret game dynamics. By converting the problem of minimizing a convex function into an auxiliary problem of solving a min-max game in a sequential…

Machine Learning · Computer Science 2023-02-21 Jun-Kun Wang , Jacob Abernethy , Kfir Y. Levy

No-regret learning has been widely used to compute a Nash equilibrium in two-person zero-sum games. However, there is still a lack of regret analysis for network stochastic zero-sum games, where players competing in two subnetworks only…

Optimization and Control · Mathematics 2022-05-31 Shijie Huang , Jinlong Lei , Yiguang Hong

We investigate multi-agent reinforcement learning for stochastic games with complex tasks, where the reward functions are non-Markovian. We utilize reward machines to incorporate high-level knowledge of complex tasks. We develop an…

Multiagent Systems · Computer Science 2023-08-30 Jueming Hu , Jean-Raphael Gaglione , Yanze Wang , Zhe Xu , Ufuk Topcu , Yongming Liu