English
Related papers

Related papers: Fast Policy Extragradient Methods for Competitive …

200 papers

Finding Nash equilibria in two-player zero-sum imperfect-information games remains a central challenge in multi-agent reinforcement learning. Recent multi-round regularization methods offer a promising direction, yet existing approaches…

Machine Learning · Computer Science 2026-05-01 Eason Yu , Tzu Hao Liu , Clément L. Canonne , Yunke Wang , Chang Xu , Nguyen H. Tran , Stefano V. Albrecht

We present a general framework for solving a large class of learning problems with non-linear functions of classification rates. This includes problems where one wishes to optimize a non-decomposable performance metric such as the F-measure…

Machine Learning · Computer Science 2019-09-09 Harikrishna Narasimhan , Andrew Cotter , Maya Gupta

There has been significant recent progress in algorithms for approximation of Nash equilibrium in large two-player zero-sum imperfect-information games and exact computation of Nash equilibrium in multiplayer strategic-form games. While…

Computer Science and Game Theory · Computer Science 2025-10-01 Sam Ganzfried

We study policy optimization algorithms for computing correlated equilibria in multi-player general-sum Markov Games. Previous results achieve $O(T^{-1/2})$ convergence rate to a correlated equilibrium and an accelerated $O(T^{-3/4})$…

Machine Learning · Computer Science 2024-05-03 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

Computing Nash equilibria of zero-sum games in classical and quantum settings is extensively studied. For general-sum games, computing Nash equilibria is PPAD-hard and the computing of a more general concept called correlated equilibria has…

Quantum Physics · Physics 2025-10-21 Tongyang Li , Xinzhao Wang , Yexin Zhang

This paper considers the problem of inverse reinforcement learning in zero-sum stochastic games when expert demonstrations are known to be not optimal. Compared to previous works that decouple agents in the game by assuming optimality in…

Machine Learning · Statistics 2018-06-07 Xingyu Wang , Diego Klabjan

This paper investigates the equilibrium convergence properties of a proposed algorithm for potential games with continuous strategy spaces in the presence of feedback delays, a main challenge in multi-agent systems that compromises the…

Optimization and Control · Mathematics 2023-03-20 Yuanhanqing Huang , Jianghai Hu

Solving feedback Stackelberg games with nonlinear dynamics and coupled constraints, a common scenario in practice, presents significant challenges. This work introduces an efficient method for computing approximate local feedback…

Optimization and Control · Mathematics 2025-04-03 Jingqi Li , Somayeh Sojoudi , Claire Tomlin , David Fridovich-Keil

We study techniques to incentivize self-interested agents to form socially desirable solutions in scenarios where they benefit from mutual coordination. Towards this end, we consider coordination games where agents have different intrinsic…

Computer Science and Game Theory · Computer Science 2014-04-21 Elliot Anshelevich , Shreyas Sekar

A major open question in algorithmic game theory is whether normal-form correlated equilibria (NFCE) can be computed efficiently in succinct games such as extensive-form games [DFF+25,6PR24,FP23,HvS08,VSF08,PR08]. Motivated by this…

Computer Science and Game Theory · Computer Science 2025-07-16 Vincent Cheval , Florian Horn , Soumyajit Paul , Mahsa Shirmohammadi

We study the problem of learning in zero-sum matrix games with repeated play and bandit feedback. Specifically, we focus on developing uncoupled algorithms that guarantee, without communication between players, the convergence of the…

Machine Learning · Computer Science 2026-04-20 Côme Fiegel , Pierre Ménard , Tadashi Kozuno , Michal Valko , Vianney Perchet

Softmax policy gradient is a popular algorithm for policy optimization in single-agent reinforcement learning, particularly since projection is not needed for each gradient update. However, in multi-agent systems, the lack of central…

Optimization and Control · Mathematics 2022-11-01 Runyu Zhang , Jincheng Mei , Bo Dai , Dale Schuurmans , Na Li

This paper addresses the problem of learning an equilibrium efficiently in general-sum Markov games through decentralized multi-agent reinforcement learning. Given the fundamental difficulty of calculating a Nash equilibrium (NE), we…

Machine Learning · Computer Science 2022-02-01 Weichao Mao , Tamer Başar

In an inverse game problem, one needs to infer the cost function of the players in a game such that a desired joint strategy is a Nash equilibrium. We study the inverse game problem for a class of multiplayer matrix games, where the cost…

Computer Science and Game Theory · Computer Science 2022-10-17 Yue Yu , Jonathan Salfity , David Fridovich-Keil , Ufuk Topcu

We study the problem of finding equilibrium strategies in multi-agent games with incomplete payoff information, where the payoff matrices are only known to the players up to some bounded uncertainty sets. In such games, an ex-post…

Computer Science and Game Theory · Computer Science 2020-07-14 Wenshuo Guo , Mihaela Curmei , Serena Wang , Benjamin Recht , Michael I. Jordan

In noncooperative Nash games, equilibria are often inefficient. This is exemplified by the Prisoner's Dilemma and was first provably shown in the 1980s. Since then, understanding the quality of Nash equilibrium (NE) received considerable…

Optimization and Control · Mathematics 2024-12-02 Yuyang Qiu , Farzad Yousefian , Brian Zhang

We study online optimization methods for zero-sum games, a fundamental problem in adversarial learning in machine learning, economics, and many other domains. Traditional methods approximate Nash equilibria (NE) using either regret-based…

Computer Science and Game Theory · Computer Science 2025-07-16 Taemin Kim , James P. Bailey

We study distributed algorithms for seeking a Nash equilibrium in a class of non-cooperative convex games with strongly monotone mappings. Each player has access to her own smooth local cost function and can communicate to her neighbors in…

Optimization and Control · Mathematics 2018-10-24 Tatiana Tatarenko , Wei Shi , Angelia Nedich

Regret-based algorithms are highly efficient at finding approximate Nash equilibria in sequential games such as poker games. However, most regret-based algorithms, including counterfactual regret minimization (CFR) and its variants, rely on…

Machine Learning · Computer Science 2021-10-28 Chung-Wei Lee , Christian Kroer , Haipeng Luo

Consider a strongly monotone game where the players' utility functions include a reward function and a linear term for each dimension, with coefficients that are controlled by the manager. Gradient play converges to a unique Nash…

Multiagent Systems · Computer Science 2026-02-25 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos