English
Related papers

Related papers: Approximating Nash Equilibria in General-Sum Games…

200 papers

As quantum processors advance, the emergence of large-scale decentralized systems involving interacting quantum-enabled agents is on the horizon. Recent research efforts have explored quantum versions of Nash and correlated equilibria as…

Computer Science and Game Theory · Computer Science 2024-12-18 Wayne Lin , Georgios Piliouras , Ryann Sim , Antonios Varvitsiotis

We study the open question of how players learn to play a social optimum pure-strategy Nash equilibrium (PSNE) through repeated interactions in general-sum coordination games. A social optimum of a game is the stable Pareto-optimal state…

Computer Science and Game Theory · Computer Science 2023-07-26 Duong Nguyen , Langford White , Hung Nguyen

Learning from repeated play in a fixed two-player zero-sum game is a classic problem in game theory and online learning. We consider a variant of this problem where the game payoff matrix changes over time, possibly in an adversarial…

Machine Learning · Computer Science 2022-02-01 Mengxiao Zhang , Peng Zhao , Haipeng Luo , Zhi-Hua Zhou

No-regret learning has been widely used to compute a Nash equilibrium in two-person zero-sum games. However, there is still a lack of regret analysis for network stochastic zero-sum games, where players competing in two subnetworks only…

Optimization and Control · Mathematics 2022-05-31 Shijie Huang , Jinlong Lei , Yiguang Hong

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

Computer Science and Game Theory · Computer Science 2022-10-27 William Brown

We address learning Nash equilibria in convex games under the payoff information setting. We consider the case in which the game pseudo-gradient is monotone but not necessarily strictly monotone. This relaxation of strict monotonicity…

Optimization and Control · Mathematics 2023-08-17 Tatiana Tatarenko , Maryam Kamgarpour

We study risk-sensitive multi-agent reinforcement learning under general-sum Markov games, where agents optimize the entropic risk measure of rewards with possibly diverse risk preferences. We show that using the regret naively adapted from…

Machine Learning · Computer Science 2024-05-07 Yingjie Fei , Ruitu Xu

Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR)…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Tuomas Sandholm

Designing efficient algorithms to compute Nash equilibria poses considerable challenges in Algorithmic Game Theory and Optimization. In this work, we employ integer programming techniques to compute Nash equilibria in Integer Programming…

Optimization and Control · Mathematics 2022-09-16 Gabriele Dragotto , Rosario Scatamacchia

We consider learning Nash equilibria in two-player zero-sum Markov Games with nonlinear function approximation, where the action-value function is approximated by a function in a Reproducing Kernel Hilbert Space (RKHS). The key challenge is…

Machine Learning · Computer Science 2022-08-11 Chris Junchi Li , Dongruo Zhou , Quanquan Gu , Michael I. Jordan

Optimization of deep learning algorithms to approach Nash Equilibrium remains a significant problem in imperfect information games, e.g. StarCraft and poker. Neural Fictitious Self-Play (NFSP) has provided an effective way to learn…

Artificial Intelligence · Computer Science 2021-04-23 Yuxuan Chen , Li Zhang , Shijian Li , Gang Pan

Regret minimization is a powerful method for finding Nash equilibria in Normal-Form Games (NFGs) and Extensive-Form Games (EFGs), but it typically guarantees convergence only for the average strategy. However, computing the average strategy…

Computer Science and Game Theory · Computer Science 2025-09-18 Hang Ren , Yulin Wu , Shuhan Qi , Jiajia Zhang , Xiaozhen Sun , Tianzi Ma , Xuan Wang

Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zero-sum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for each player. In many…

Computer Science and Game Theory · Computer Science 2019-02-07 Trevor Davis , Kevin Waugh , Michael Bowling

A celebrated result in the interface of online learning and game theory guarantees that the repeated interaction of no-regret players leads to a coarse correlated equilibrium (CCE) -- a natural game-theoretic solution concept. Despite the…

Computer Science and Game Theory · Computer Science 2024-11-05 Ioannis Anagnostides , Alkis Kalavasis , Tuomas Sandholm

Contemporary applications of machine learning in two-team e-sports and the superior expressivity of multi-agent generative adversarial networks raise important and overlooked theoretical questions regarding optimization in two-team games.…

Computer Science and Game Theory · Computer Science 2023-04-18 Fivos Kalogiannis , Ioannis Panageas , Emmanouil-Vasileios Vlatakis-Gkaragkounis

We argue that the existing regret matchings for Nash equilibrium approximation conduct "jumpy" strategy updating when the probabilities of future plays are set to be proportional to positive regret measures. We propose a geometrical regret…

Computer Science and Game Theory · Computer Science 2020-01-24 Sizhong Lan

Pseudo-games are a natural and well-known generalization of normal-form games, in which the actions taken by each player affect not only the other players' payoffs, as in games, but also the other players' strategy sets. The solution…

Computer Science and Game Theory · Computer Science 2022-10-20 Denizalp Goktas , Amy Greenwald

Nash equilibrium is the most commonly-used notion of equilibrium in game theory. However, it suffers from numerous problems. Some are well known in the game theory community; for example, the Nash equilibrium of repeated prisoner's dilemma…

Computer Science and Game Theory · Computer Science 2008-12-18 Joseph Y. Halpern

Game theory is a very profound study on distributed decision-making behavior and has been extensively developed by many scholars. However, many existing works rely on certain strict assumptions such as knowing the opponent's private…

Computer Science and Game Theory · Computer Science 2020-04-21 Kuo Chun Tsai , Zhu Han