中文
相关论文

相关论文: Model-Free Learning for Two-Player Zero-Sum Partia…

200 篇论文

Mean-field games have been used as a theoretical tool to obtain an approximate Nash equilibrium for symmetric and anonymous $N$-player games. However, limiting applicability, existing theoretical results assume variations of a "population…

最优化与控制 · 数学 2023-06-12 Batuhan Yardim , Semih Cayci , Matthieu Geist , Niao He

Markov Potential Games (MPGs) form an important sub-class of Markov games, which are a common framework to model multi-agent reinforcement learning problems. In particular, MPGs include as a special case the identical-interest setting where…

机器学习 · 计算机科学 2024-08-16 Pragnya Alatur , Anas Barakat , Niao He

Decentralized online learning for seeking generalized Nash equilibrium (GNE) of noncooperative games in dynamic environments is studied in this paper. Each player aims at selfishly minimizing its own time-varying cost function subject to…

最优化与控制 · 数学 2021-05-14 Min Meng , Xiuxian Li , Yiguang Hong , Jie Chen , Long Wang

This paper investigates posterior sampling algorithms for competitive reinforcement learning (RL) in the context of general function approximations. Focusing on zero-sum Markov games (MGs) under two critical settings, namely self-play and…

机器学习 · 计算机科学 2023-11-01 Shuang Qiu , Ziyu Dai , Han Zhong , Zhaoran Wang , Zhuoran Yang , Tong Zhang

We study the problem of learning a Nash equilibrium (NE) in Markov games which is a cornerstone in multi-agent reinforcement learning (MARL). In particular, we focus on infinite-horizon adversarial team Markov games (ATMGs) in which agents…

计算机科学与博弈论 · 计算机科学 2024-10-10 Fivos Kalogiannis , Jingming Yan , Ioannis Panageas

We characterize offline data poisoning attacks on Multi-Agent Reinforcement Learning (MARL), where an attacker may change a data set in an attempt to install a (potentially fictitious) unique Markov-perfect Nash equilibrium for a two-player…

多智能体系统 · 计算机科学 2024-06-19 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie

We prove that optimistic-follow-the-regularized-leader (OFTRL), together with smooth value updates, finds an $O(T^{-1})$-approximate Nash equilibrium in $T$ iterations for two-player zero-sum Markov games with full information. This…

机器学习 · 计算机科学 2023-02-10 Yuepeng Yang , Cong Ma

We consider online no-regret learning in unknown games with bandit feedback, where each player can only observe its reward at each time -- determined by all players' current joint action -- rather than its gradient. We focus on the class of…

机器学习 · 计算机科学 2024-04-01 Wenjia Ba , Tianyi Lin , Jiawei Zhang , Zhengyuan Zhou

The goal of agents in multi-agent environments is to maximize total reward against the opposing agents that are encountered. Following a game-theoretic solution concept, such as Nash equilibrium, may obtain a strong performance in some…

计算机科学与博弈论 · 计算机科学 2026-01-05 Sam Ganzfried

We study a setting in which two players play a (possibly approximate) Nash equilibrium of a bimatrix game, while a learner observes only their actions and has no knowledge of the equilibrium or the underlying game. A natural question is…

计算机科学与博弈论 · 计算机科学 2026-05-27 Annalisa Barbara , Riccardo Poiani , Martino Bernasconi , Andrea Celli

The behavior of no-regret learning algorithms is well understood in two-player min-max (i.e, zero-sum) games. In this paper, we investigate the behavior of no-regret learning in min-max games with dependent strategy sets, where the strategy…

计算机科学与博弈论 · 计算机科学 2022-04-15 Denizalp Goktas , Jiayi Zhao , Amy Greenwald

We present an algorithm for computing evolutionarily stable strategies (ESSs) in symmetric perfect-recall extensive-form games of imperfect information. Our main algorithm is for two-player games, and we describe how it can be extended to…

计算机科学与博弈论 · 计算机科学 2025-12-15 Sam Ganzfried

Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR)…

计算机科学与博弈论 · 计算机科学 2021-03-09 Gabriele Farina , Tuomas Sandholm

We consider two-player zero-sum stochastic games and propose a two-timescale $Q$-learning algorithm with function approximation that is payoff-based, convergent, rational, and symmetric between the two players. In two-timescale…

机器学习 · 计算机科学 2023-12-11 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

The paper addresses a problem of sequential bilateral bargaining with incomplete information. We proposed a decision model that helps agents to successfully bargain by performing indirect negotiation and learning the opponent's model.…

计算机科学与博弈论 · 计算机科学 2024-09-11 Tatiana V. Guy , Jitka Homolová , Aleksej Gaj

We consider the problem of learning sparse polymatrix games from observations of strategic interactions. We show that a polynomial time method based on $\ell_{1,2}$-group regularized logistic regression recovers a game, whose Nash…

机器学习 · 计算机科学 2019-01-30 Asish Ghoshal , Jean Honorio

Regret minimization is a general approach to online optimization which plays a crucial role in many algorithms for approximating Nash equilibria in two-player zero-sum games. The literature mainly focuses on solving individual games in…

计算机科学与博弈论 · 计算机科学 2025-04-29 David Sychrovský , Martin Schmid , Michal Šustr , Michael Bowling

In this paper, we present an online learning approach for two-player zero-sum linear quadratic games with unknown dynamics. We develop a framework combining regularized least squares model estimation, high probability confidence sets, and…

系统与控制 · 电气工程与系统科学 2026-04-06 Shanting Wang , Weihao Sun , Andreas A. Malikopoulos

We initiate the study of how to perturb the reward in a zero-sum Markov game with two players to induce a desirable Nash equilibrium, namely arbitrating. Such a problem admits a bi-level optimization formulation. The lower level requires…

多智能体系统 · 计算机科学 2023-02-21 Jing Wang , Meichen Song , Feng Gao , Boyi Liu , Zhaoran Wang , Yi Wu

Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, where only the loss of the selected action pair is observed, Fiegel et al. (2025) show a…

机器学习 · 计算机科学 2026-05-12 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang