English
Related papers

Related papers: Model-Based Reinforcement Learning for Offline Zer…

200 papers

We give a quantum algorithm for computing an $\epsilon$-approximate Nash equilibrium of a zero-sum game in a $m \times n$ payoff matrix with bounded entries. Given a standard quantum oracle for accessing the payoff matrix our algorithm runs…

Quantum Physics · Physics 2023-01-11 Adam Bouland , Yosheb Getachew , Yujia Jin , Aaron Sidford , Kevin Tian

We study a subclass of $n$-player stochastic games, namely, stochastic games with independent chains and unknown transition matrices. In this class of games, players control their own internal Markov chains whose transitions do not depend…

Computer Science and Game Theory · Computer Science 2023-12-05 Tiancheng Qin , S. Rasoul Etesami

Zero-sum games arise in a wide variety of problems, including robust optimization and adversarial learning. However, algorithms deployed for finding a local Nash equilibrium in these games often converge to non-Nash stationary points. This…

Computer Science and Game Theory · Computer Science 2025-09-30 Kushagra Gupta , Xinjie Liu , Ross Allen , Ufuk Topcu , David Fridovich-Keil

In this paper, we consider a large class of constrained non-cooperative stochastic Markov games with countable state spaces and discounted cost criteria. In one-player case, i.e., constrained discounted Markov decision models, it is…

Optimization and Control · Mathematics 2021-12-16 Anna Jaśkiewicz , Andrzej S. Nowak

We introduce a novel class of Nash equilibrium seeking dynamics for non-cooperative games with a finite number of players, where the convergence to the Nash equilibrium is bounded by a KL function with a settling time that can be upper…

Optimization and Control · Mathematics 2020-12-25 Jorge I. Poveda , Miroslav Krstic , Tamer Basar

We present a framework for computing approximate mixed-strategy Nash equilibria of continuous-action games. It is a modification of the traditional double oracle algorithm, extended to multiple players and continuous action spaces. Unlike…

Computer Science and Game Theory · Computer Science 2024-06-14 Carlos Martin , Tuomas Sandholm

Many important real-world settings contain multiple players interacting over an unknown duration with probabilistic state transitions, and are naturally modeled as stochastic games. Prior research on algorithms for stochastic games has…

Computer Science and Game Theory · Computer Science 2021-02-19 Sam Ganzfried

This paper investigates online stochastic aggregative games subject to local set constraints and time-varying coupled inequality constraints, where each player possesses a time-varying expectation-valued cost function relying on not only…

Optimization and Control · Mathematics 2025-11-18 Kaixin Du , Min Meng

We consider a class of two-player dynamic stochastic nonzero-sum games where the state transition and observation equations are linear, and the primitive random variables are Gaussian. Each controller acquires possibly different dynamic…

Systems and Control · Computer Science 2014-01-21 Abhishek Gupta , Ashutosh Nayyar , Cedric Langbort , Tamer Basar

Equilibria of realistic multiplayer games constitute a key solution concept both in practical applications, such as online advertising auctions and electricity markets, and in analytical frameworks used to study strategic voting in…

Computer Science and Game Theory · Computer Science 2025-11-18 Jakub Černý , Shuvomoy Das Gupta , Christian Kroer

Markov games model interactions among multiple players in a stochastic, dynamic environment. Each player in a Markov game maximizes its expected total discounted reward, which depends upon the policies of the other players. We formulate a…

Computer Science and Game Theory · Computer Science 2023-09-11 Shenghui Chen , Yue Yu , David Fridovich-Keil , Ufuk Topcu

In this paper, we consider the problem of finding a Nash equilibrium in a multi-player game over generally connected networks. This model differs from a conventional setting in that players have partial information on the actions of their…

Optimization and Control · Mathematics 2019-12-10 Farzad Salehisadaghiani , Wei Shi , Lacra Pavel

This paper considers a distributed Nash equilibrium seeking problem, where the players only have partial access to other players' actions, such as their neighbors' actions. Thus, the players are supposed to communicate with each other to…

Optimization and Control · Mathematics 2020-03-31 Yipeng Pang , Guoqiang Hu

We propose a framework for two-player infinite-dimensional games with cooperative or competitive structure. These games take the form of coupled partial differential equations in which players optimize over a space of measures, driven by…

Analysis of PDEs · Mathematics 2025-02-11 Lauren Conger , Franca Hoffmann , Eric Mazumdar , Lillian J. Ratliff

We develop a flexible stochastic approximation framework for analyzing the long-run behavior of learning in games (both continuous and finite). The proposed analysis template incorporates a wide array of popular learning algorithms,…

Computer Science and Game Theory · Computer Science 2023-07-04 Panayotis Mertikopoulos , Ya-Ping Hsieh , Volkan Cevher

Adversarial training is a standard technique for training adversarially robust models. In this paper, we study adversarial training as an alternating best-response strategy in a 2-player zero-sum game. We prove that even in a simple…

Machine Learning · Computer Science 2023-03-01 Maria-Florina Balcan , Rattana Pukdee , Pradeep Ravikumar , Hongyang Zhang

We characterize offline data poisoning attacks on Multi-Agent Reinforcement Learning (MARL), where an attacker may change a data set in an attempt to install a (potentially fictitious) unique Markov-perfect Nash equilibrium for a two-player…

Multiagent Systems · Computer Science 2024-06-19 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie

We consider the computation of an equilibrium of a stochastic Nash equilibrium problem, where the player objectives are assumed to be $L_0$-Lipschitz continuous and convex given rival decisions with convex and closed player-specific…

Optimization and Control · Mathematics 2025-10-29 Luke Marrinan , Farzad Yousefian , Uday V. Shanbhag

Adversarial team games model multiplayer strategic interactions in which a team of identically-interested players is competing against an adversarial player in a zero-sum game. Such games capture many well-studied settings in game theory,…

Computer Science and Game Theory · Computer Science 2025-09-26 Ioannis Anagnostides , Fivos Kalogiannis , Ioannis Panageas , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Stephen McAleer

This paper studies a class of zero-sum stopping game in a regime switching model. A verification theorem as a sufficient criterion for Nash equilibriums is established based on a set of variational inequalities (VIs). Under an appropriate…

Optimization and Control · Mathematics 2023-03-29 Siyu Lv , Xiao Yang