English
Related papers

Related papers: Payoff-based learning with matrix multiplicative w…

200 papers

The Multiplicative Weights Update (MWU) method is a ubiquitous meta-algorithm that works as follows: A distribution is maintained on a certain set, and at each step the probability assigned to element $\gamma$ is multiplied by $(1 -\epsilon…

Computer Science and Game Theory · Computer Science 2017-03-06 Gerasimos Palaiopanos , Ioannis Panageas , Georgios Piliouras

Many real-world applications involve some agents that fall into two teams, with payoffs that are equal within the same team but of opposite sign across the opponent team. The so-called two-team zero-sum Markov games (2t0sMGs) can be…

Artificial Intelligence · Computer Science 2024-02-02 Guangzheng Hu , Yuanheng Zhu , Haoran Li , Dongbin Zhao

We study a version of the classical zero-sum matrix game with unknown payoff matrix and bandit feedback, where the players only observe each others actions and a noisy payoff. This generalizes the usual matrix game, where the payoff matrix…

Machine Learning · Computer Science 2021-06-15 Brendan O'Donoghue , Tor Lattimore , Ian Osband

In an inverse game problem, one needs to infer the cost function of the players in a game such that a desired joint strategy is a Nash equilibrium. We study the inverse game problem for a class of multiplayer matrix games, where the cost…

Computer Science and Game Theory · Computer Science 2022-10-17 Yue Yu , Jonathan Salfity , David Fridovich-Keil , Ufuk Topcu

We formalize the problem of maximizing the mean-payoff value with high probability while satisfying a parity objective in a Markov decision process (MDP) with unknown probabilistic transition function and unknown reward function. Assuming…

Artificial Intelligence · Computer Science 2018-08-24 Jan Křetínský , Guillermo A. Pérez , Jean-François Raskin

Enormous successes have been made by quantum algorithms during the last decade. In this paper, we combine the quantum game with the problem of data clustering, and then develop a quantum-game-based clustering algorithm, in which data points…

Machine Learning · Computer Science 2015-05-13 Qiang Li , Yan He , Jing-ping Jiang

Mean-payoff games (MPGs) are infinite duration two-player zero-sum games played on weighted graphs. Under the hypothesis of perfect information, they admit memoryless optimal strategies for both players and can be solved in…

Logic in Computer Science · Computer Science 2015-04-14 Paul Hunter , Guillermo A. Pérez , Jean-François Raskin

We study countably infinite Markov decision processes (MDPs) with real-valued transition rewards. Every infinite run induces the following sequences of payoffs: 1. Point payoff (the sequence of directly seen transition rewards), 2. Total…

Artificial Intelligence · Computer Science 2021-07-13 Richard Mayr , Eric Munday

Multi-dimensional mean-payoff and energy games provide the mathematical foundation for the quantitative study of reactive systems, and play a central role in the emerging quantitative theory of verification and synthesis. In this work, we…

Computer Science and Game Theory · Computer Science 2014-11-04 Krishnendu Chatterjee , Mickael Randour , Jean-François Raskin

In this paper, we consider the problem of optimization and learning for constrained and multi-objective Markov decision processes, for both discounted rewards and expected average rewards. We formulate the problems as zero-sum games where…

Optimization and Control · Mathematics 2021-03-05 Ather Gattami , Qinbo Bai , Vaneet Agarwal

Recent advances in quantum computing and in particular, the introduction of quantum GANs, have led to increased interest in quantum zero-sum game theory, extending the scope of learning algorithms for classical games into the quantum realm.…

Computer Science and Game Theory · Computer Science 2023-04-28 Rahul Jain , Georgios Piliouras , Ryann Sim

This paper proposes Mutation-Driven Multiplicative Weights Update (M2WU) for learning an equilibrium in two-player zero-sum normal-form games and proves that it exhibits the last-iterate convergence property in both full and noisy feedback…

Computer Science and Game Theory · Computer Science 2023-05-29 Kenshi Abe , Kaito Ariu , Mitsuki Sakamoto , Kentaro Toyoshima , Atsushi Iwasaki

The game-theoretic risk management framework put forth in the precursor work "Towards a Theory of Games with Payoffs that are Probability-Distributions" (arXiv:1506.07368 [q-fin.EC]) is herein extended by algorithmic details on how to…

General Economics · Economics 2020-04-10 Stefan Rass

We study two-player zero-sum stochastic games, and propose a form of independent learning dynamics called Doubly Smoothed Best-Response dynamics, which integrates a discrete and doubly smoothed variant of the best-response dynamics into…

Computer Science and Game Theory · Computer Science 2023-03-07 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

We study countably infinite Markov decision processes (MDPs) with real-valued transition rewards. Every infinite run induces the following sequences of payoffs: 1. Point payoff (the sequence of directly seen transition rewards), 2. Mean…

Computational Complexity · Computer Science 2023-06-22 Richard Mayr , Eric Munday

We study deterministic games of infinite duration played on graphs and focus on the strategy complexity of quantitative objectives. Such games are known to admit optimal memoryless strategies over finite graphs, but require infinite-memory…

Computer Science and Game Theory · Computer Science 2024-06-26 Sougata Bose , Rasmus Ibsen-Jensen , David Purser , Patrick Totzke , Pierre Vandenhove

The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret…

Computer Science and Game Theory · Computer Science 2025-08-18 Aymeric Capitaine , Etienne Boursier , Eric Moulines , Michael I. Jordan , Alain Durmus

We consider generalized Nash equilibrium (GNE) problems in games with strongly monotone pseudo-gradients and jointly linear coupling constraints. We establish the convergence rate of a payoff-based approach intended to learn a variational…

Optimization and Control · Mathematics 2024-11-14 Tatiana Tatarenko , Maryam Kamgarpour

This paper proposes a payoff perturbation technique for the Mirror Descent (MD) algorithm in games where the gradient of the payoff functions is monotone in the strategy profile space, potentially containing additive noise. The optimistic…

Computer Science and Game Theory · Computer Science 2024-06-25 Kenshi Abe , Kaito Ariu , Mitsuki Sakamoto , Atsushi Iwasaki

In two-player games on graph, the players construct an infinite path through the game graph and get a reward computed by a payoff function over infinite paths. Over weighted graphs, the typical and most studied payoff functions compute the…

Computer Science and Game Theory · Computer Science 2011-04-19 Krishnendu Chatterjee , Laurent Doyen , Rohit Singh