English
Related papers

Related papers: Exploiting No-Regret Algorithms in System Design

200 papers

Zero-determinant strategies are memory-one strategies in repeated games which unilaterally enforce linear relations between expected payoffs of players. Recently, the concept of zero-determinant strategies was extended to the class of…

Optimization and Control · Mathematics 2022-09-07 Masahiko Ueda

We study last-iterate convergence properties of algorithms for solving two-player zero-sum games based on Regret Matching$^+$ (RM$^+$). Despite their widespread use for solving real games, virtually nothing is known about their last-iterate…

Computer Science and Game Theory · Computer Science 2025-03-05 Yang Cai , Gabriele Farina , Julien Grand-Clément , Christian Kroer , Chung-Wei Lee , Haipeng Luo , Weiqiang Zheng

In communication systems where users share common resources, users' selfish behavior usually results in suboptimal resource utilization. There have been extensive works that model communication systems with selfish users as one-shot games…

Information Theory · Computer Science 2011-11-11 Yuanzhang Xiao , Jaeok Park , Mihaela van der Schaar

Discounted-sum games provide a formal model for the study of reinforcement learning, where the agent is enticed to get rewards early since later rewards are discounted. When the agent interacts with the environment, she may regret her…

Computer Science and Game Theory · Computer Science 2018-11-20 Michaël Cadilhac , Guillermo A. Pérez , Marie van den Bogaard

We study best-response type learning dynamics for zero-sum polymatrix games under two information settings. The two settings are distinguished by the type of information that each player has about the game and their opponents' strategy. The…

Optimization and Control · Mathematics 2025-08-13 Fathima Zarin Faizal , Asuman Ozdaglar , Martin J. Wainwright

Optimization under uncertainty is a fundamental problem in learning and decision-making, particularly in multi-agent systems. Previously, Feldman, Kalai, and Tennenholtz [2010] demonstrated the ability to efficiently compete in repeated…

Computer Science and Game Theory · Computer Science 2026-01-29 Daniel Ablin , Alon Cohen

Regret matching (RM) -- and its modern variants -- is a foundational online algorithm that has been at the heart of many AI breakthrough results in solving benchmark zero-sum games, such as poker. Yet, surprisingly little is known so far in…

Computer Science and Game Theory · Computer Science 2025-11-18 Ioannis Anagnostides , Emanuel Tewolde , Brian Hu Zhang , Ioannis Panageas , Vincent Conitzer , Tuomas Sandholm

We consider regret minimization in repeated games with non-convex loss functions. Minimizing the standard notion of regret is computationally intractable. Thus, we define a natural notion of regret which permits efficient optimization and…

Machine Learning · Computer Science 2017-11-06 Elad Hazan , Karan Singh , Cyril Zhang

Motivated by applications in service systems, we consider queueing systems where each customer must be handled by a server with the right skill set. We focus on optimizing the routing of customers to servers in order to maximize the total…

Machine Learning · Computer Science 2024-12-16 Sanne van Kempen , Jaron Sanders , Fiona Sloothaak , Maarten G. Wolf

In repeated interactions between individuals, we do not expect that exactly the same situation will occur from one time to another. Contrary to what is common in models of repeated games in the literature, most real situations may differ a…

Populations and Evolution · Quantitative Biology 2007-05-23 Anders Eriksson , Kristian Lindgren

We consider an autonomous navigation problem, whereby a traveler aims at traversing an environment in which an adversary tries to set an ambush. A two players zero sum game is introduced. Players' strategies are computed as random path…

Robotics · Computer Science 2016-12-08 Emmanuel Boidot , Aude Marzuoli , Eric Feron

This paper considers convex games involving multiple agents that aim to minimize their own cost functions using locally available information. A common assumption in the study of such games is that the agents are symmetric, meaning that…

Optimization and Control · Mathematics 2025-09-25 Zifan Wang , Xinlei Yi , Yi Shen , Michael M. Zavlanos , Karl H. Johansson

We study a version of the classical zero-sum matrix game with unknown payoff matrix and bandit feedback, where the players only observe each others actions and a noisy payoff. This generalizes the usual matrix game, where the payoff matrix…

Machine Learning · Computer Science 2021-06-15 Brendan O'Donoghue , Tor Lattimore , Ian Osband

We study a general version of the adversarial online learning problem. We are given a decision set $\mathcal{X}$ in a reflexive Banach space $X$ and a sequence of reward vectors in the dual space of $X$. At each iteration, we choose an…

Machine Learning · Computer Science 2016-06-07 Maximilian Balandat , Walid Krichene , Claire Tomlin , Alexandre Bayen

We introduce a new approach for computing optimal equilibria via learning in games. It applies to extensive-form settings with any number of players, including mechanism design, information design, and solution concepts such as correlated,…

Evolutionary game theory is a powerful mathematical framework to study how intelligent individuals adjust their strategies in collective interactions. It has been widely believed that it is impossible to unilaterally control players'…

Optimization and Control · Mathematics 2021-08-31 Renfei Tan , Qi Su , Bin Wu , Long Wang

Adversarial training, a special case of multi-objective optimization, is an increasingly prevalent machine learning technique: some of its most notable applications include GAN-based generative modeling and self-play techniques in…

Machine Learning · Statistics 2021-03-17 Gauthier Gidel , David Balduzzi , Wojciech Marian Czarnecki , Marta Garnelo , Yoram Bachrach

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

In game theory, imperfect-recall decision problems model situations in which an agent forgets information it held before. They encompass games such as the ``absentminded driver'' and team games with limited communication. In this paper, we…

Computer Science and Game Theory · Computer Science 2026-02-18 Emanuel Tewolde , Brian Hu Zhang , Ioannis Anagnostides , Tuomas Sandholm , Vincent Conitzer

We consider the problem of decentralized multi-agent reinforcement learning in Markov games. A fundamental question is whether there exist algorithms that, when adopted by all agents and run independently in a decentralized fashion, lead to…

Machine Learning · Computer Science 2023-03-23 Dylan J. Foster , Noah Golowich , Sham M. Kakade