English
Related papers

Related papers: Poincar\'{e}-Bendixson Limit Sets in Multi-Agent L…

200 papers

Consider a 2-player normal-form game repeated over time. We introduce an adaptive learning procedure, where the players only observe their own realized payoff at each stage. We assume that agents do not know their own payoff function, and…

Computer Science and Game Theory · Computer Science 2013-06-13 Mario Bravo , Mathieu Faure

Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own…

Populations and Evolution · Quantitative Biology 2022-09-02 Alex McAvoy , Julian Kates-Harbeck , Krishnendu Chatterjee , Christian Hilbe

Adversarial training, a special case of multi-objective optimization, is an increasingly prevalent machine learning technique: some of its most notable applications include GAN-based generative modeling and self-play techniques in…

Machine Learning · Statistics 2021-03-17 Gauthier Gidel , David Balduzzi , Wojciech Marian Czarnecki , Marta Garnelo , Yoram Bachrach

We study a model for cascade effects over finite networks based on a deterministic binary linear threshold model. Our starting point is a networked coordination game where each agent's payoff is the sum of the payoffs coming from pairwise…

Discrete Mathematics · Computer Science 2013-01-04 Elie M. Adam , Munther A. Dahleh , Asuman Ozdaglar

Learning from repeated play in a fixed two-player zero-sum game is a classic problem in game theory and online learning. We consider a variant of this problem where the game payoff matrix changes over time, possibly in an adversarial…

Machine Learning · Computer Science 2022-02-01 Mengxiao Zhang , Peng Zhao , Haipeng Luo , Zhi-Hua Zhou

Characterizing the limit behavior -- that is, the attractors -- of learning dynamics is one of the most fundamental open questions in game theory. In recent work on this front, it was conjectured that the attractors of the replicator…

Computer Science and Game Theory · Computer Science 2026-03-06 Oliver Biggar , Christos Papadimitriou

Learning in games refers to scenarios where multiple players interact in a shared environment, each aiming to minimize their regret. An equilibrium can be computed at a fast rate of $O(1/T)$ when all players follow the optimistic…

Computer Science and Game Theory · Computer Science 2025-02-18 Taira Tsuchiya , Shinji Ito , Haipeng Luo

The existence of simple, uncoupled no-regret dynamics that converge to correlated equilibria in normal-form games is a celebrated result in the theory of multi-agent systems. Specifically, it has been known for more than 20 years that when…

Computer Science and Game Theory · Computer Science 2022-09-05 Andrea Celli , Alberto Marchesi , Gabriele Farina , Nicola Gatti

Regularized learning is a fundamental technique in online optimization, machine learning and many other fields of computer science. A natural question that arises in these settings is how regularized learning algorithms behave when faced…

Computer Science and Game Theory · Computer Science 2017-09-11 Panayotis Mertikopoulos , Christos Papadimitriou , Georgios Piliouras

We explore the behaviour emerging from learning agents repeatedly interacting strategically for a wide range of learning dynamics, including $Q$-learning, projected gradient, replicator and log-barrier dynamics. Going beyond the better…

Computer Science and Game Theory · Computer Science 2026-03-04 Galit Askenazi-Golan , Domenico Mergoni Cecchelli , Edward Plumb , Clemens Possnig

We study learning dynamics induced by strategic agents who repeatedly play a game with an unknown payoff-relevant parameter. In each step, an information system estimates a belief distribution of the parameter based on the players'…

Systems and Control · Electrical Eng. & Systems 2020-10-20 Manxi Wu , Saurabh Amin , Asuman Ozdaglar

Machine learning processes, e.g. ''learning in games'', can be viewed as non-linear dynamical systems. In general, such systems exhibit a wide spectrum of behaviors, ranging from stability/recurrence to the undesirable phenomena of chaos…

Computer Science and Game Theory · Computer Science 2020-08-05 Yun Kuen Cheung , Yixin Tao

Behavior in the context of game theory is described as a natural process that follows the 2nd law of thermodynamics. The rate of entropy increase as the payoff function is derived from statistical physics of open systems. The thermodynamic…

General Physics · Physics 2011-10-27 Jani Anttila , Arto Annila

In the literature on game-theoretic equilibrium finding, focus has mainly been on solving a single game in isolation. In practice, however, strategic interactions -- ranging from routing problems to online advertising auctions -- evolve…

Computer Science and Game Theory · Computer Science 2023-03-02 Keegan Harris , Ioannis Anagnostides , Gabriele Farina , Mikhail Khodak , Zhiwei Steven Wu , Tuomas Sandholm

Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent…

Machine Learning · Computer Science 2023-10-19 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

Starting with a group of reinforcement-learning agents we derive coupled replicator equations that describe the dynamics of collective learning in multiagent systems. We show that, although agents model their environment in a…

Adaptation and Self-Organizing Systems · Physics 2009-11-07 Yuzuru Sato , James P. Crutchfield

Routing games are amongst the most studied classes of games. Their two most well-known properties are that learning dynamics converge to equilibria and that all equilibria are approximately optimal. In this work, we perform a stress test…

Computer Science and Game Theory · Computer Science 2022-01-28 Thiparat Chotibut , Fryderyk Falniowski , Michał Misiurewicz , Georgios Piliouras

The behaviour of multi-agent learning in competitive network games is often studied within the context of zero-sum games, in which convergence guarantees may be obtained. However, outside of this class the behaviour of learning is known to…

Computer Science and Game Theory · Computer Science 2023-12-20 Aamal Hussain , Francesco Belardinelli

Understanding the behavior of no-regret dynamics in general $N$-player games is a fundamental question in online learning and game theory. A folk result in the field states that, in finite games, the empirical frequency of play under…

Computer Science and Game Theory · Computer Science 2020-10-21 Lampros Flokas , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Thanasis Lianeas , Panayotis Mertikopoulos , Georgios Piliouras

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g.…

Computer Science and Game Theory · Computer Science 2022-02-25 Gabriel P. Andrade , Rafael Frongillo , Georgios Piliouras