English
Related papers

Related papers: Convergence of Payoff-Based Higher-Order Replicato…

200 papers

This tutorial article puts forth a framework to analyze the noncooperative strategic interactions among the members of a large population of bounded rationality agents. Our approach hinges on, unifies and generalizes existing methods and…

Optimization and Control · Mathematics 2020-07-15 Shinkyu Park , Nuno C. Martins , Jeff S. Shamma

Learning problems commonly exhibit an interesting feedback mechanism wherein the population data reacts to competing decision makers' actions. This paper formulates a new game theoretic framework for this phenomenon, called "multi-player…

Computer Science and Game Theory · Computer Science 2022-04-08 Adhyyan Narang , Evan Faulkner , Dmitriy Drusvyatskiy , Maryam Fazel , Lillian J. Ratliff

We study a class of evolutionary game dynamics defined by balancing a gain determined by the game's payoffs against a cost of motion that captures the difficulty with which the population moves between states. Costs of motion are…

Optimization and Control · Mathematics 2018-04-12 Panayotis Mertikopoulos , WIlliam H. Sandholm

We consider generalized Nash equilibrium (GNE) problems in games with strongly monotone pseudo-gradients and jointly linear coupling constraints. We establish the convergence rate of a payoff-based approach intended to learn a variational…

Optimization and Control · Mathematics 2024-11-14 Tatiana Tatarenko , Maryam Kamgarpour

We consider the inverse problem of dynamic games, where cost function parameters are sought which explain observed behavior of interacting players. Maximum entropy inverse reinforcement learning is extended to the N-player case in order to…

Systems and Control · Electrical Eng. & Systems 2020-07-27 Jairo Inga , Esther Bischoff , Florian Köpf , Sören Hohmann

We analyze, using a dynamical systems approach, the replicator dynamics for the asymmetric Hawk-Dove game in which there is a set of four pure strategies with arbitrary payoffs. We give a full account of the equilibrium points and their…

Dynamical Systems · Mathematics 2017-04-26 Ikjyot Singh Kohli , Michael C. Haslam

Reinforcement-based learning dynamics may exhibit several limitations when applied in a distributed setup. In (repeatedly-played) multi-player/action strategic-form games, and when each player applies an independent copy of the learning…

Computer Science and Game Theory · Computer Science 2025-11-25 Georgios C. Chasparis

In this paper, we study the problem of learning in quantum games - and other classes of semidefinite games - with scalar, payoff-based feedback. For concreteness, we focus on the widely used matrix multiplicative weights (MMW) algorithm…

Computer Science and Game Theory · Computer Science 2023-11-07 Kyriakos Lotidis , Panayotis Mertikopoulos , Nicholas Bambos , Jose Blanchet

We study the asymptotic behavior of deterministic, continuous-time imitation dynamics for population games over networks. The basic assumption of this learning mechanism -- encompassing the replicator dynamics -- is that players belonging…

Systems and Control · Electrical Eng. & Systems 2020-10-23 Giacomo Como , Fabio Fagnani , Lorenzo Zino

We study a coevolutionary public goods game on a dynamic hypergraph, where an individual's payoff directly determines the number of hyperedges it can join. In the proposed mechanism, nodes adjust their participation according to the group…

Physics and Society · Physics 2026-05-27 Yichao Yao , Yuji Zhang , Juan Wu , Minyu Feng , Attila Szolnoki

We develop a flexible stochastic approximation framework for analyzing the long-run behavior of learning in games (both continuous and finite). The proposed analysis template incorporates a wide array of popular learning algorithms,…

Computer Science and Game Theory · Computer Science 2023-07-04 Panayotis Mertikopoulos , Ya-Ping Hsieh , Volkan Cevher

What does it mean to fully understand the behavior of a network of adaptive agents? The golden standard typically is the behavior of learning dynamics in potential games, where many evolutionary dynamics, e.g., replicator, are known to…

Computer Science and Game Theory · Computer Science 2016-10-04 Ioannis Panageas , Georgios Piliouras

We study two-player zero-sum stochastic games, and propose a form of independent learning dynamics called Doubly Smoothed Best-Response dynamics, which integrates a discrete and doubly smoothed variant of the best-response dynamics into…

Computer Science and Game Theory · Computer Science 2023-03-07 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

We investigate a class of reinforcement learning dynamics where players adjust their strategies based on their actions' cumulative payoffs over time - specifically, by playing mixed strategies that maximize their expected cumulative payoff…

Optimization and Control · Mathematics 2016-02-10 Panayotis Mertikopoulos , William H. Sandholm

We propose an adaptive incentive mechanism that learns the optimal incentives in environments where players continuously update their strategies. Our mechanism updates incentives based on each player's externality, defined as the difference…

Computer Science and Game Theory · Computer Science 2025-03-04 Chinmay Maheshwari , Kshitij Kulkarni , Manxi Wu , Shankar Sastry

Replicator equation -- a paradigm equation in evolutionary game dynamics -- mathematizes the frequency dependent selection of competing strategies vying to enhance their fitness (quantified by the average payoffs) with respect to the…

Chaotic Dynamics · Physics 2021-02-18 Varun Pandit , Archan Mukhopadhyay , Sagar Chakraborty

Imitating successful behavior is a natural and frequently applied approach to trust in when facing scenarios for which we have little or no experience upon which we can base our decision. In this paper, we consider such behavior in atomic…

Computer Science and Game Theory · Computer Science 2008-10-04 Heiner Ackermann , Petra Berenbrink , Simon Fischer , Martin Hoefer

Except for special classes of games, there is no systematic framework for analyzing the dynamical properties of multi-agent strategic interactions. Potential games are one such special but restrictive class of games that allow for tractable…

Computer Science and Game Theory · Computer Science 2023-10-03 Ozan Candogan , Asuman Ozdaglar , Pablo A. Parrilo

This paper examines the convergence behaviour of simultaneous best-response dynamics in random potential games. We provide a theoretical result showing that, for two-player games with sufficiently many actions, the dynamics converge quickly…

Computer Science and Game Theory · Computer Science 2025-05-19 Galit Ashkenazi-Golan , Domenico Mergoni Cecchelli , Edward Plumb

In this paper, we address the inverse problem in the case of linear-quadratic discrete-time dynamic non-cooperative games. Given feedback laws of players that are known to be a Nash equilibrium pair for a discrete-time linear system, we…

Optimization and Control · Mathematics 2024-07-19 Emin Martirosyan , Ming Cao