English
Related papers

Related papers: Learning with minimal information in continuous ga…

200 papers

We provide a distributed algorithm to learn a Nash equilibrium in a class of non-cooperative games with strongly monotone mappings and unconstrained action sets. Each player has access to her own smooth local cost function and can…

Optimization and Control · Mathematics 2019-07-17 Tatiana Tatarenko , Angelia Nedich

A recent body of experimental literature has studied empirical game-theoretical analysis, in which we have partial knowledge of a game, consisting of observations of a subset of the pure-strategy profiles and their associated payoffs to…

Computer Science and Game Theory · Computer Science 2014-02-13 John Fearnley , Martin Gairing , Paul Goldberg , Rahul Savani

Constrained Markov games offer a formal mathematical framework for modeling multi-agent reinforcement learning problems where the behavior of the agents is subject to constraints. In this work, we focus on the recently introduced class of…

Machine Learning · Computer Science 2024-02-29 Philip Jordan , Anas Barakat , Niao He

Considering a class of gradient-based multi-agent learning algorithms in non-cooperative settings, we provide local convergence guarantees to a neighborhood of a stable local Nash equilibrium. In particular, we consider continuous games…

Optimization and Control · Mathematics 2024-09-23 Benjamin Chasnov , Lillian J. Ratliff , Eric Mazumdar , Samuel A. Burden

Generating payoff matrices of normal-form games at random, we calculate the frequency of games with a unique pure strategy Nash equilibrium in the ensemble of $n$-player, $m$-strategy games. These are perfectly predictable as they must…

Theoretical Economics · Economics 2020-11-03 Samuel C. Wiese , Torsten Heinrich

We study best-response type learning dynamics for zero-sum polymatrix games under two information settings. The two settings are distinguished by the type of information that each player has about the game and their opponents' strategy. The…

Optimization and Control · Mathematics 2025-08-13 Fathima Zarin Faizal , Asuman Ozdaglar , Martin J. Wainwright

This paper examines the long-run behavior of learning with bandit feedback in non-cooperative concave games. The bandit framework accounts for extremely low-information environments where the agents may not even know they are playing a…

Computer Science and Game Theory · Computer Science 2018-10-05 Mario Bravo , David S. Leslie , Panayotis Mertikopoulos

This paper considers a distributed Nash equilibrium seeking problem, where the players only have partial access to other players' actions, such as their neighbors' actions. Thus, the players are supposed to communicate with each other to…

Optimization and Control · Mathematics 2020-03-31 Yipeng Pang , Guoqiang Hu

In this work, we study stochastic non-cooperative games, where only noisy black-box function evaluations are available to estimate the cost function for each player. Since each player's cost function depends on both its own decision…

Computer Science and Game Theory · Computer Science 2025-11-18 Haidong Li , Anzhi Sheng , Yijie Peng , Long Wang

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

In this paper, we propose a passivity-based methodology for analysis and design of reinforcement learning in multi-agent finite games. Starting from a known exponentially-discounted reinforcement learning scheme, we show that convergence to…

Optimization and Control · Mathematics 2024-10-30 Bolin Gao , Lacra Pavel

We analyze the performance of the best-response dynamic across all normal-form games using a random games approach. The playing sequence -- the order in which players update their actions -- is essentially irrelevant in determining whether…

Theoretical Economics · Economics 2022-11-18 Torsten Heinrich , Yoojin Jang , Luca Mungo , Marco Pangallo , Alex Scott , Bassel Tarbush , Samuel Wiese

We study stochastic effects on the lagging anchor dynamics, a reinforcement learning algorithm used to learn successful strategies in iterated games, which is known to converge to Nash points in the absence of noise. The dynamics is…

Adaptation and Self-Organizing Systems · Physics 2012-04-20 James B. T. Sanders , Tobias Galla , Jonathan Shapiro

We consider multi-agent decision making, where each agent optimizes its cost function subject to constraints. Agents' actions belong to a compact convex Euclidean space and the agents' cost functions are coupled. We propose a distributed…

Optimization and Control · Mathematics 2016-12-01 Tatiana Tatarenko , Maryam Kamgarpour

We consider two classes of constrained finite state-action stochastic games. First, we consider a two player nonzero sum single controller constrained stochastic game with both average and discounted cost criterion. We consider the same…

Optimization and Control · Mathematics 2012-06-11 Vikas Vikram Singh , N. Hemachandra

This paper introduces a novel payoff-based learning scheme for distributed optimization in repeatedly-played strategic-form games. Standard reinforcement-based learning exhibits several limitations with respect to their asymptotic…

Computer Science and Game Theory · Computer Science 2018-03-08 Georgios C. Chasparis

This work considers stochastic differential games with a large number of players, whose costs and dynamics interact through the empirical distribution of both their states and their controls. We develop a new framework to prove convergence…

Probability · Mathematics 2022-03-24 Mathieu Laurière , Ludovic Tangpi

Distributed Nash equilibrium seeking of aggregative games is investigated and a continuous-time algorithm is proposed. The algorithm is designed by virtue of projected gradient play dynamics and distributed average tracking dynamics, and is…

Optimization and Control · Mathematics 2021-12-07 Shu Liang , Peng Yi , Yiguang Hong , Kaixiang Peng

Multi-agent games are becoming an increasing prevalent formalism for the study of electronic commerce and auctions. The speed at which transactions can take place and the growing complexity of electronic marketplaces makes the study of…

Computer Science and Game Theory · Computer Science 2013-01-18 Satinder Singh , Michael Kearns , Yishay Mansour

In this paper, we extend the Descent framework, which enables learning and planning in the context of two-player games with perfect information, to the framework of stochastic games. We propose two ways of doing this, the first way…

Artificial Intelligence · Computer Science 2023-02-10 Quentin Cohen-Solal , Tristan Cazenave