English
Related papers

Related papers: Policy Optimization finds Nash Equilibrium in Regu…

200 papers

Mean-field games have been used as a theoretical tool to obtain an approximate Nash equilibrium for symmetric and anonymous $N$-player games. However, limiting applicability, existing theoretical results assume variations of a "population…

Optimization and Control · Mathematics 2023-06-12 Batuhan Yardim , Semih Cayci , Matthieu Geist , Niao He

We study the problem of training a principal in a multi-agent general-sum game using reinforcement learning (RL). Learning a robust principal policy requires anticipating the worst possible strategic responses of other agents, which is…

Machine Learning · Computer Science 2022-12-21 Eric Zhao , Alexander R. Trott , Caiming Xiong , Stephan Zheng

We design and analyze reinforcement learning algorithms for Graphon Mean-Field Games (GMFGs). In contrast to previous works that require the precise values of the graphons, we aim to learn the Nash Equilibrium (NE) of the regularized GMFGs…

Computer Science and Game Theory · Computer Science 2023-10-27 Fengzhuo Zhang , Vincent Y. F. Tan , Zhaoran Wang , Zhuoran Yang

The Kelly or proportional allocation mechanism is a simple and efficient auction-based scheme that distributes an infinitely divisible resource proportionally to the agents bids. When agents are aware of the allocation rule, their…

Computer Science and Game Theory · Computer Science 2026-03-27 Younes Ben Mazziane , Cleque-Marlain Mboulou Moutoubi , Eitan Altman , Francesco De Pellegrini

Correlated Equilibrium is a solution concept that is more general than Nash Equilibrium (NE) and can lead to outcomes with better social welfare. However, its natural extension to the sequential setting, the \textit{Extensive Form…

Computer Science and Game Theory · Computer Science 2023-01-02 Chun Kai Ling , Fei Fang

We propose a framework to compute approximate Nash equilibria in integer programming games with nonlinear payoffs, i.e., simultaneous and non-cooperative games where each player solves a parametrized mixed-integer nonlinear program. We…

Optimization and Control · Mathematics 2025-08-04 Aloïs Duguet , Margarida Carvalho , Gabriele Dragotto , Sandra Ulrich Ngueveu

This paper explores advanced topics in complex multi-agent systems building upon our previous work. We examine four fundamental challenges in Multi-Agent Reinforcement Learning (MARL): non-stationarity, partial observability, scalability…

Multiagent Systems · Computer Science 2024-12-31 Neil De La Fuente , Miquel Noguer i Alonso , Guim Casadellà

For solving zero-sum games involving non-transitivity, a useful approach is to maintain a policy population to approximate the Nash Equilibrium (NE). Previous studies have shown that the Policy Space Response Oracles (PSRO) algorithm is an…

Computer Science and Game Theory · Computer Science 2026-01-06 Jiesong Lian , Yucong Huang , Chengdong Ma , Mingzhi Wang , Ying Wen , Long Hu , Yixue Hao

We consider the problem of finding a Nash equilibrium (NE) in a general-sum game, where player $i$'s objective is $f_i(x)=f_i(x_1,...,x_n)$, with $x_j\in\mathbb{R}^{d_j}$ denoting the strategy variables of player $j$. Our focus is on…

Computer Science and Game Theory · Computer Science 2026-02-13 Yutong Chao , Jalal Etesami

The overall aim of our research is to develop techniques to reason about the equilibrium properties of multi-agent systems. We model multi-agent systems as concurrent games, in which each player is a process that is assumed to act…

Logic in Computer Science · Computer Science 2020-08-14 Julian Gutierrez , Aniello Murano , Giuseppe Perelli , Sasha Rubin , Thomas Steeples , Michael Wooldridge

Modern random access mechanisms combine packet repetitions with multi-user detection mechanisms at the receiver to maximize the throughput and reliability in massive Internet of Things (IoT) scenarios. However, optimizing the access policy,…

A growing body of literature in networked systems research relies on game theory and mechanism design to model and address the potential lack of cooperation between self-interested users. Most game-theoretic models applied to system…

Computer Science and Game Theory · Computer Science 2007-05-23 Nicolas Christin , Jens Grossklags , John Chuang

Reinforcement Learning Algorithms (RLA) are useful machine learning tools to understand how decision makers react to signals. It is known that RLA converge towards the pure Nash Equilibria (NE) of finite congestion games and more generally,…

Computer Science and Game Theory · Computer Science 2021-11-15 Benoît Sohet , Yezekael Hayel , Olivier Beaude , Alban Jeandin

Entropy regularization is commonly used to improve policy optimization in reinforcement learning. It is believed to help with \emph{exploration} by encouraging the selection of more stochastic policies. In this work, we analyze this claim…

Machine Learning · Computer Science 2019-06-11 Zafarali Ahmed , Nicolas Le Roux , Mohammad Norouzi , Dale Schuurmans

We present efficient approximation algorithms for finding Nash equilibria in anonymous games, that is, games in which the players utilities, though different, do not differentiate between other players. Our results pertain to such games…

Computer Science and Game Theory · Computer Science 2007-10-31 Constantinos Daskalakis , Christos Papadimitriou

Much of recent success in multiagent reinforcement learning has been in two-player zero-sum games. In these games, algorithms such as fictitious self-play and minimax tree search can converge to an approximate Nash equilibrium. While…

Multiagent Systems · Computer Science 2019-12-11 Alexander Shmakov , John Lanier , Stephen McAleer , Rohan Achar , Cristina Lopes , Pierre Baldi

This work proposes a novel distributed approach for computing a Nash equilibrium in convex games with restricted strongly monotone pseudo-gradients. By leveraging the idea of the centralized operator extrapolation method presented in [4] to…

Optimization and Control · Mathematics 2023-10-25 Tatiana Tatarenko , Angelia Nedich

We consider potential games with mixed-integer variables, for which we propose two distributed, proximal-like equilibrium seeking algorithms. Specifically, we focus on two scenarios: i) the underlying game is generalized ordinal and the…

Optimization and Control · Mathematics 2022-10-28 Filippo Fabiani , Barbara Franci , Simone Sagratella , Martin Schmidt , Mathias Staudigl

In classical job-scheduling games, each job behaves as a selfish player, choosing a machine to minimize its own completion time. To reduce the equilibria inefficiency, coordination mechanisms are employed, allowing each machine to follow…

Computer Science and Game Theory · Computer Science 2025-02-11 Gilad Lavie , Tami Tamir

The well known refinement of the Nash Equilibrium (NE) called an Evolutionarily Stable Strategy (ESS) is investigated in the quantum Prisoner's Dilemma (PD) game that is played using an Einstein-Podolsky-Rosen type setting. Earlier results…

Quantum Physics · Physics 2015-05-13 Azhar Iqbal , Derek Abbott