English
Related papers

Related papers: Learning in Congestion Games with Bandit Feedback

200 papers

Existing studies on provably efficient algorithms for Markov games (MGs) almost exclusively build on the "optimism in the face of uncertainty" (OFU) principle. This work focuses on a different approach of posterior sampling, which is…

Machine Learning · Computer Science 2022-10-06 Wei Xiong , Han Zhong , Chengshuai Shi , Cong Shen , Tong Zhang

Behavioral diversity, expert imitation, fairness, safety goals and others give rise to preferences in sequential decision making domains that do not decompose additively across time. We introduce the class of convex Markov games that allow…

Computer Science and Game Theory · Computer Science 2025-06-17 Ian Gemp , Andreas Haupt , Luke Marris , Siqi Liu , Georgios Piliouras

Learning and equilibrium computation in games are fundamental problems across computer science and economics, with applications ranging from politics to machine learning. Much of the work in this area revolves around a simple algorithm…

Computer Science and Game Theory · Computer Science 2022-07-19 Daniel Beaglehole , Max Hopkins , Daniel Kane , Sihan Liu , Shachar Lovett

We address the generalized Nash equilibrium seeking problem for a population of agents playing aggregative games with affine coupling constraints. We focus on semi-decentralized communication architectures, where there is a central…

Optimization and Control · Mathematics 2022-06-16 Giuseppe Belgioioso , Sergio Grammatico

We consider a decentralized multiplayer game, played over $T$ rounds, with a leader-follower hierarchy described by a directed acyclic graph. For each round, the graph structure dictates the order of the players and how players observe the…

Machine Learning · Computer Science 2023-01-30 Johan Östman , Ather Gattami , Daniel Gillblad

In this paper, we present a novel consensus-based zeroth-order algorithm tailored for non-convex multiplayer games. The proposed method leverages a metaheuristic approach using concepts from swarm intelligence to reliably identify global…

Dynamical Systems · Mathematics 2024-07-30 Enis Chenchene , Hui Huang , Jinniao Qiu

We propose the first model-free algorithm that achieves low regret performance for decentralized learning in two-player zero-sum tabular stochastic games with infinite-horizon average-reward objective. In decentralized learning, the…

Machine Learning · Computer Science 2023-01-16 Romain Cravic , Nicolas Gast , Bruno Gaujal

This work proposes a novel distributed approach for computing a Nash equilibrium in convex games with restricted strongly monotone pseudo-gradients. By leveraging the idea of the centralized operator extrapolation method presented in [4] to…

Optimization and Control · Mathematics 2023-10-25 Tatiana Tatarenko , Angelia Nedich

Congestion games are popular models often used to study the system-level inefficiencies caused by selfish agents, typically measured by the price of anarchy. One may expect that aligning the agents' preferences with the system-level…

Computer Science and Game Theory · Computer Science 2024-09-04 Bryce L Ferguson , Dario Paccagnan , Bary S R Pradelski , Jason R Marden

We develop a flexible stochastic approximation framework for analyzing the long-run behavior of learning in games (both continuous and finite). The proposed analysis template incorporates a wide array of popular learning algorithms,…

Computer Science and Game Theory · Computer Science 2023-07-04 Panayotis Mertikopoulos , Ya-Ping Hsieh , Volkan Cevher

We study online learning in two-player uninformed Markov games, where the opponent's actions and policies are unobserved. In this setting, Tian et al. (2021) show that achieving no-external-regret is impossible without incurring an…

Machine Learning · Computer Science 2026-02-10 Junyan Liu , Haipeng Luo , Zihan Zhang , Lillian J. Ratliff

We consider the problem of learning to play a repeated multi-agent game with an unknown reward function. Single player online learning algorithms attain strong regret bounds when provided with full information feedback, which unfortunately…

Machine Learning · Computer Science 2019-10-29 Pier Giuseppe Sessa , Ilija Bogunovic , Maryam Kamgarpour , Andreas Krause

Learning from repeated play in a fixed two-player zero-sum game is a classic problem in game theory and online learning. We consider a variant of this problem where the game payoff matrix changes over time, possibly in an adversarial…

Machine Learning · Computer Science 2022-02-01 Mengxiao Zhang , Peng Zhao , Haipeng Luo , Zhi-Hua Zhou

Correlated equilibrium generalizes Nash equilibrium by allowing a central coordinator to guide players' actions through shared recommendations, similar to how routing apps guide drivers. We investigate how a coordinator can learn a…

Computer Science and Game Theory · Computer Science 2025-09-16 Zhenlong Fang , Aryan Deshwal , Yue Yu

This paper addresses the distributed Nash Equilibrium seeking problem for aggregative games, where legitimate players' decisions are affected by potential malicious players. To describe players' behavior, we introduce a novel heterogeneous…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Kai-Yuan Guo , Yan-Wu Wang , Xiao-Kang Liu , Zhi-Wei Liu

Data mining and knowledge discovery are two important growing research fields in the last two decades due to the abundance of data collected from various sources. The exponentially growing volumes of generated data urge the development of…

Computer Science and Game Theory · Computer Science 2020-07-13 Dalila Kessira , Mohand-Tahar Kechadi

Multi-agent reinforcement learning has made substantial empirical progresses in solving games with a large number of players. However, theoretically, the best known sample complexity for finding a Nash equilibrium in general-sum games…

Machine Learning · Computer Science 2022-04-01 Ziang Song , Song Mei , Yu Bai

Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR)…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Tuomas Sandholm

The minority game is a simple congestion game in which the players' main goal is to choose among two options the one that is adopted by the smallest number of players. We characterize the set of Nash equilibria and the limiting behavior of…

Physics and Society · Physics 2007-08-28 Willemien Kets , Mark Voorneveld

Game theory studies situations in which strategic players can modify the state of a given system, due to the absence of a central authority. Solution concepts, such as Nash equilibrium, are defined to predict the outcome of such situations.…

Computer Science and Game Theory · Computer Science 2013-11-08 Diodato Ferraioli , Paul W. Goldberg , Carmine Ventre