English
Related papers

Related papers: Efficient Competitive Self-Play Policy Optimizatio…

200 papers

How can a social planner adaptively incentivize selfish agents who are learning in a strategic environment to induce a socially optimal outcome in the long run? We propose a two-timescale learning dynamics to answer this question in both…

Computer Science and Game Theory · Computer Science 2022-04-13 Chinmay Maheshwari , Kshitij Kulkarni , Manxi Wu , Shankar Sastry

This paper investigates the challenge of learning in black-box games, where the underlying utility function is unknown to any of the agents. While there is an extensive body of literature on the theoretical analysis of algorithms for…

Machine Learning · Computer Science 2024-11-15 Minbiao Han , Fengxue Zhang , Yuxin Chen

We study the repeated congestion game, in which multiple populations of players share resources, and make, at each iteration, a decentralized decision on which resources to utilize. We investigate the following question: given a model of…

Machine Learning · Computer Science 2014-08-04 Walid Krichene , Benjamin Drighès , Alexandre M. Bayen

We investigate a class of reinforcement learning dynamics where players adjust their strategies based on their actions' cumulative payoffs over time - specifically, by playing mixed strategies that maximize their expected cumulative payoff…

Optimization and Control · Mathematics 2016-02-10 Panayotis Mertikopoulos , William H. Sandholm

In many game-theoretic settings, agents are challenged with taking decisions against the uncertain behavior exhibited by others. Often, this uncertainty arises from multiple sources, e.g., incomplete information, limited computation,…

Computer Science and Game Theory · Computer Science 2025-07-22 Nicolas Lanzetti , Sylvain Fricker , Saverio Bolognani , Florian Dörfler , Dario Paccagnan

In modern transportation networks, adversaries can manipulate routing algorithms using false data injection attacks, such as simulating heavy traffic with multiple devices running crowdsourced navigation applications, to mislead vehicles…

Artificial Intelligence · Computer Science 2026-03-13 Taha Eghtesad , Yevgeniy Vorobeychik , Aron Laszka

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

Machine Learning · Computer Science 2017-05-25 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

Artificial Intelligence · Computer Science 2014-08-08 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

Policy-based methods with function approximation are widely used for solving two-player zero-sum games with large state and/or action spaces. However, it remains elusive how to obtain optimization and statistical guarantees for such…

Machine Learning · Computer Science 2022-03-01 Yulai Zhao , Yuandong Tian , Jason D. Lee , Simon S. Du

There is a recent trend of applying multi-agent reinforcement learning (MARL) to train an agent that can cooperate with humans in a zero-shot fashion without using any human data. The typical workflow is to first repeatedly run self-play…

Artificial Intelligence · Computer Science 2023-02-06 Chao Yu , Jiaxuan Gao , Weilin Liu , Botian Xu , Hao Tang , Jiaqi Yang , Yu Wang , Yi Wu

When solving two-player zero-sum games, multi-agent reinforcement learning (MARL) algorithms often create populations of agents where, at each iteration, a new agent is discovered as the best response to a mixture over the opponent…

Artificial Intelligence · Computer Science 2021-11-02 Xidong Feng , Oliver Slumbers , Ziyu Wan , Bo Liu , Stephen McAleer , Ying Wen , Jun Wang , Yaodong Yang

The standard risk minimization paradigm of machine learning is brittle when operating in environments whose test distributions are different from the training distribution due to spurious correlations. Training on data from many…

Machine Learning · Computer Science 2020-03-20 Kartik Ahuja , Karthikeyan Shanmugam , Kush R. Varshney , Amit Dhurandhar

The Nash equilibrium is an important benchmark for behaviour in systems of strategic autonomous agents. Polymatrix games are a succinct and expressive representation of multiplayer games that model pairwise interactions between players. The…

Computer Science and Game Theory · Computer Science 2016-03-17 Argyrios Deligkas , John Fearnley , Tobenna Peter Igwe , Rahul Savani

Consider a set of agents who play a network game repeatedly. Agents may not know the network. They may even be unaware that they are interacting with other agents in a network. Possibly, they just understand that their payoffs depend on an…

Theoretical Economics · Economics 2022-07-26 Pierpaolo Battigalli , Fabrizio Panebianco , Paolo Pin

Auctions are modeled as Bayesian games with continuous type and action spaces. Determining equilibria in auction games is computationally hard in general and no exact solution theory is known. We introduce an algorithmic framework in which…

Computer Science and Game Theory · Computer Science 2023-05-10 Martin Bichler , Maximilian Fichtl , Matthias Oberlechner

This paper presents a multi-agent reinforcement learning algorithm to represent strategic bidding behavior in freight transport markets. Using this algorithm, we investigate whether feasible market equilibriums arise without any central…

Machine Learning · Computer Science 2021-02-19 Wouter van Heeswijk

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

A satisfactory multiagent learning algorithm should, {\em at a minimum}, learn to play optimally against stationary opponents and converge to a Nash equilibrium in self-play. The algorithm that has come closest, WoLF-IGA, has been proven to…

Computer Science and Game Theory · Computer Science 2009-09-29 Vincent Conitzer , Tuomas Sandholm

Research in adversarial learning follows a cat and mouse game between attackers and defenders where attacks are proposed, they are mitigated by new defenses, and subsequently new attacks are proposed that break earlier defenses, and so on.…

Machine Learning · Computer Science 2020-11-13 Ambar Pal , René Vidal

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal