English
Related papers

Related papers: Equilibrium Selection for Multi-agent Reinforcemen…

200 papers

In multi-agent reinforcement learning (MARL) and game theory, agents repeatedly interact and revise their strategies as new data arrives, producing a sequence of strategy profiles. This paper studies sequences of strategies satisfying a…

Computer Science and Game Theory · Computer Science 2024-10-02 Bora Yongacoglu , Gürdal Arslan , Lacra Pavel , Serdar Yüksel

Multi-agent reinforcement learning (MARL) is increasingly used to design learning-enabled agents that interact in shared environments. However, training MARL algorithms in general-sum games remains challenging: learning dynamics can become…

Machine Learning · Computer Science 2026-04-07 Addison Kalanther , Sanika Bharvirkar , Shankar Sastry , Chinmay Maheshwari

The framework of multi-agent learning explores the dynamics of how individual agent strategies evolve in response to the evolving strategies of other agents. Of particular interest is whether or not agent strategies converge to well known…

Computer Science and Game Theory · Computer Science 2023-11-21 Sarah A. Toonsi , Jeff S. Shamma

We study multi-agent reinforcement learning (MARL) in infinite-horizon discounted zero-sum Markov games. We focus on the practical but challenging setting of decentralized MARL, where agents make decisions without coordination by a…

Computer Science and Game Theory · Computer Science 2021-12-14 Muhammed O. Sayin , Kaiqing Zhang , David S. Leslie , Tamer Basar , Asuman Ozdaglar

Motivated by the scarcity of accurate payoff feedback in practical applications of game theory, we examine a class of learning dynamics where players adjust their choices based on past payoff observations that are subject to noise and…

Optimization and Control · Mathematics 2016-06-03 Mario Bravo , Panayotis Mertikopoulos

In real-world multi-agent reinforcement learning (MARL) applications, agents may not have perfect state information (e.g., due to inaccurate measurement or malicious attacks), which challenges the robustness of agents' policies. Though…

Machine Learning · Computer Science 2023-08-01 Sihong He , Songyang Han , Sanbao Su , Shuo Han , Shaofeng Zou , Fei Miao

Repeated games consider a situation where multiple agents are motivated by their independent rewards throughout learning. In general, the dynamics of their learning become complex. Especially when their rewards compete with each other like…

Computer Science and Game Theory · Computer Science 2023-05-23 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

One key in real-life Nash equilibrium applications is to calibrate players' cost functions. To leverage the approximation ability of neural networks, we proposed a general framework for optimizing and learning Nash equilibrium using neural…

Computer Science and Game Theory · Computer Science 2024-09-04 Di Zhang , Wei Gu , Qing Jin

Multi-Agent Reinforcement Learning (MARL) -- where multiple agents learn to interact in a shared dynamic environment -- permeates across a wide range of critical applications. While there has been substantial progress on understanding the…

Computer Science and Game Theory · Computer Science 2022-10-05 Shicong Cen , Yuejie Chi , Simon S. Du , Lin Xiao

Real-world games, which concern imperfect information, multiple players, and simultaneous moves, are less frequently discussed in the existing literature of game theory. While reinforcement learning (RL) provides a general framework to…

Computer Science and Game Theory · Computer Science 2023-06-02 Runyu Lu , Yuanheng Zhu , Dongbin Zhao

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their…

Optimization and Control · Mathematics 2024-06-18 Gokce Dayanikli , Mathieu Lauriere

In multi-agent reinforcement learning (MARL), independent learners are those that do not observe the actions of other agents in the system. Due to the decentralization of information, it is challenging to design independent learners that…

Computer Science and Game Theory · Computer Science 2024-03-28 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

Existing settings of decentralized learning either require players to have full information or the system to have certain special structure that may be hard to check and hinder their applicability to practical systems. To overcome this, we…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Yan Jiang , Wenqi Cui , Baosen Zhang , Jorge Cortés

Federated learning offers a decentralized approach to machine learning, where multiple agents collaboratively train a model while preserving data privacy. In this paper, we investigate the decision-making and equilibrium behavior in…

Computer Science and Game Theory · Computer Science 2025-03-13 Lihui Yi , Xiaochun Niu , Ermin Wei

Much of recent success in multiagent reinforcement learning has been in two-player zero-sum games. In these games, algorithms such as fictitious self-play and minimax tree search can converge to an approximate Nash equilibrium. While…

Multiagent Systems · Computer Science 2019-12-11 Alexander Shmakov , John Lanier , Stephen McAleer , Rohan Achar , Cristina Lopes , Pierre Baldi

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

The overall aim of our research is to develop techniques to reason about the equilibrium properties of multi-agent systems. We model multi-agent systems as concurrent games, in which each player is a process that is assumed to act…

Logic in Computer Science · Computer Science 2020-08-14 Julian Gutierrez , Aniello Murano , Giuseppe Perelli , Sasha Rubin , Thomas Steeples , Michael Wooldridge

Learning in games provides a powerful framework to design control policies for self-interested agents that may be coupled through their dynamics, costs, or constraints. We consider the case where the dynamics of the coupled system can be…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Mostafa M. Shibl , Vijay Gupta

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

Executing actions in a correlated manner is a common strategy for human coordination that often leads to better cooperation, which is also potentially beneficial for cooperative multi-agent reinforcement learning (MARL). However, the recent…

Multiagent Systems · Computer Science 2023-06-06 Dingyang Chen , Qi Zhang