English
Related papers

Related papers: Learning Approximate Nash Equilibria in Cooperativ…

200 papers

In this paper, we investigate the mean field games with $K$ classes of agents who are weakly coupled via the empirical measure. The underlying dynamics of the representative agents is assumed to be a controlled nonlinear Markov process…

Probability · Mathematics 2012-04-09 Vassili N. Kolokoltsov , Jiajie Li , Wei Yang

We present a new model-based reinforcement learning algorithm, Cooperative Prioritized Sweeping, for efficient learning in multi-agent Markov decision processes. The algorithm allows for sample-efficient learning on large problems by…

Machine Learning · Computer Science 2020-01-22 Eugenio Bargiacchi , Timothy Verstraeten , Diederik M. Roijers , Ann Nowé

We consider a multi-agent Markov strategic interaction over an infinite horizon where agents can be of multiple types. We model the strategic interaction as a mean-field game in the asymptotic limit when the number of agents of each type…

Multiagent Systems · Computer Science 2021-01-01 Arnob Ghosh , Vaneet Aggarwal

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

Subject to reasonable conditions, in large population stochastic dynamics games, where the agents are coupled by the system's mean field (i.e. the state distribution of the generic agent) through their nonlinear dynamics and their nonlinear…

Optimization and Control · Mathematics 2019-05-28 Nevroz Sen , Peter E. Caines

This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents…

Artificial Intelligence · Computer Science 2023-04-14 Talal Algumaei , Ruben Solozabal , Reda Alami , Hakim Hacid , Merouane Debbah , Martin Takac

Mean field game theory studies the behavior of a large number of interacting individuals in a game theoretic setting and has received a lot of attention in the past decade (Lasry and Lions, Japanese journal of mathematics, 2007). In this…

Optimization and Control · Mathematics 2019-10-31 Martin Frank , Michael Herty , Torsten Trimborn

We consider multi-agent decision making, where each agent optimizes its cost function subject to constraints. Agents' actions belong to a compact convex Euclidean space and the agents' cost functions are coupled. We propose a distributed…

Optimization and Control · Mathematics 2016-12-01 Tatiana Tatarenko , Maryam Kamgarpour

We optimize finite horizon multi-agent reach-avoid Markov decision process (MDP) via \emph{local feedback policies}. The global feedback policy solution yields global optimality but its communication complexity, memory usage and computation…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Adam Casselman , Abraham P. Vinod , Sarah H. Q. Li

This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this problem consist of the…

Artificial Intelligence · Computer Science 2022-10-17 Zhiyuan Yao , Zihan Ding

We consider a class of dynamic collective choice models with social interactions, whereby a large number of non-uniform agents have to individually settle on one of multiple discrete alternative choices, with the relevance of their would-be…

Systems and Control · Computer Science 2017-08-21 Rabih Salhab , Roland P. Malhamé , Jerome Le Ny

This paper develops a distributed Nash Equilibrium seeking algorithm for heterogeneous multi-robot systems. The algorithm utilises distributed optimisation and output control to achieve the Nash equilibrium by leveraging information shared…

Robotics · Computer Science 2025-09-22 Yi Dong , Zhongguo Li , Sarvapali D. Ramchurn , Xiaowei Huang

We consider the problem where $M$ agents interact with $M$ identical and independent environments with $S$ states and $A$ actions using reinforcement learning for $T$ rounds. The agents share their data with a central server to minimize…

Machine Learning · Computer Science 2021-02-23 Mridul Agarwal , Bhargav Ganguly , Vaneet Aggarwal

We consider the problem of learning Nash equilibrial policies for two-player risk-sensitive collision-avoiding interactions. Solving the Hamilton-Jacobi-Isaacs equations of such general-sum differential games in real time is an open…

Robotics · Computer Science 2025-03-21 Lei Zhang , Siddharth Das , Tanner Merry , Wenlong Zhang , Yi Ren

Multi-agent reinforcement learning (MARL) is often modeled using the framework of Markov games (also called stochastic games or dynamic games). Most of the existing literature on MARL concentrates on zero-sum Markov games but is not…

Computer Science and Game Theory · Computer Science 2022-12-20 Jayakumar Subramanian , Amit Sinha , Aditya Mahajan

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

Machine Learning · Computer Science 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

This thesis is going to give a gentle introduction to Mean Field Games. It aims to produce a coherent text beginning for simple notions of deterministic control theory progressively to current Mean Field Games theory. The framework…

Optimization and Control · Mathematics 2019-07-03 Athanasios Vasiliadis

The majority of Multi-Agent Reinforcement Learning (MARL) literature equates the cooperation of self-interested agents in mixed environments to the problem of social welfare maximization, allowing agents to arbitrarily share rewards and…

Multiagent Systems · Computer Science 2023-06-16 Dmitry Ivanov , Ilya Zisman , Kirill Chernyshev

One of the key approaches to save samples in reinforcement learning (RL) is to use knowledge from an approximate model such as its simulator. However, how much does an approximate model help to learn a near-optimal policy of the true…

Machine Learning · Computer Science 2020-07-15 Fei Feng , Wotao Yin , Lin F. Yang

Cooperation is fundamental in Multi-Agent Systems (MAS) and Multi-Agent Reinforcement Learning (MARL), often requiring agents to balance individual gains with collective rewards. In this regard, this paper aims to investigate strategies to…

Computer Science and Game Theory · Computer Science 2024-05-06 Vaigarai Sathi , Sabahat Shaik , Jaswanth Nidamanuri