English
Related papers

Related papers: When is Mean-Field Reinforcement Learning Tractabl…

200 papers

Markov games (MGs) and multi-agent reinforcement learning (MARL) are studied to model decision making in multi-agent systems. Traditionally, the objective in MG and MARL has been risk-neutral, i.e., agents are assumed to optimize a…

Computer Science and Game Theory · Computer Science 2024-06-11 Hafez Ghaemi , Shirin Jamshidi , Mohammad Mashreghi , Majid Nili Ahmadabadi , Hamed Kebriaei

We propose a policy iteration method to solve an inverse problem for a mean-field game (MFG) model, specifically to reconstruct the obstacle function in the game from the partial observation data of value functions, which represent the…

Optimization and Control · Mathematics 2026-02-12 Kui Ren , Nathan Soedjak , Shanyin Tong

Mean Field Game systems describe equilibrium configurations in differential games with infinitely many infinitesimal interacting agents. We introduce a learning procedure (similar to the Fictitious Play) for these games and show its…

Optimization and Control · Mathematics 2015-08-03 Pierre Cardaliaguet , Saeed Hadikhanloo

Multi-Agent Deep Reinforcement Learning (MADRL) was proven efficient in solving complex problems in robotics or games, yet most of the trained models are hard to interpret. While learning intrinsically interpretable models remains a…

Artificial Intelligence · Computer Science 2025-02-04 Yoann Poupart , Aurélie Beynier , Nicolas Maudet

While the topic of mean-field games (MFGs) has a relatively long history, heretofore there has been limited work concerning algorithms for the computation of equilibrium control policies. In this paper, we develop a computable policy…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

Reinforcement learning for multi-agent games has attracted lots of attention recently. However, given the challenge of solving Nash equilibria for large population games, existing works with guaranteed polynomial complexities either focus…

Optimization and Control · Mathematics 2025-09-04 Anran Hu , Junzi Zhang

In this paper, we consider a finite horizon, non-stationary, mean field games (MFG) with a large population of homogeneous players, sequentially making strategic decisions, where each player is affected by other players through an aggregate…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Multi-Agent Reinforcement Learning (MARL) has shown clear effectiveness in coordinating multiple agents across simulated benchmarks and constrained scenarios. However, its deployment in real-world multi-agent systems (MAS) remains limited,…

Artificial Intelligence · Computer Science 2025-07-15 Siyi Hu , Mohamad A Hady , Jianglin Qiao , Jimmy Cao , Mahardhika Pratama , Ryszard Kowalczyk

In this paper, we study a large population game with heterogeneous dynamics and cost functions solving a consensus problem. Moreover, the agents have communication constraints which appear as: (1) an Additive-White Gaussian Noise (AWGN)…

Systems and Control · Electrical Eng. & Systems 2022-08-26 Shubham Aggarwal , Muhammad Aneeq uz Zaman , Tamer Başar

We consider a dynamic traffic routing game over an urban road network involving a large number of drivers in which each driver selecting a particular route is subject to a penalty that is affine in the logarithm of the number of drivers…

Optimization and Control · Mathematics 2020-01-22 Takashi Tanaka , Ehsan Nekouei , Ali Reza Pedram , Karl Henrik Johansson

Mean-Field Game (MFG) serves as a crucial mathematical framework in modeling the collective behavior of individual agents interacting stochastically with a large population. In this work, we aim at solving a challenging class of MFGs in…

Machine Learning · Statistics 2022-09-21 Guan-Horng Liu , Tianrong Chen , Oswin So , Evangelos A. Theodorou

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation…

Optimization and Control · Mathematics 2025-06-03 Dirk Becherer , Christoph Reisinger , Jonathan Tam

We study provable multi-agent reinforcement learning (RL) in the general framework of partially observable stochastic games (POSGs). To circumvent the known hardness results and the use of computationally intractable oracles, we advocate…

Machine Learning · Computer Science 2026-03-16 Xiangyu Liu , Kaiqing Zhang

Recent renewed interest in multi-agent reinforcement learning (MARL) has generated an impressive array of techniques that leverage deep reinforcement learning, primarily actor-critic architectures, and can be applied to a limited range of…

Machine Learning · Computer Science 2021-06-21 Keyang He , Prashant Doshi , Bikramjit Banerjee

Reinforcement learning (RL) typically models the interaction between the agent and environment as a Markov decision process (MDP), where the rewards that guide the agent's behavior are always observable. However, in many real-world…

Artificial Intelligence · Computer Science 2025-05-15 Montaser Mohammedalamen , Michael Bowling

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement…

Machine Learning · Computer Science 2019-08-01 Lantao Yu , Jiaming Song , Stefano Ermon

While the general theory for the terminal-initial value problem for mean-field games (MFGs) has achieved a substantial progress, the corresponding forward-forward problem is still poorly understood - even in the one-dimensional setting.…

Analysis of PDEs · Mathematics 2016-06-30 Diogo Gomes , Levon Nurbekyan , Marc Sedjro