English
Related papers

Related papers: Learning Mean Field Games on Sparse Graphs: A Hybr…

200 papers

Multi-agent reinforcement learning (MARL) remains difficult to scale to many agents. Recent MARL using Mean Field Control (MFC) provides a tractable and rigorous approach to otherwise difficult cooperative MARL. However, the strict MFC…

Machine Learning · Computer Science 2024-05-09 Kai Cui , Christian Fabian , Anam Tahir , Heinz Koeppl

Mean field games (MFGs) offer a versatile framework for modeling large-scale interactive systems across multiple domains. This paper builds upon a previous work, by developing a state-of-the-art unified approach to decode or design the…

Analysis of PDEs · Mathematics 2025-01-22 Hongyu Liu , Catharine W. K. Lo

Mean field games (MFGs) tractably model behavior in large agent populations. The literature on learning MFG equilibria typically focuses on finding Nash equilibria (NE), which assume perfectly rational agents and are hence implausible in…

Computer Science and Game Theory · Computer Science 2025-01-31 Yannick Eich , Christian Fabian , Kai Cui , Heinz Koeppl

Reinforcement learning is a powerful tool to learn the optimal policy of possibly multiple agents by interacting with the environment. As the number of agents grow to be very large, the system can be approximated by a mean-field problem.…

Optimization and Control · Mathematics 2020-08-18 Weichen Wang , Jiequn Han , Zhuoran Yang , Zhaoran Wang

Graph Neural Networks (GNNs) have shown considerable effectiveness in a variety of graph learning tasks, particularly those based on the message-passing approach in recent years. However, their performance is often constrained by a limited…

Machine Learning · Computer Science 2024-04-22 Ruizhe Zhang , Xinke Jiang , Yuchen Fang , Jiayuan Luo , Yongxin Xu , Yichen Zhu , Xu Chu , Junfeng Zhao , Yasha Wang

Mean field games (MFGs) are a promising framework for modeling the behavior of large-population systems. However, solving MFGs can be challenging due to the coupling of forward population evolution and backward agent dynamics. Typically,…

Machine Learning · Computer Science 2024-07-17 Chenyu Zhang , Xu Chen , Xuan Di

We propose a novel mean field games (MFGs) based GAN(generative adversarial network) framework. To be specific, we utilize the Hopf formula in density space to rewrite MFGs as a primal-dual problem so that we are able to train the model via…

Machine Learning · Computer Science 2021-03-16 Shaojun Ma , Haomin Zhou , Hongyuan Zha

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

Optimization and Control · Mathematics 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

Mean Field Games (MFGs) have been introduced to efficiently approximate games with very large populations of strategic agents. Recently, the question of learning equilibria in MFGs has gained momentum, particularly using model-free…

We present a Reinforcement Learning (RL) algorithm to solve infinite horizon asymptotic Mean Field Game (MFG) and Mean Field Control (MFC) problems. Our approach can be described as a unified two-timescale Mean Field Q-learning: The…

Optimization and Control · Mathematics 2021-06-01 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière

This paper proposes a novel Mean-Field Game (MFG) framework for large-scale attacker-defender systems aimed at protecting one or multiple High-Value Units (HVUs). Motivated by classical agent-wise attrition models, we introduce a…

Analysis of PDEs · Mathematics 2026-04-03 Avetik Arakelyan , Tigran Bakaryan , Davit Alaverdyan , Naira Hovakimyan , Isaac Kaminer

Coordination is one of the most difficult aspects of multi-agent reinforcement learning (MARL). One reason is that agents normally choose their actions independently of one another. In order to see coordination strategies emerging from the…

Machine Learning · Computer Science 2023-01-16 Matteo Gallici , Mario Martin , Ivan Masmitja

In this paper, we study large population multi-agent reinforcement learning (RL) in the context of discrete-time linear-quadratic mean-field games (LQ-MFGs). Our setting differs from most existing work on RL for MFGs, in that we consider a…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space. Existing graph representation learning methods can be classified into two categories: generative models that learn the…

Machine Learning · Computer Science 2017-11-23 Hongwei Wang , Jia Wang , Jialin Wang , Miao Zhao , Weinan Zhang , Fuzheng Zhang , Xing Xie , Minyi Guo

Mean Field Control (MFC) is a powerful approximation tool to solve large-scale Multi-Agent Reinforcement Learning (MARL) problems. However, the success of MFC relies on the presumption that given the local states and actions of all the…

Machine Learning · Computer Science 2023-05-30 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

Towards the challenging problem of semi-supervised node classification, there have been extensive studies. As a frontier, Graph Neural Networks (GNNs) have aroused great interest recently, which update the representation of each node by…

Machine Learning · Computer Science 2020-05-12 Huaxiu Yao , Chuxu Zhang , Ying Wei , Meng Jiang , Suhang Wang , Junzhou Huang , Nitesh V. Chawla , Zhenhui Li

Multi-agent reinforcement learning has emerged as a powerful framework for enabling agents to learn complex, coordinated behaviors but faces persistent challenges regarding its generalization, scalability and sample efficiency. Recent…

Robotics · Computer Science 2025-04-28 Nikolaos Bousias , Stefanos Pertigkiozoglou , Kostas Daniilidis , George Pappas

Unsupervised graph-level representation learning plays a crucial role in a variety of tasks such as molecular property prediction and community analysis, especially when data annotation is expensive. Currently, most of the best-performing…

Machine Learning · Computer Science 2022-02-09 Thilini Cooray , Ngai-Man Cheung

To model complex real-world systems, such as traders in stock markets, or the dissemination of contagious diseases, graphon mean-field games (GMFG) have been proposed to model many agents. Despite the empirical success, our understanding of…

Computer Science and Game Theory · Computer Science 2024-10-14 Jing Dong , Baoxiang Wang , Yaoliang Yu

We consider a class of mean field games in which the agents interact through both their states and controls, and we focus on situations in which a generic agent tries to adjust her speed (control) to an average speed (the average is made in…

Analysis of PDEs · Mathematics 2020-03-10 Y Achdou , Z Kobeissi