中文
相关论文

相关论文: Analysis of Multiscale Reinforcement Q-Learning Al…

200 篇论文

We propose a mean field control game model for the intra-and-inter-bank borrowing and lending problem. This framework allows to study the competitive game arising between groups of collaborative banks. The solution is provided in terms of…

最优化与控制 · 数学 2022-07-08 Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Laurière , Jimin Lin

This paper presents a novel model-free method to solve linear quadratic Gaussian mean field social control problems in the presence of multiplicative noise. The objective is to achieve a social optimum by solving two algebraic Riccati…

最优化与控制 · 数学 2025-11-11 Zhenhui Xu , Bing-Chang Wang , Tielong Shen

Scalability remains a challenge in multi-agent reinforcement learning and is currently under active research. A framework named mean-field reinforcement learning (MFRL) could alleviate the scalability problem by employing the Mean Field…

人工智能 · 计算机科学 2025-02-21 Hao Ma , Zhiqiang Pu , Yi Pan , Boyin Liu , Junlong Gao , Zhenyu Guo

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

最优化与控制 · 数学 2021-10-12 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

Mean field games (MFG) and mean field control (MFC) are critical classes of multi-agent models for efficient analysis of massive populations of interacting agents. Their areas of application span topics in economics, finance, game theory,…

机器学习 · 计算机科学 2022-06-08 Lars Ruthotto , Stanley Osher , Wuchen Li , Levon Nurbekyan , Samy Wu Fung

Mean field games (MFGs) tractably model behavior in large agent populations. The literature on learning MFG equilibria typically focuses on finding Nash equilibria (NE), which assume perfectly rational agents and are hence implausible in…

计算机科学与博弈论 · 计算机科学 2025-01-31 Yannick Eich , Christian Fabian , Kai Cui , Heinz Koeppl

While the topic of mean-field games (MFGs) has a relatively long history, heretofore there has been limited work concerning algorithms for the computation of equilibrium control policies. In this paper, we develop a computable policy…

系统与控制 · 电气工程与系统科学 2020-04-07 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

This paper establishes a data-driven solution for infinite horizon linear quadratic Gaussian Mean Field Games with network-coupled heterogeneous agent populations where the dynamics of the agents are unknown. The solution technique relies…

系统与控制 · 电气工程与系统科学 2026-02-17 Jean Zhu , Shuang Gao

Mean-field reinforcement learning has become a popular theoretical framework for efficiently approximating large-scale multi-agent reinforcement learning (MARL) problems exhibiting symmetry. However, questions remain regarding the…

计算机科学与博弈论 · 计算机科学 2024-02-09 Batuhan Yardim , Artur Goldman , Niao He

This paper studies the continuous-time q-learning in mean-field jump-diffusion models when the population distribution is not directly observable. We propose the integrated q-function in decoupled form (decoupled Iq-function) from the…

最优化与控制 · 数学 2025-03-24 Xiaoli Wei , Xiang Yu , Fengyi Yuan

Reinforcement learning has been successful both empirically and theoretically in single-agent settings, but extending these results to multi-agent reinforcement learning in general-sum Markov games remains challenging. This paper studies…

机器学习 · 计算机科学 2026-04-07 Narim Jeong , Donghwan Lee

Multitask Representation Learning (MRL) has emerged as a prevalent technique to improve sample efficiency in Reinforcement Learning (RL). Empirical studies have found that training agents on multiple tasks simultaneously within online and…

机器学习 · 计算机科学 2025-03-04 Rui Lu , Yang Yue , Andrew Zhao , Simon Du , Gao Huang

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

机器学习 · 计算机科学 2023-01-05 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

Recent techniques based on Mean Field Games (MFGs) allow the scalable analysis of multi-player games with many similar, rational agents. However, standard MFGs remain limited to homogeneous players that weakly influence each other, and…

计算机科学与博弈论 · 计算机科学 2023-12-19 Kai Cui , Gökçe Dayanıklı , Mathieu Laurière , Matthieu Geist , Olivier Pietquin , Heinz Koeppl

In this paper, we consider a finite horizon, non-stationary, mean field games (MFG) with a large population of homogeneous players, sequentially making strategic decisions, where each player is affected by other players through an aggregate…

系统与控制 · 电气工程与系统科学 2020-04-07 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

This paper presents a novel approach to multi-agent reinforcement learning (RL) for linear systems with convex polytopic constraints. Existing work on RL has demonstrated the use of model predictive control (MPC) as a function approximator…

系统与控制 · 电气工程与系统科学 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Bart De Schutter

Mean field control (MFC) is an effective way to mitigate the curse of dimensionality of cooperative multi-agent reinforcement learning (MARL) problems. This work considers a collection of $N_{\mathrm{pop}}$ heterogeneous agents that can be…

机器学习 · 计算机科学 2022-05-10 Washim Uddin Mondal , Mridul Agarwal , Vaneet Aggarwal , Satish V. Ukkusuri

We consider reinforcement learning (RL) methods for finding optimal policies in linear quadratic (LQ) mean field control (MFC) problems over an infinite horizon in continuous time, with common noise and entropy regularization. We study…

最优化与控制 · 数学 2024-08-06 Noufel Frikha , Huyên Pham , Xuanye Song

Mean Field Games (MFGs) can potentially scale multi-agent systems to extremely large populations of agents. Yet, most of the literature assumes a single initial distribution for the agents, which limits the practical applications of MFGs.…

机器学习 · 计算机科学 2021-09-21 Sarah Perrin , Mathieu Laurière , Julien Pérolat , Romuald Élie , Matthieu Geist , Olivier Pietquin

Mean Field Games (MFGs) have the ability to handle large-scale multi-agent systems, but learning Nash equilibria in MFGs remains a challenging task. In this paper, we propose a deep reinforcement learning (DRL) algorithm that achieves…

计算机科学与博弈论 · 计算机科学 2024-03-07 Zida Wu , Mathieu Lauriere , Samuel Jia Cong Chua , Matthieu Geist , Olivier Pietquin , Ankur Mehta