English
Related papers

Related papers: Mean-Field Controls with Q-learning for Cooperativ…

200 papers

Cooperative multi-agent reinforcement learning (MARL) has been an increasingly important research topic in the last half-decade because of its great potential for real-world applications. Because of the curse of dimensionality, the popular…

Multiagent Systems · Computer Science 2024-04-05 Weizhe Chen , Sven Koenig , Bistra Dilkina

This paper is a continuation work of Ren et al. (2026) aiming to further devise q-learning algorithms for mean-field control (MFC) with controlled common noise. Based on the relaxed control formulation, we first establish the martingale…

Optimization and Control · Mathematics 2026-05-01 Zhenjie Ren , Xiaoli Wei , Xiang Yu , Xun Yu Zhou

In this paper, we propose several approaches to learn the optimal population-dependent controls in order to solve mean field control problems (MFC). Such policies enable us to solve MFC problems with forms of common noises at a level of…

Optimization and Control · Mathematics 2023-11-21 Gokce Dayanikli , Mathieu Lauriere , Jiacheng Zhang

Mean Field Control Games (MFCG), introduced in [Angiuli et al., 2022a], represent competitive games between a large number of large collaborative groups of agents in the infinite limit of number and size of groups. In this paper, we prove…

Optimization and Control · Mathematics 2024-06-05 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather information about their environment by vehicle-to-vehicle (V2V) communication. In this work, we design an information-sharing-based…

Artificial Intelligence · Computer Science 2022-09-07 Songyang Han , Shanglin Zhou , Jiangwei Wang , Lynn Pepin , Caiwen Ding , Jie Fu , Fei Miao

Existing multi-agent reinforcement learning methods are limited typically to a small number of agents. When the agent number increases largely, the learning becomes intractable due to the curse of the dimensionality and the exponential…

Multiagent Systems · Computer Science 2020-12-16 Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , Jun Wang

Multi-Agent Reinforcement Learning (MARL) is useful in many problems that require the cooperation and coordination of multiple agents. Learning optimal policies using reinforcement learning in a multi-agent setting can be very difficult as…

Machine Learning · Computer Science 2022-05-31 Rafael Pina , Varuna De Silva , Joosep Hook , Ahmet Kondoz

Although quantum supremacy is yet to come, there has recently been an increasing interest in identifying the potential of quantum machine learning (QML) in the looming era of practical quantum computing. Motivated by this, in this article…

Quantum Physics · Physics 2022-11-29 Won Joon Yun , Jihong Park , Joongheon Kim

For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties…

Multiagent Systems · Computer Science 2023-08-04 Soohyun Park , Jae Pyoung Kim , Chanyoung Park , Soyi Jung , Joongheon Kim

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Mean-field control (MFC) problems aim to find the optimal policy to control massive populations of interacting agents. These problems are crucial in areas such as economics, physics, and biology. We consider the non-local setting, where the…

Optimization and Control · Mathematics 2024-05-20 Alexander Vidal , Samy Wu Fung , Stanley Osher , Luis Tenorio , Levon Nurbekyan

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

We study multi-agent reinforcement learning (MARL) for the general-sum Markov Games (MGs) under the general function approximation. In order to find the minimum assumption for sample-efficient learning, we introduce a novel complexity…

Machine Learning · Computer Science 2023-10-11 Nuoya Xiong , Zhihan Liu , Zhaoran Wang , Zhuoran Yang

This paper studies the discrete-time linear-quadratic-Gaussian mean field (MF) social control problem in an infinite horizon, where the dynamics of all agents are unknown. The objective is to design a reinforcement learning (RL) algorithm…

Optimization and Control · Mathematics 2025-12-05 Hanfang Zhang , Bing-Chang Wang , Shuo Chen

We propose using regularization for Multi-Agent Reinforcement Learning rather than learning explicit cooperative structures called {\em Multi-Agent Regularized Q-learning} (MARQ). Many MARL approaches leverage centralized structures in…

Machine Learning · Computer Science 2021-09-21 Chapman Siu , Jason Traish , Richard Yi Da Xu

Many large-scale platforms and networked control systems have a centralized decision maker interacting with a massive population of agents under strict observability constraints. Motivated by such applications, we study a cooperative Markov…

Multiagent Systems · Computer Science 2026-05-12 Emile Anand , Ishani Karmarkar

This paper concerns imitation learning (IL) (i.e, the problem of learning to mimic expert behaviors from demonstrations) in cooperative multi-agent systems. The learning problem under consideration poses several challenges, characterized by…

Machine Learning · Computer Science 2023-10-11 The Viet Bui , Tien Mai , Thanh Hong Nguyen

The thriving field of multi-agent reinforcement learning (MARL) studies how a group of interacting agents make decisions autonomously in a shared dynamic environment. Existing theoretical studies in this area suffer from at least two of the…

Machine Learning · Computer Science 2025-12-02 Na Li , Yuchen Jiao , Hangguan Shan , Shefeng Yan

Inspired by a graph-based technique for predicting molecular properties in quantum chemistry -- atoms' position within molecules in three-dimensional space -- we present Q-MARL, a completely decentralised learning architecture that supports…

Machine Learning · Computer Science 2025-03-11 Kha Vo , Chin-Teng Lin

Traditional multi-agent reinforcement learning algorithms are not scalable to environments with more than a few agents, since these algorithms are exponential in the number of agents. Recent research has introduced successful methods to…

Multiagent Systems · Computer Science 2021-01-26 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart