English
Related papers

Related papers: Learning Decentralized Partially Observable Mean F…

200 papers

Federated learning (FL) is a promising paradigm that can enable collaborative model training between vehicles while protecting data privacy, thereby significantly improving the performance of intelligent transportation systems (ITSs). In…

Networking and Internet Architecture · Computer Science 2025-03-11 Dongyu Chen , Tao Deng , He Huang , Juncheng Jia , Mianxiong Dong , Di Yuan , Keqin Li

Centralised training with decentralised execution (CT-DE) serves as the foundation of many leading multi-agent reinforcement learning (MARL) algorithms. Despite its popularity, it suffers from a critical drawback due to its reliance on…

Multiagent Systems · Computer Science 2023-06-23 Taher Jafferjee , Juliusz Ziomek , Tianpei Yang , Zipeng Dai , Jianhong Wang , Matthew Taylor , Kun Shao , Jun Wang , David Mguni

Tasks for multi-robot systems often require the robots to collaborate and complete a team goal while maintaining safety. This problem is usually formalized as a constrained Markov decision process (CMDP), which targets minimizing a global…

Robotics · Computer Science 2025-04-23 Songyuan Zhang , Oswin So , Mitchell Black , Zachary Serlin , Chuchu Fan

Deep reinforcement learning (DRL) is a booming area of artificial intelligence. Many practical applications of DRL naturally involve more than one collaborative learners, making it important to study DRL in a multi-agent context. Previous…

Machine Learning · Computer Science 2019-10-22 Gang Chen

In edge computing systems, autonomous agents must make fast local decisions while competing for shared resources. Existing MARL methods often resume to centralized critics or frequent communication, which fail under limited observability…

Machine Learning · Computer Science 2025-10-24 Andrea Fox , Francesco De Pellegrini , Eitan Altman

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

Decentralized control schemes are increasingly favored in various domains that involve multi-agent systems due to the need for computational efficiency as well as general applicability to large-scale systems. However, in the absence of an…

Robotics · Computer Science 2023-05-24 Yiwei Lyu , Wenhao Luo , John M. Dolan

Mean field games (MFG) and mean field control problems (MFC) are frameworks to study Nash equilibria or social optima in games with a continuum of agents. These problems can be used to approximate competitive or cooperative games with a…

Optimization and Control · Mathematics 2021-06-28 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Lauriere

Cooperative multi-agent reinforcement learning (MARL) involves complex agent interactions and requires effective exploration strategies. A prominent class of MARL algorithms, decentralized softmax policy gradient (DecSPG), addresses this…

Multiagent Systems · Computer Science 2026-05-11 Yuyang Zhang , Haldun Balim , Na Li

Targets search and detection encompasses a variety of decision problems such as coverage, surveillance, search, observing and pursuit-evasion along with others. In this paper we develop a multi-agent deep reinforcement learning (MADRL)…

Robotics · Computer Science 2021-03-18 Roi Yehoshua , Juan Heredia-Juesas , Yushu Wu , Christopher Amato , Jose Martinez-Lorenzo

We present a decentralized reinforcement learning (RL) approach to address the multi-agent shepherding control problem, departing from the conventional assumption of cohesive target groups. Our two-layer control architecture consists of a…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Italo Napolitano , Andrea Lama , Francesco De Lellis , Mario di Bernardo

This paper presents the first ever approach for solving \emph{continuous-observation} Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) and their semi-Markovian counterparts, Dec-POSMDPs. This contribution is…

Multiagent Systems · Computer Science 2017-03-17 Shayegan Omidshafiei , Christopher Amato , Miao Liu , Michael Everett , Jonathan P. How , John Vian

Connected and autonomous vehicles (CAVs) promise next-gen transportation systems with enhanced safety, energy efficiency, and sustainability. One typical control strategy for CAVs is the so-called cooperative adaptive cruise control (CACC)…

Systems and Control · Electrical Eng. & Systems 2024-02-20 Dong Chen , Kaixiang Zhang , Yongqiang Wang , Xunyuan Yin , Zhaojian Li , Dimitar Filev

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

Artificial Intelligence · Computer Science 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

The inability to communicate poses a major challenge to coordination in multi-agent reinforcement learning (MARL). Prior work has explored correlating local policies via shared randomness, sometimes in the form of a correlation device, as a…

Multiagent Systems · Computer Science 2026-02-12 John Gardiner , Orlando Romero , Brendan Tivnan , Nicolò Dal Fabbro , George J. Pappas

We study provable multi-agent reinforcement learning (RL) in the general framework of partially observable stochastic games (POSGs). To circumvent the known hardness results and the use of computationally intractable oracles, we advocate…

Machine Learning · Computer Science 2026-03-16 Xiangyu Liu , Kaiqing Zhang

Cooperative multi-agent reinforcement learning (CMARL) has shown to be promising for many real-world applications. Previous works mainly focus on improving coordination ability via solving MARL-specific challenges (e.g., non-stationarity,…

Multiagent Systems · Computer Science 2023-05-11 Lei Yuan , Zi-Qian Zhang , Ke Xue , Hao Yin , Feng Chen , Cong Guan , Li-He Li , Chao Qian , Yang Yu

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution (CTDE), where centralized critics leverage global information to guide decentralized actors. However,…

Machine Learning · Computer Science 2025-11-27 Yan Wang , Ke Deng , Yongli Ren

This paper introduces and analyzes a new class of mean-field control (\textsc{MFC}) problems in which agents interact through a \emph{fixed but controllable} network structure. In contrast with the classical \textsc{MFC} framework -- where…

Optimization and Control · Mathematics 2025-11-07 Mao Fabrice Djete