English
Related papers

Related papers: A Distributed Primal-Dual Method for Constrained M…

200 papers

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

Machine Learning · Computer Science 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

Coordination is one of the essential problems in multi-agent systems. Typically multi-agent reinforcement learning (MARL) methods treat agents equally and the goal is to solve the Markov game to an arbitrary Nash equilibrium (NE) when…

Multiagent Systems · Computer Science 2020-04-07 Haifeng Zhang , Weizhe Chen , Zeren Huang , Minne Li , Yaodong Yang , Weinan Zhang , Jun Wang

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Yijing Xie , Shaoshuai Mou , Shreyas Sundaram

We investigate the problem of distributed training under partial observability, whereby cooperative multi-agent reinforcement learning agents (MARL) maximize the expected cumulative joint reward. We propose distributed value decomposition…

Machine Learning · Computer Science 2025-02-12 Guilherme S. Varela , Alberto Sardinha , Francisco S. Melo

In this paper, we aim to solve a distributed optimization problem with affine coupling constraints in a multi-agent network, where the cost function of the agents is composed of smooth and possibly non-smooth parts. To solve this problem,…

Optimization and Control · Mathematics 2022-05-31 Jianzheng Wang , Guoqiang Hu

We consider algorithms for solving structured convex optimization problems over a network of agents with communication delays. It is assumed that each agent performs its local updates by using possibly outdated information from its…

Optimization and Control · Mathematics 2020-09-14 Puya Latafat , Panagiotis Patrinos

Mean-Field Control (MFC) has recently been proven to be a scalable tool to approximately solve large-scale multi-agent reinforcement learning (MARL) problems. However, these studies are typically limited to unconstrained cumulative reward…

Machine Learning · Computer Science 2024-09-11 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

In cooperative multi-agent reinforcement learning (c-MARL), agents learn to cooperatively take actions as a team to maximize a total team reward. We analyze the robustness of c-MARL to adversaries capable of attacking one of the agents on a…

Machine Learning · Computer Science 2020-03-10 Jieyu Lin , Kristina Dzeparoska , Sai Qian Zhang , Alberto Leon-Garcia , Nicolas Papernot

We propose a new framework for multi-agent reinforcement learning (MARL), where the agents cooperate in a time-evolving network with latent community structures and mixed memberships. Unlike traditional neighbor-based or fixed interaction…

Machine Learning · Computer Science 2025-05-16 Zhaoyang Shi

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

Purpose of review: Recent advances in sensing, actuation, and computation have opened the door to multi-robot systems consisting of hundreds/thousands of robots, with promising applications to automated manufacturing, disaster relief,…

Robotics · Computer Science 2022-04-08 Yutong Wang , Mehul Damani , Pamela Wang , Yuhong Cao , Guillaume Sartoretti

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

Multiagent Systems · Computer Science 2025-10-14 Shahbaz P Qadri Syed , He Bai

Although Multi-Agent Reinforcement Learning (MARL) is effective for complex multi-robot tasks, it suffers from low sample efficiency and requires iterative manual reward tuning. Large Language Models (LLMs) have shown promise in…

Robotics · Computer Science 2025-06-04 Guobin Zhu , Rui Zhou , Wenkang Ji , Shiyu Zhao

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

Machine Learning · Computer Science 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

Existing multi-agent coordination techniques are often fragile and vulnerable to anomalies such as agent attrition and communication disturbances, which are quite common in the real-world deployment of systems like field robotics. To better…

Multiagent Systems · Computer Science 2024-10-27 Anthony Goeckner , Yueyuan Sui , Nicolas Martinet , Xinliang Li , Qi Zhu

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

The deployment of Unmanned Aerial Vehicle (UAV) swarms as dynamic communication relays is critical for next-generation tactical networks. However, operating in contested environments requires solving a complex trade-off, including…

Networking and Internet Architecture · Computer Science 2025-12-10 Thai Duong Nguyen , Ngoc-Tan Nguyen , Thanh-Dao Nguyen , Nguyen Van Huynh , Dinh-Hieu Tran , Symeon Chatzinotas

In cooperative multi-agent tasks, a team of agents jointly interact with an environment by taking actions, receiving a team reward and observing the next state. During the interactions, the uncertainty of environment and reward will…

Machine Learning · Computer Science 2022-05-23 Jian Zhao , Mingyu Yang , Youpeng Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Multi-agent actor-critic algorithms are an important part of the Reinforcement Learning paradigm. We propose three fully decentralized multi-agent natural actor-critic (MAN) algorithms in this work. The objective is to collectively find a…

Machine Learning · Computer Science 2022-04-05 Prashant Trivedi , Nandyala Hemachandra

Tasks for multi-robot systems often require the robots to collaborate and complete a team goal while maintaining safety. This problem is usually formalized as a constrained Markov decision process (CMDP), which targets minimizing a global…

Robotics · Computer Science 2025-04-23 Songyuan Zhang , Oswin So , Mitchell Black , Zachary Serlin , Chuchu Fan