English
Related papers

Related papers: MARL with General Utilities via Decentralized Shad…

200 papers

Efficient exploration in multi-agent reinforcement learning (MARL) is a challenging problem when receiving only a team reward, especially in environments with sparse rewards. A powerful method to mitigate this issue involves crafting dense…

Machine Learning · Computer Science 2025-07-28 Xuefei Wu , Xiao Yin , Yuanyang Zhu , Chunlin Chen

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

Machine Learning · Computer Science 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

Recent advances in multi-agent reinforcement learning (MARL) have achieved super-human performance in games like Quake 3 and Dota 2. Unfortunately, these techniques require orders-of-magnitude more training rounds than humans and don't…

Machine Learning · Computer Science 2020-10-19 Tianjun Zhang , Huazhe Xu , Xiaolong Wang , Yi Wu , Kurt Keutzer , Joseph E. Gonzalez , Yuandong Tian

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Artificial Intelligence · Computer Science 2017-11-08 Marc Lanctot , Vinicius Zambaldi , Audrunas Gruslys , Angeliki Lazaridou , Karl Tuyls , Julien Perolat , David Silver , Thore Graepel

This paper considers multi-agent reinforcement learning (MARL) tasks where agents receive a shared global reward at the end of an episode. The delayed nature of this reward affects the ability of the agents to assess the quality of their…

Multiagent Systems · Computer Science 2022-01-13 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Communication technologies enable coordination among connected and autonomous vehicles (CAVs). However, it remains unclear how to utilize shared information to improve the safety and efficiency of the CAV system in dynamic and complicated…

Robotics · Computer Science 2023-03-15 Zhili Zhang , Songyang Han , Jiangwei Wang , Fei Miao

We consider the problem of cooperative exploration where multiple robots need to cooperatively explore an unknown region as fast as possible. Multi-agent reinforcement learning (MARL) has recently become a trending paradigm for solving this…

Robotics · Computer Science 2023-04-12 Chao Yu , Xinyi Yang , Jiaxuan Gao , Jiayu Chen , Yunfei Li , Jijia Liu , Yunfei Xiang , Ruixin Huang , Huazhong Yang , Yi Wu , Yu Wang

Multi-Agent Reinforcement Learning (MARL) comprises an area of growing interest in the field of machine learning. Despite notable advances, there are still problems that require investigation. The lazy agent pathology is a famous problem in…

Machine Learning · Computer Science 2023-11-07 Rafael Pina , Varuna De Silva , Corentin Artaud

Offline Multi-Agent Reinforcement Learning (MARL) is an emerging field that aims to learn optimal multi-agent policies from pre-collected datasets. Compared to single-agent case, multi-agent setting involves a large joint state-action space…

Artificial Intelligence · Computer Science 2024-12-19 Zongkai Liu , Qian Lin , Chao Yu , Xiawei Wu , Yile Liang , Donghui Li , Xuetao Ding

Multi-agent reinforcement learning (MARL) methods typically require that agents enjoy global state observability, preventing development of decentralized algorithms and limiting scalability. Recent work has shown that, under assumptions on…

Machine Learning · Computer Science 2025-05-30 Wesley A Suttle , Vipul K Sharma , Brian M Sadler

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in AI research. However, many research endeavours heavily rely on parameter sharing among agents, which confines…

Machine Learning · Computer Science 2023-12-29 Yifan Zhong , Jakub Grudzien Kuba , Xidong Feng , Siyi Hu , Jiaming Ji , Yaodong Yang

This paper studies networked multi-agent reinforcement learning (NMARL) with interdependent rewards and coupled policies. In this setting, each agent's reward depends on its own state-action pair as well as those of its direct neighbors,…

Multiagent Systems · Computer Science 2025-12-11 Pengcheng Dai , Dongming Wang , Wenwu Yu , Wei Ren

This paper presents a decentralized Multi-Agent Reinforcement Learning (MARL) approach to an incentive-based Demand Response (DR) program, which aims to maintain the capacity limits of the electricity grid and prevent grid congestion by…

Systems and Control · Electrical Eng. & Systems 2023-04-11 Jasper van Tilburg , Luciano C. Siebert , Jochen L. Cremer

In this work, we present a novel cooperative multi-agent reinforcement learning method called \textbf{Loc}ality based \textbf{Fac}torized \textbf{M}ulti-Agent \textbf{A}ctor-\textbf{C}ritic (Loc-FACMAC). Existing state-of-the-art…

Instead of making behavioral decisions directly from the exponentially expanding joint observational-action space, subtask-based multi-agent reinforcement learning (MARL) methods enable agents to learn how to tackle different subtasks. Most…

Artificial Intelligence · Computer Science 2024-03-05 Wenjing Zhang , Wei Zhang

Centralized Training for Decentralized Execution where agents are trained offline in a centralized fashion and execute online in a decentralized manner, has become a popular approach in Multi-Agent Reinforcement Learning (MARL). In…

Artificial Intelligence · Computer Science 2024-08-28 Xueguang Lyu , Andrea Baisero , Yuchen Xiao , Brett Daley , Christopher Amato

In multi-agent reinforcement learning (MARL), the centralized training with decentralized execution (CTDE) framework has gained widespread adoption due to its strong performance. However, the further development of CTDE faces two key…

Multiagent Systems · Computer Science 2024-12-25 Lunjun Liu , Weilai Jiang , Yaonan Wang

Inferring reward functions from demonstrations is a key challenge in reinforcement learning (RL), particularly in multi-agent RL (MARL), where large joint state-action spaces and complex inter-agent interactions complicate the task. While…

Machine Learning · Computer Science 2025-02-03 The Viet Bui , Tien Mai , Hong Thanh Nguyen

Multiagent reinforcement learning (MARL) can solve complex cooperative tasks. However, the efficiency of existing MARL methods relies heavily on well-defined reward functions. Multiagent tasks with sparse reward feedback are especially…

Artificial Intelligence · Computer Science 2022-08-08 Qingxu Fu , Tenghai Qiu , Zhiqiang Pu , Jianqiang Yi , Wanmai Yuan