English
Related papers

Related papers: How Exploration Breaks Cooperation in Shared-Polic…

200 papers

Multi-Agent Reinforcement Learning (MARL) has gained significant interest in recent years, enabling sequential decision-making across multiple agents in various domains. However, most existing explanation methods focus on centralized MARL,…

Artificial Intelligence · Computer Science 2025-11-14 Kayla Boggess , Sarit Kraus , Lu Feng

Multiagent reinforcement learning (MARL) has attracted considerable attention due to its potential in addressing complex cooperative tasks. However, existing MARL approaches often rely on frequent exchanges of action or state information…

Machine Learning · Computer Science 2026-01-14 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu , Ke Pan

We propose a unified mechanism for achieving coordination and communication in Multi-Agent Reinforcement Learning (MARL), through rewarding agents for having causal influence over other agents' actions. Causal influence is assessed using…

Recently, deep multiagent reinforcement learning (MARL) has become a highly active research area as many real-world problems can be inherently viewed as multiagent systems. A particularly interesting and widely applicable class of problems…

Multiagent Systems · Computer Science 2020-02-11 Yaodong Yang , Jianye Hao , Guangyong Chen , Hongyao Tang , Yingfeng Chen , Yujing Hu , Changjie Fan , Zhongyu Wei

Multi-Agent Reinforcement Learning (MARL) approaches have emerged as popular solutions to address the general challenges of cooperation in multi-agent environments, where the success of achieving shared or individual goals critically…

Multiagent Systems · Computer Science 2024-12-31 Reza Azadeh

Recent works have proven that intricate cooperative behaviors can emerge in agents trained using meta reinforcement learning on open ended task distributions using self-play. While the results are impressive, we argue that self-play and…

Multiagent Systems · Computer Science 2024-05-08 Richard Bornemann , Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

Parameter sharing, as an important technique in multi-agent systems, can effectively solve the scalability issue in large-scale agent problems. However, the effectiveness of parameter sharing largely depends on the environment setting. When…

Artificial Intelligence · Computer Science 2025-03-04 Dapeng Li , Na Lou , Bin Zhang , Zhiwei Xu , Guoliang Fan

The majority of Multi-Agent Reinforcement Learning (MARL) literature equates the cooperation of self-interested agents in mixed environments to the problem of social welfare maximization, allowing agents to arbitrarily share rewards and…

Multiagent Systems · Computer Science 2023-06-16 Dmitry Ivanov , Ilya Zisman , Kirill Chernyshev

Parameter sharing is a key strategy in multi-agent reinforcement learning (MARL) for improving scalability, yet conventional fully shared architectures often collapse into homogeneous behaviors. Recent methods introduce diversity through…

Multiagent Systems · Computer Science 2026-02-09 Kyungbeom Kim , Seungwon Oh , Kyung-Joong Kim

This paper studies a class of multi-agent reinforcement learning (MARL) problems where the reward that an agent receives depends on the states of other agents, but the next state only depends on the agent's own current state and action. We…

Multiagent Systems · Computer Science 2023-05-16 Xin Liu , Honghao Wei , Lei Ying

Exploration-exploitation is a powerful and practical tool in multi-agent learning (MAL), however, its effects are far from understood. To make progress in this direction, we study a smooth analogue of Q-learning. We start by showing that…

Computer Science and Game Theory · Computer Science 2020-12-16 Stefanos Leonardos , Georgios Piliouras

Cooperative multi-agent reinforcement learning (MARL) has made prominent progress in recent years. For training efficiency and scalability, most of the MARL algorithms make all agents share the same policy or value network. However, in many…

Machine Learning · Computer Science 2022-11-07 Mingyu Yang , Jian Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

Multiagent Systems · Computer Science 2025-10-14 Shahbaz P Qadri Syed , He Bai

Training a multi-agent reinforcement learning (MARL) algorithm is more challenging than training a single-agent reinforcement learning algorithm, because the result of a multi-agent task strongly depends on the complex interactions among…

Machine Learning · Computer Science 2021-01-19 Heechang Ryu , Hayong Shin , Jinkyoo Park

Humanity faces numerous problems of common-pool resource appropriation. This class of multi-agent social dilemma includes the problems of ensuring sustainable use of fresh water, common fisheries, grazing pastures, and irrigation systems.…

Multiagent Systems · Computer Science 2017-09-07 Julien Perolat , Joel Z. Leibo , Vinicius Zambaldi , Charles Beattie , Karl Tuyls , Thore Graepel

Multi-agent Reinforcement Learning (MARL) has gained wide attention in recent years and has made progress in various fields. Specifically, cooperative MARL focuses on training a team of agents to cooperatively achieve tasks that are…

Multiagent Systems · Computer Science 2023-12-05 Lei Yuan , Ziqian Zhang , Lihe Li , Cong Guan , Yang Yu

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof

In order to collaborate efficiently with unknown partners in cooperative control settings, adaptation of the partners based on online experience is required. The rather general and widely applicable control setting, where each cooperation…

Multiagent Systems · Computer Science 2019-10-30 Florian Köpf , Samuel Tesfazgi , Michael Flad , Sören Hohmann

Autonomous cyber and cyber-physical systems need to perform decision-making, learning, and control in unknown environments. Such decision-making can be sensitive to multiple factors, including modeling errors, changes in costs, and impacts…

Artificial Intelligence · Computer Science 2023-04-05 Abdullah Al Maruf , Luyao Niu , Bhaskar Ramasubramanian , Andrew Clark , Radha Poovendran