English
Related papers

Related papers: Energy-based Surprise Minimization for Multi-Agent…

200 papers

Non-stationarity poses a fundamental challenge in Multi-Agent Reinforcement Learning (MARL), arising from agents simultaneously learning and altering their policies. This creates a non-stationary environment from the perspective of each…

Robotics · Computer Science 2024-10-22 Jianye Xu , Omar Sobhy , Bassam Alrifaee

Deep Multi-agent Reinforcement Learning (MARL) relies on neural networks with numerous parameters in multi-agent scenarios, often incurring substantial computational overhead. Consequently, there is an urgent need to expedite training and…

Machine Learning · Computer Science 2024-10-01 Pihe Hu , Shaolong Li , Zhuoran Li , Ling Pan , Longbo Huang

Multi-agent reinforcement learning (MARL) has been shown effective for cooperative games in recent years. However, existing state-of-the-art methods face challenges related to sample complexity, training instability, and the risk of…

Multiagent Systems · Computer Science 2025-03-14 Jiarong Liu , Yifan Zhong , Siyi Hu , Haobo Fu , Qiang Fu , Xiaojun Chang , Yaodong Yang

Cell-free (CF) massive multiple-input multiple-output (mMIMO) and reconfigurable intelligent surface (RIS) are two advanced transceiver technologies for realizing future sixth-generation (6G) networks. In this paper, we investigate the…

Information Theory · Computer Science 2024-11-19 Enyu Shi , Jiayi Zhang , Ziheng Liu , Yiyang Zhu , Chau Yuen , Derrick Wing Kwan Ng , Marco Di Renzo , Bo Ai

This paper proposes an exploration technique for multi-agent reinforcement learning (MARL) with graph-based communication among agents. We assume the individual rewards received by the agents are independent of the actions by the other…

Machine Learning · Computer Science 2025-08-11 Ainur Zhaikhan , Ali H. Sayed

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective credit assignment…

Artificial Intelligence · Computer Science 2021-09-23 Roy Zohar , Shie Mannor , Guy Tennenholtz

Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three…

Machine Learning · Computer Science 2021-11-10 Georgios Papoudakis , Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

In cooperative multi-agent reinforcement learning (MARL), the environmental stochasticity and uncertainties will increase exponentially when the number of agents increases, which puts hard pressure on how to come up with a compact latent…

Multiagent Systems · Computer Science 2023-05-15 Qingpeng Zhao , Yuanyang Zhu , Zichuan Liu , Zhi Wang , Chunlin Chen

In human society, the conflict between self-interest and collective well-being often obstructs efforts to achieve shared welfare. Related concepts like the Tragedy of the Commons and Social Dilemmas frequently manifest in our daily lives.…

Multiagent Systems · Computer Science 2025-06-17 Yue Jin , Shuangqing Wei , Giovanni Montana

Cell-free (CF) massive multiple-input multiple-output (mMIMO) systems offer high spectral efficiency (SE) through multiple distributed access points (APs). However, the large number of antennas increases power consumption. We propose…

Information Theory · Computer Science 2025-02-28 Yiyang Zhu , Jiayi Zhang , Enyu Shi , Ziheng Liu , Chau Yuen , Bo Ai

Many complex real-world problems, such as climate change mitigation, are intertwined with human social factors. Climate change mitigation, a social dilemma made difficult by the inherent complexities of human behavior, has an impact at a…

Multiagent Systems · Computer Science 2020-02-13 Kyle Tilbury , Jesse Hoey

Centralized training is widely utilized in the field of multi-agent reinforcement learning (MARL) to assure the stability of training process. Once a joint policy is obtained, it is critical to design a value function factorization method…

Artificial Intelligence · Computer Science 2023-11-02 Rizhong Wang , Huiping Li , Di Cui , Demin Xu

Multi-agent reinforcement learning methods such as VDN, QMIX, and QTRAN that adopt centralized training with decentralized execution (CTDE) framework have shown promising results in cooperation and competition. However, in some multi-agent…

Multiagent Systems · Computer Science 2022-03-29 Jiajun Chai , Weifan Li , Yuanheng Zhu , Dongbin Zhao , Zhe Ma , Kewu Sun , Jishiyu Ding

Mutual Information between agent Actions and environment States (MIAS) quantifies the influence of agent on its environment. Recently, it was found that the maximization of MIAS can be used as an intrinsic motivation for artificial agents.…

Machine Learning · Computer Science 2020-08-04 Ruihan Zhao , Stas Tiomkin , Pieter Abbeel

While achieving tremendous success in various fields, existing multi-agent reinforcement learning (MARL) with a black-box neural network makes decisions in an opaque manner that hinders humans from understanding the learned knowledge and…

Machine Learning · Computer Science 2025-03-05 Zichuan Liu , Yuanyang Zhu , Zhi Wang , Yang Gao , Chunlin Chen

Multi-agent credit assignment is a fundamental challenge for cooperative multi-agent reinforcement learning (MARL), where a team of agents learn from shared reward signals. The Individual-Global-Max (IGM) condition is a widely used…

Machine Learning · Computer Science 2026-02-04 Wen-Tse Chen , Yuxuan Li , Shiyu Huang , Jiayu Chen , Jeff Schneider

Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by…

Machine Learning · Computer Science 2022-02-01 Weichao Mao , Lin F. Yang , Kaiqing Zhang , Tamer Başar

Protecting endangered wildlife from illegal poaching presents a critical challenge, particularly in vast and partially observable environments where real-time response is essential. This paper introduces a novel Expectation-Maximization…

Machine Learning · Computer Science 2025-10-13 Mazyar Taghavi , Rahman Farnoosh

Multi-agent reinforcement learning (MARL) has been gaining extensive attention from academia and industries in the past few decades. One of the fundamental problems in MARL is how to evaluate different approaches comprehensively. Most…

Multiagent Systems · Computer Science 2022-06-22 Zhiuxan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Jinlin Chen , Huafeng Xu