English
Related papers

Related papers: Shapley Counterfactual Credits for Multi-Agent Rei…

200 papers

This paper focuses on the fundamental challenge of partitioning input variables in attribution methods for Explainable AI, particularly in Shapley value-based approaches. Previous methods always compute attributions given a predefined…

Machine Learning · Computer Science 2026-02-25 Xinhao Zheng , Huiqi Deng , Quanshi Zhang

Learning to communicate in order to share state information is an active problem in the area of multi-agent reinforcement learning (MARL). The credit assignment problem, the non-stationarity of the communication environment and the creation…

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

Machine Learning · Computer Science 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

Multi-agent reinforcement learning (MARL) has emerged as a promising paradigm for adaptive traffic signal control (ATSC) of multiple intersections. Existing approaches typically follow either a fully centralized or a fully decentralized…

Multiagent Systems · Computer Science 2026-03-31 Arash Rezaali , Pouria Yazdani , Monireh Abdoos

The temporal credit assignment problem is a central challenge in Reinforcement Learning (RL), concerned with attributing the appropriate influence to each actions in a trajectory for their ability to achieve a goal. However, when feedback…

Machine Learning · Computer Science 2024-09-20 Eduardo Pignatelli , Johan Ferret , Tim Rockäschel , Edward Grefenstette , Davide Paglieri , Samuel Coward , Laura Toni

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

Multiagent Systems · Computer Science 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

In collaborative machine learning (CML), data valuation, i.e., evaluating the contribution of each client's data to the machine learning model, has become a critical task for incentivizing and selecting positive data contributions. However,…

Cryptography and Security · Computer Science 2025-05-27 Shuyuan Zheng , Sudong Cai , Chuan Xiao , Yang Cao , Jianbin Qin , Masatoshi Yoshikawa , Makoto Onizuka

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

In cooperative multi-agent reinforcement learning (c-MARL), agents learn to cooperatively take actions as a team to maximize a total team reward. We analyze the robustness of c-MARL to adversaries capable of attacking one of the agents on a…

Machine Learning · Computer Science 2020-03-10 Jieyu Lin , Kristina Dzeparoska , Sai Qian Zhang , Alberto Leon-Garcia , Nicolas Papernot

Traditional multi-agent reinforcement learning (MARL) algorithms, such as independent Q-learning, struggle when presented with partially observable scenarios, and where agents are required to develop delicate action sequences. This is often…

Machine Learning · Computer Science 2022-11-21 F. Bredell , H. A. Engelbrecht , J. C. Schoeman

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize…

Machine Learning · Computer Science 2019-10-22 Nicolas Carion , Gabriel Synnaeve , Alessandro Lazaric , Nicolas Usunier

Despite substantial progress in applying neural networks (NN) to multi-agent reinforcement learning (MARL) areas, they still largely suffer from a lack of transparency and interoperability. However, its implicit cooperative mechanism is not…

Artificial Intelligence · Computer Science 2025-07-29 Zhonghan Ge , Yuanyang Zhu , Chunlin Chen

Centralized Training with Decentralized Execution (CTDE) has emerged as a widely adopted paradigm in multi-agent reinforcement learning, emphasizing the utilization of global information for learning an enhanced joint $Q$-function or…

Artificial Intelligence · Computer Science 2024-04-23 Yiqun Chen , Hangyu Mao , Jiaxin Mao , Shiguang Wu , Tianle Zhang , Bin Zhang , Wei Yang , Hongxing Chang

In this work, we propose a multi-agent actor-critic reinforcement learning (RL) algorithm to accelerate the multi-level Monte Carlo Markov Chain (MCMC) sampling algorithms. The policies (actors) of the agents are used to generate the…

Machine Learning · Computer Science 2020-11-19 Eric Chung , Yalchin Efendiev , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

Federated learning (FL) is a collaborative and privacy-preserving Machine Learning paradigm, allowing the development of robust models without the need to centralize sensitive data. A critical challenge in FL lies in fairly and accurately…

Machine Learning · Computer Science 2025-12-04 Arno Geimer , Beltran Fiz , Radu State

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

Machine Learning · Statistics 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal