English
Related papers

Related papers: Shapley Counterfactual Credits for Multi-Agent Rei…

200 papers

In this paper, a novel Multi-agent Reinforcement Learning (MARL) approach, Multi-Agent Continuous Dynamic Policy Gradient (MACDPP) was proposed to tackle the issues of limited capability and sample efficiency in various scenarios controlled…

Systems and Control · Electrical Eng. & Systems 2023-09-27 Chenyang Miao , Yunduan Cui , Huiyun Li , Xinyu Wu

Reinforcement learning has achieved remarkable success in complex decision-making environments, yet its lack of transparency limits its deployment in practice, especially in safety-critical settings. Shapley values from cooperative game…

Machine Learning · Computer Science 2025-11-11 Daniel Beechey , Özgür Şimşek

Multi-agent reinforcement learning (MARL) has witnessed significant progress with the development of value function factorization methods. It allows optimizing a joint action-value function through the maximization of factorized per-agent…

Multiagent Systems · Computer Science 2023-05-05 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Credit assignment remains a fundamental challenge in multi agent reinforcement learning (MARL) and is commonly addressed through value decomposition under the centralized training with decentralized ex ecution (CTDE) paradigm. However,…

Multiagent Systems · Computer Science 2026-03-17 Yuanjun Li , Zhouyang Jiang , Bin Zhang , Mingchao Zhang , Junhao Zhao , Zhiwei Xu

Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical challenge. Prior work…

Computer Science and Game Theory · Computer Science 2025-10-16 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

Machine Learning · Computer Science 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

Agentic workflows have become the dominant paradigm for building complex AI systems, orchestrating specialized components, such as planning, reasoning, action execution, and reflection, to tackle sophisticated real-world tasks. However,…

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

Machine Learning · Computer Science 2026-01-30 Bang Giang Le , Viet Cuong Ta

Open multi-agent systems are increasingly important in modeling real-world applications, such as smart grids, swarm robotics, etc. In this paper, we aim to investigate a recently proposed problem for open multi-agent systems, referred to as…

Multiagent Systems · Computer Science 2025-06-16 Jianhong Wang , Yang Li , Samuel Kaski , Jonathan Lawry

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

Multiagent Systems · Computer Science 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

While autonomous vehicles (AVs) may perform remarkably well in generic real-life cases, their irrational action in some unforeseen cases leads to critical safety concerns. This paper introduces the concept of collaborative reinforcement…

Machine Learning · Computer Science 2023-05-31 Utku Ayvaz , Chih-Hong Cheng , Hao Shen

Federated learning (FL) has emerged as a pivotal approach in machine learning, enabling multiple participants to collaboratively train a global model without sharing raw data. While FL finds applications in various domains such as…

Machine Learning · Computer Science 2024-06-04 Nurbek Tastan , Samar Fares , Toluwani Aremu , Samuel Horvath , Karthik Nandakumar

Multi-agent credit assignment is a fundamental challenge for cooperative multi-agent reinforcement learning (MARL), where a team of agents learn from shared reward signals. The Individual-Global-Max (IGM) condition is a widely used…

Machine Learning · Computer Science 2026-02-04 Wen-Tse Chen , Yuxuan Li , Shiyu Huang , Jiayu Chen , Jeff Schneider

This paper investigates the impact of mechanism design on collaborative learning systems enabled by federated learning (FL). We propose a multi-action collaborative federated learning (MCFL) framework, capturing the interplay between agent…

Computer Science and Game Theory · Computer Science 2026-03-24 Meng Qi , Mingxi Zhu

Removing an agent from a cooperative team to measure its contribution seems natural, yet in multi-agent LLM systems this evaluation distorts the result it claims to measure. This failure is not isolated: learned critics, trajectory-level…

Machine Learning · Computer Science 2026-05-11 Yanjun Chen , Yirong Sun , Hanlin Wang , Jinghan Wang , Xinming Zhang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Given an unexpected change in the output metric of a large-scale system, it is important to answer why the change occurred: which inputs caused the change in metric? A key component of such an attribution question is estimating the…

Machine Learning · Computer Science 2022-08-18 Amit Sharma , Hua Li , Jian Jiao

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution (CTDE), where centralized critics leverage global information to guide decentralized actors. However,…

Machine Learning · Computer Science 2025-11-27 Yan Wang , Ke Deng , Yongli Ren

In recent years, reinforcement learning has faced several challenges in the multi-agent domain, such as the credit assignment issue. Value function factorization emerges as a promising way to handle the credit assignment issue under the…

Machine Learning · Computer Science 2022-06-06 Hao Chen , Guangkai Yang , Junge Zhang , Qiyue Yin , Kaiqi Huang

Federated learning offers a privacy-friendly collaborative learning framework, yet its success, like any joint venture, hinges on the contributions of its participants. Existing client evaluation methods predominantly focus on model…

Machine Learning · Computer Science 2026-02-27 Balazs Pejo