中文
相关论文

相关论文: Shapley Counterfactual Credits for Multi-Agent Rei…

200 篇论文

In this paper, a novel Multi-agent Reinforcement Learning (MARL) approach, Multi-Agent Continuous Dynamic Policy Gradient (MACDPP) was proposed to tackle the issues of limited capability and sample efficiency in various scenarios controlled…

系统与控制 · 电气工程与系统科学 2023-09-27 Chenyang Miao , Yunduan Cui , Huiyun Li , Xinyu Wu

Reinforcement learning has achieved remarkable success in complex decision-making environments, yet its lack of transparency limits its deployment in practice, especially in safety-critical settings. Shapley values from cooperative game…

机器学习 · 计算机科学 2025-11-11 Daniel Beechey , Özgür Şimşek

Multi-agent reinforcement learning (MARL) has witnessed significant progress with the development of value function factorization methods. It allows optimizing a joint action-value function through the maximization of factorized per-agent…

多智能体系统 · 计算机科学 2023-05-05 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Credit assignment remains a fundamental challenge in multi agent reinforcement learning (MARL) and is commonly addressed through value decomposition under the centralized training with decentralized ex ecution (CTDE) paradigm. However,…

多智能体系统 · 计算机科学 2026-03-17 Yuanjun Li , Zhouyang Jiang , Bin Zhang , Mingchao Zhang , Junhao Zhao , Zhiwei Xu

Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical challenge. Prior work…

计算机科学与博弈论 · 计算机科学 2025-10-16 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

人工智能 · 计算机科学 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

机器学习 · 计算机科学 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

Agentic workflows have become the dominant paradigm for building complex AI systems, orchestrating specialized components, such as planning, reasoning, action execution, and reflection, to tackle sophisticated real-world tasks. However,…

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

机器学习 · 计算机科学 2026-01-30 Bang Giang Le , Viet Cuong Ta

Open multi-agent systems are increasingly important in modeling real-world applications, such as smart grids, swarm robotics, etc. In this paper, we aim to investigate a recently proposed problem for open multi-agent systems, referred to as…

多智能体系统 · 计算机科学 2025-06-16 Jianhong Wang , Yang Li , Samuel Kaski , Jonathan Lawry

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

多智能体系统 · 计算机科学 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

While autonomous vehicles (AVs) may perform remarkably well in generic real-life cases, their irrational action in some unforeseen cases leads to critical safety concerns. This paper introduces the concept of collaborative reinforcement…

机器学习 · 计算机科学 2023-05-31 Utku Ayvaz , Chih-Hong Cheng , Hao Shen

Federated learning (FL) has emerged as a pivotal approach in machine learning, enabling multiple participants to collaboratively train a global model without sharing raw data. While FL finds applications in various domains such as…

机器学习 · 计算机科学 2024-06-04 Nurbek Tastan , Samar Fares , Toluwani Aremu , Samuel Horvath , Karthik Nandakumar

Multi-agent credit assignment is a fundamental challenge for cooperative multi-agent reinforcement learning (MARL), where a team of agents learn from shared reward signals. The Individual-Global-Max (IGM) condition is a widely used…

机器学习 · 计算机科学 2026-02-04 Wen-Tse Chen , Yuxuan Li , Shiyu Huang , Jiayu Chen , Jeff Schneider

This paper investigates the impact of mechanism design on collaborative learning systems enabled by federated learning (FL). We propose a multi-action collaborative federated learning (MCFL) framework, capturing the interplay between agent…

计算机科学与博弈论 · 计算机科学 2026-03-24 Meng Qi , Mingxi Zhu

Removing an agent from a cooperative team to measure its contribution seems natural, yet in multi-agent LLM systems this evaluation distorts the result it claims to measure. This failure is not isolated: learned critics, trajectory-level…

机器学习 · 计算机科学 2026-05-11 Yanjun Chen , Yirong Sun , Hanlin Wang , Jinghan Wang , Xinming Zhang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Given an unexpected change in the output metric of a large-scale system, it is important to answer why the change occurred: which inputs caused the change in metric? A key component of such an attribution question is estimating the…

机器学习 · 计算机科学 2022-08-18 Amit Sharma , Hua Li , Jian Jiao

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution (CTDE), where centralized critics leverage global information to guide decentralized actors. However,…

机器学习 · 计算机科学 2025-11-27 Yan Wang , Ke Deng , Yongli Ren

In recent years, reinforcement learning has faced several challenges in the multi-agent domain, such as the credit assignment issue. Value function factorization emerges as a promising way to handle the credit assignment issue under the…

机器学习 · 计算机科学 2022-06-06 Hao Chen , Guangkai Yang , Junge Zhang , Qiyue Yin , Kaiqi Huang

Federated learning offers a privacy-friendly collaborative learning framework, yet its success, like any joint venture, hinges on the contributions of its participants. Existing client evaluation methods predominantly focus on model…

机器学习 · 计算机科学 2026-02-27 Balazs Pejo