中文
相关论文

相关论文: Shapley Counterfactual Credits for Multi-Agent Rei…

200 篇论文

The Centralized Training with Decentralized Execution (CTDE) paradigm has gained significant attention in multi-agent reinforcement learning (MARL) and is the foundation of many recent algorithms. However, decentralized policies operate…

多智能体系统 · 计算机科学 2025-08-19 Zhuofan Xu , Benedikt Bollig , Matthias Függer , Thomas Nowak , Vincent Le Dréau

One of the preeminent obstacles to scaling multi-agent reinforcement learning to large numbers of agents is assigning credit to individual agents' actions. In this paper, we address this credit assignment problem with an approach that we…

机器学习 · 计算机科学 2021-12-24 Benjamin Freed , Aditya Kapoor , Ian Abraham , Jeff Schneider , Howie Choset

Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. Many approaches have been developed but they can be divided into three main types: centralized training and execution (CTE), centralized training for…

机器学习 · 计算机科学 2024-12-22 Christopher Amato

Reinforcement Learning from Human Feedback (RLHF) is a widely used technique for aligning Large Language Models (LLMs) with human preferences, yet it often suffers from sparse reward signals, making effective credit assignment challenging.…

人工智能 · 计算机科学 2025-05-28 Meng Cao , Shuyuan Zhang , Xiao-Wen Chang , Doina Precup

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

多智能体系统 · 计算机科学 2025-10-14 Shahbaz P Qadri Syed , He Bai

Existing value-factorized based Multi-Agent deep Reinforce-ment Learning (MARL) approaches are well-performing invarious multi-agent cooperative environment under thecen-tralized training and decentralized execution(CTDE) scheme,where all…

人工智能 · 计算机科学 2019-11-19 Runsheng Yu , Zhenyu Shi , Xinrun Wang , Rundong Wang , Buhong Liu , Xinwen Hou , Hanjiang Lai , Bo An

Centralized Training with Decentralized Execution (CTDE) has recently emerged as a popular framework for cooperative Multi-Agent Reinforcement Learning (MARL), where agents can use additional global state information to guide training in a…

人工智能 · 计算机科学 2025-05-14 Yihe Zhou , Shunyu Liu , Yunpeng Qing , Kaixuan Chen , Tongya Zheng , Jie Song , Mingli Song

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

机器学习 · 计算机科学 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Cooperative multi-agent policy gradient (MAPG) algorithms have recently attracted wide attention and are regarded as a general scheme for the multi-agent system. Credit assignment plays an important role in MAPG and can induce cooperation…

机器学习 · 计算机科学 2023-03-07 Wubing Chen , Wenbin Li , Xiao Liu , Shangdong Yang , Yang Gao

For reinforcement learning systems to be widely adopted, their users must understand and trust them. We present a theoretical analysis of explaining reinforcement learning using Shapley values, following a principled approach from game…

机器学习 · 计算机科学 2023-06-12 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

综合数学 · 数学 2025-11-25 Mazyar Taghavi , Javad Vahidi

Credit assignmen, disentangling each agent's contribution to a shared reward, is a critical challenge in cooperative multi-agent reinforcement learning (MARL). To be effective, credit assignment methods must preserve the environment's…

多智能体系统 · 计算机科学 2025-10-30 Aditya Kapoor , Kale-ab Tessera , Mayank Baranwal , Harshad Khadilkar , Jan Peters , Stefano Albrecht , Mingfei Sun

Value Decomposition (VD) aims to deduce the contributions of agents for decentralized policies in the presence of only global rewards, and has recently emerged as a powerful credit assignment paradigm for tackling cooperative Multi-Agent…

机器学习 · 计算机科学 2023-03-15 Shunyu Liu , Yihe Zhou , Jie Song , Tongya Zheng , Kaixuan Chen , Tongtian Zhu , Zunlei Feng , Mingli Song

Credit assignment in reinforcement learning is the problem of measuring an action's influence on future rewards. In particular, this requires separating skill from luck, i.e. disentangling the effect of an action on rewards from that of…

Much work has been dedicated to the exploration of Multi-Agent Reinforcement Learning (MARL) paradigms implementing a centralized learning with decentralized execution (CLDE) approach to achieve human-like collaboration in cooperative…

多智能体系统 · 计算机科学 2023-07-26 Piyush K. Sharma , Rolando Fernandez , Erin Zaroukian , Michael Dorothy , Anjon Basak , Derrik E. Asher

Due to the partial observability and communication constraints in many multi-agent reinforcement learning (MARL) tasks, centralized training with decentralized execution (CTDE) has become one of the most widely used MARL paradigms. In CTDE,…

多智能体系统 · 计算机科学 2022-03-17 Jian Zhao , Xunhan Hu , Mingyu Yang , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Reinforcement learning agents can achieve super-human performance in complex decision-making tasks, but their behaviour is often difficult to understand and explain. This lack of explanation limits deployment, especially in safety-critical…

机器学习 · 计算机科学 2025-08-01 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Blame attribution is one of the key aspects of accountable decision making, as it provides means to quantify the responsibility of an agent for a decision making outcome. In this paper, we study blame attribution in the context of…

人工智能 · 计算机科学 2022-01-26 Stelios Triantafyllou , Adish Singla , Goran Radanovic

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

多智能体系统 · 计算机科学 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Real-world cooperation often requires intensive coordination among agents simultaneously. This task has been extensively studied within the framework of cooperative multi-agent reinforcement learning (MARL), and value decomposition methods…

机器人学 · 计算机科学 2023-02-15 Shanqi Liu , Yujing Hu , Runze Wu , Dong Xing , Yu Xiong , Changjie Fan , Kun Kuang , Yong Liu