中文
相关论文

相关论文: Shapley Counterfactual Credits for Multi-Agent Rei…

200 篇论文

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

机器学习 · 计算机科学 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Multi-agent settings remain a fundamental challenge in the reinforcement learning (RL) domain due to the partial observability and the lack of accurate real-time interactions across agents. In this paper, we propose a new method based on…

机器学习 · 计算机科学 2023-01-03 Donghan Xie , Zhi Wang , Chunlin Chen , Daoyi Dong

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

机器学习 · 计算机科学 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

The StarCraft II Multi-Agent Challenge (SMAC) was created to be a challenging benchmark problem for cooperative multi-agent reinforcement learning (MARL). SMAC focuses exclusively on the problem of StarCraft micromanagement and assumes that…

多智能体系统 · 计算机科学 2022-08-16 Muhammad Junaid Khan , Syed Hammad Ahmed , Gita Sukthankar

Shapley value is a popular approach for measuring the influence of individual features. While Shapley feature attribution is built upon desiderata from game theory, some of its constraints may be less natural in certain machine learning…

机器学习 · 计算机科学 2022-09-28 Yongchan Kwon , James Zou

Adequately assigning credit to actions for future outcomes based on their contributions is a long-standing open challenge in Reinforcement Learning. The assumptions of the most commonly used credit assignment method are disadvantageous in…

机器学习 · 计算机科学 2023-05-18 Mátyás Schubert

Shapley values are great analytical tools in game theory to measure the importance of a player in a game. Due to their axiomatic and desirable properties such as efficiency, they have become popular for feature importance analysis in data…

机器学习 · 计算机科学 2020-10-26 Ramin Okhrati , Aldo Lipani

Learning a stable and generalizable centralized value function (CVF) is a crucial but challenging task in multi-agent reinforcement learning (MARL), as it has to deal with the issue that the joint action space increases exponentially with…

多智能体系统 · 计算机科学 2020-08-11 Xinghu Yao , Chao Wen , Yuhui Wang , Xiaoyang Tan

Multi-agent reinforcement learning (MARL) faces significant challenges in task sequencing and curriculum design, particularly for cooperative coordination scenarios. While curriculum learning has demonstrated success in single-agent…

多智能体系统 · 计算机科学 2025-07-10 Farhaan Ebadulla , Dharini Hindlatti , Srinivaasan NS , Apoorva VH , Ayman Aftab

Deep reinforcement learning (RL) has recently shown great promise in robotic continuous control tasks. Nevertheless, prior research in this vein center around the centralized learning setting that largely relies on the communication…

人工智能 · 计算机科学 2021-12-30 Dongge Han , Chris Xiaoxuan Lu , Tomasz Michalak , Michael Wooldridge

Multi-agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single-agent case, multi-agent problems are often harder to train and analyze…

机器学习 · 计算机科学 2024-04-04 Michał Zawalski , Błażej Osiński , Henryk Michalewski , Piotr Miłoś

Centralized training with decentralized execution (CTDE) is a standard framework for cooperative multi-agent policy-gradient reinforcement learning, allowing agents to learn from joint information while acting from local observations.…

In user-agent interaction scenarios such as recommendation, brainstorming, and code suggestion, Large Language Models (LLMs) often generate sets of candidate recommendations where the objective is to maximize the collective utility of the…

人工智能 · 计算机科学 2026-04-01 Rui Ai , Yu Pan , David Simchi-Levi , Chonghuan Wang

Inferring reward functions from demonstrations is a key challenge in reinforcement learning (RL), particularly in multi-agent RL (MARL), where large joint state-action spaces and complex inter-agent interactions complicate the task. While…

机器学习 · 计算机科学 2025-02-03 The Viet Bui , Tien Mai , Hong Thanh Nguyen

Cooperative game theory methods, notably Shapley values, have significantly enhanced machine learning (ML) interpretability. However, existing explainable AI (XAI) frameworks mainly attribute average model predictions, overlooking…

人工智能 · 计算机科学 2025-05-20 Marouane Il Idrissi , Agathe Fernandes Machado , Ewen Gallic , Arthur Charpentier

Centralized Training for Decentralized Execution where agents are trained offline in a centralized fashion and execute online in a decentralized manner, has become a popular approach in Multi-Agent Reinforcement Learning (MARL). In…

人工智能 · 计算机科学 2024-08-28 Xueguang Lyu , Andrea Baisero , Yuchen Xiao , Brett Daley , Christopher Amato

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective credit assignment…

人工智能 · 计算机科学 2021-09-23 Roy Zohar , Shie Mannor , Guy Tennenholtz

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool…

机器学习 · 计算机科学 2025-11-21 Haifeng Sun , Yu Xiong , Runze Wu , Xinyu Cai , Changjie Fan , Lan Zhang , Xiang-Yang Li

Counterfactual analysis is central to education market design and provides a foundation for credible policy recommendations. We develop a novel methodology for counterfactual analysis in Gale-Shapley deferred-acceptance (DA) assignment…

计量经济学 · 经济学 2025-12-10 Lixiong Li , Ismaël Mourifié

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

机器学习 · 计算机科学 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel