English
Related papers

Related papers: Learning Explicit Credit Assignment for Cooperativ…

200 papers

Scaling cooperative multi-agent reinforcement learning (MARL) is fundamentally limited by cross-agent noise. When agents share a common reward, each agent's learning signal is computed from a shared return that depends on all agents, so the…

Multiagent Systems · Computer Science 2026-05-06 Shan Yang , Yang Liu

In multi-agent reinforcement learning, discovering successful collective behaviors is challenging as it requires exploring a joint action space that grows exponentially with the number of agents. While the tractability of independent…

Machine Learning · Computer Science 2020-11-10 Julien Roy , Paul Barde , Félix G. Harvey , Derek Nowrouzezahrai , Christopher Pal

In this paper, we propose a novel benchmark called the StarCraft Multi-Agent Challenges+, where agents learn to perform multi-stage tasks and to use environmental factors without precise reward functions. The previous challenges (SMAC)…

Machine Learning · Computer Science 2022-07-08 Mingyu Kim , Jihwan Oh , Yongsik Lee , Joonkee Kim , Seonghwan Kim , Song Chong , Se-Young Yun

We study policy optimization for Markov decision processes (MDPs) with multiple reward value functions, which are to be jointly optimized according to given criteria such as proportional fairness (smooth concave scalarization), hard…

Machine Learning · Computer Science 2022-10-19 Ruida Zhou , Tao Liu , Dileep Kalathil , P. R. Kumar , Chao Tian

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

Multiagent Systems · Computer Science 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

Multi-agent reinforcement learning has been successfully applied to fully-cooperative and fully-competitive environments, but little is currently known about mixed cooperative/competitive environments. In this paper, we focus on a…

Machine Learning · Computer Science 2021-10-22 Roy Fox , Stephen McAleer , Will Overman , Ioannis Panageas

Policy gradient methods are among the most effective methods in challenging reinforcement learning problems with large state and/or action spaces. However, little is known about even their most basic theoretical convergence properties,…

Machine Learning · Computer Science 2020-10-16 Alekh Agarwal , Sham M. Kakade , Jason D. Lee , Gaurav Mahajan

Adapting a single agent to a new multi-agent system brings challenges, necessitating adjustments across various tasks, environments, and interactions with unknown teammates and opponents. Addressing this challenge is highly complex, and…

Multiagent Systems · Computer Science 2025-06-23 Chenxu Wang , Yonggang Jin , Cheng Hu , Youpeng Zhao , Zipeng Dai , Jian Zhao , Shiyu Huang , Liuyu Xiang , Junge Zhang , Zhaofeng He

Recent technological progress in the development of Unmanned Aerial Vehicles (UAVs) together with decreasing acquisition costs make the application of drone fleets attractive for a wide variety of tasks. In agriculture, disaster management,…

Robotics · Computer Science 2024-10-30 Yoav Alon , Huiyu Zhou

In cooperative multi-agent systems, agents jointly take actions and receive a team reward instead of individual rewards. In the absence of individual reward signals, credit assignment mechanisms are usually introduced to discriminate the…

Artificial Intelligence · Computer Science 2022-02-17 Jian Zhao , Yue Zhang , Xunhan Hu , Weixun Wang , Wengang Zhou , Jianye Hao , Jiangcheng Zhu , Houqiang Li

Memory systems are critical for LLMs, mitigating context window limitations and supporting long-horizon user-LLM interactions. Such systems typically comprise multiple agents responsible for memory construction and retrieval. Existing…

Multiagent Systems · Computer Science 2026-04-28 Wenyu Mao , Haoyang Liu , Haosong Tan , Yaorui Shi , Jiancan Wu , An Zhang , Xiang Wang

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

This paper proposes the Cooperative Soft Actor Critic (CSAC) method of enabling consecutive reinforcement learning agents to cooperatively solve a long time horizon multi-stage task. This method is achieved by modifying the policy of each…

Machine Learning · Computer Science 2020-07-02 Jordan Erskine , Chris Lehnert

Learning to collaborate is critical in Multi-Agent Reinforcement Learning (MARL). Previous works promote collaboration by maximizing the correlation of agents' behaviors, which is typically characterized by Mutual Information (MI) in…

Multiagent Systems · Computer Science 2023-02-23 Pengyi Li , Hongyao Tang , Tianpei Yang , Xiaotian Hao , Tong Sang , Yan Zheng , Jianye Hao , Matthew E. Taylor , Wenyuan Tao , Zhen Wang , Fazl Barez

Proximal Policy Optimization (PPO) is a ubiquitous on-policy reinforcement learning algorithm but is significantly less utilized than off-policy learning algorithms in multi-agent settings. This is often due to the belief that PPO is…

Machine Learning · Computer Science 2022-11-07 Chao Yu , Akash Velu , Eugene Vinitsky , Jiaxuan Gao , Yu Wang , Alexandre Bayen , Yi Wu

Multi-agent reinforcement learning (MARL) faces significant challenges in task sequencing and curriculum design, particularly for cooperative coordination scenarios. While curriculum learning has demonstrated success in single-agent…

Multiagent Systems · Computer Science 2025-07-10 Farhaan Ebadulla , Dharini Hindlatti , Srinivaasan NS , Apoorva VH , Ayman Aftab

The state-of-the-art multi-agent reinforcement learning (MARL) methods have provided promising solutions to a variety of complex problems. Yet, these methods all assume that agents perform synchronized primitive-action executions so that…

Artificial Intelligence · Computer Science 2022-10-12 Yuchen Xiao

In this paper, we propose a new mutual information framework for multi-agent reinforcement learning to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the simultaneous mutual information…

Multiagent Systems · Computer Science 2023-03-02 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung