English
Related papers

Related papers: Learning to Communicate Using Counterfactual Reaso…

200 papers

By enabling agents to communicate, recent cooperative multi-agent reinforcement learning (MARL) methods have demonstrated better task performance and more coordinated behavior. Most existing approaches facilitate inter-agent communication…

Artificial Intelligence · Computer Science 2023-03-21 Yat Long Lo , Christian Schroeder de Witt , Samuel Sokota , Jakob Nicolaus Foerster , Shimon Whiteson

Large language model (LLM) agents struggle to autonomously evolve coordination strategies in dynamic environments, largely because coarse global outcomes obscure the causal signals needed for local policy refinement. We identify this…

Computation and Language · Computer Science 2026-04-02 Huaiyuan Yao , Longchao Da , Xiaoou Liu , Charles Fleming , Tianlong Chen , Hua Wei

Multi-agent reinforcement learning (MARL) has attracted much research attention recently. However, unlike its single-agent counterpart, many theoretical and algorithmic aspects of MARL have not been well-understood. In this paper, we study…

Machine Learning · Computer Science 2021-12-08 Siliang Zeng , Tianyi Chen , Alfredo Garcia , Mingyi Hong

Single-Agent (SA) Reinforcement Learning systems have shown outstanding re-sults on non-stationary problems. However, Multi-Agent Reinforcement Learning(MARL) can surpass SA systems generally and when scaling. Furthermore, MAsystems can be…

Artificial Intelligence · Computer Science 2021-12-16 Philipp Dominic Siedler

We consider the problem setting in which multiple autonomous agents must cooperatively navigate and perform tasks in an unknown, communication-constrained environment. Traditional multi-agent reinforcement learning (MARL) approaches assume…

Multiagent Systems · Computer Science 2026-05-20 Sydney Dolan , Siddharth Nayak , Jasmine Jerry Aloor , Hamsa Balakrishnan

Most real-world domains can be formulated as multi-agent (MA) systems. Intentionality sharing agents can solve more complex tasks by collaborating, possibly in less time. True cooperative actions are beneficial for egoistic and collective…

Artificial Intelligence · Computer Science 2022-04-26 Philipp Dominic Siedler

We propose a unified mechanism for achieving coordination and communication in Multi-Agent Reinforcement Learning (MARL), through rewarding agents for having causal influence over other agents' actions. Causal influence is assessed using…

Cooperative multi-agent systems can be naturally used to model many real world problems, such as network packet routing and the coordination of autonomous vehicles. There is a great need for new reinforcement learning methods that can…

Artificial Intelligence · Computer Science 2024-12-12 Jakob Foerster , Gregory Farquhar , Triantafyllos Afouras , Nantas Nardelli , Shimon Whiteson

Multi-Agent Path Finding (MAPF) is essential to large-scale robotic systems. Recent methods have applied reinforcement learning (RL) to learn decentralized polices in partially observable environments. A fundamental challenge of obtaining…

Robotics · Computer Science 2021-06-23 Ziyuan Ma , Yudong Luo , Hang Ma

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to…

Artificial Intelligence · Computer Science 2023-10-20 Baofu Fang , Caiming Zheng , Hao Wang

In Multi-Agent Reinforcement Learning (MARL), specialized channels are often introduced that allow agents to communicate directly with one another. In this paper, we propose an alternative approach whereby agents communicate through an…

Artificial Intelligence · Computer Science 2022-05-26 Dianbo Liu , Vedant Shah , Oussama Boussif , Cristian Meo , Anirudh Goyal , Tianmin Shu , Michael Mozer , Nicolas Heess , Yoshua Bengio

Traffic signal control (TSC) is a challenging problem within intelligent transportation systems and has been tackled using multi-agent reinforcement learning (MARL). While centralized approaches are often infeasible for large-scale TSC…

Multiagent Systems · Computer Science 2023-10-05 Rohit Bokade , Xiaoning Jin , Christopher Amato

We propose a new framework for multi-agent reinforcement learning (MARL), where the agents cooperate in a time-evolving network with latent community structures and mixed memberships. Unlike traditional neighbor-based or fixed interaction…

Machine Learning · Computer Science 2025-05-16 Zhaoyang Shi

A key challenge in multi-agent reinforcement learning (MARL) lies in designing learning signals that effectively promote coordination among agents. Designing such signals requires estimating how one agent's current action affects its…

Multiagent Systems · Computer Science 2026-05-12 Haohan Yu , Jinmiao Cong , Shengzhi Wang , Lu Wang , Chanjuan Liu

Computational models of emergent communication in agent populations are currently gaining interest in the machine learning community due to recent advances in Multi-Agent Reinforcement Learning (MARL). Current contributions are however…

Multiagent Systems · Computer Science 2020-10-28 Clément Moulin-Frier , Pierre-Yves Oudeyer

Nowadays, cooperative multi-agent systems are used to learn how to achieve goals in large-scale dynamic environments. However, learning in these environments is challenging: from the effect of search space size on learning time to…

Multiagent Systems · Computer Science 2022-01-19 Mahnoosh Mahdavimoghaddam , Amin Nikanjam , Monireh Abdoos

Communication can improve coordination in partially observed multi-agent reinforcement learning (MARL), but learning \emph{when} and \emph{who} to communicate with requires choosing among many possible sender-recipient pairs, and the effect…

Multiagent Systems · Computer Science 2026-03-06 Manav Vora , Gokul Puthumanaillam , Hiroyasu Tsukamoto , Melkior Ornik

Learning communication strategies in cooperative multi-agent reinforcement learning (MARL) has recently attracted intensive attention. Early studies typically assumed a fully-connected communication topology among agents, which induces high…

Multiagent Systems · Computer Science 2023-05-24 Xuefeng Wang , Xinran Li , Jiawei Shao , Jun Zhang

Collective human knowledge has clearly benefited from the fact that innovations by individuals are taught to others through communication. Similar to human social groups, agents in distributed learning systems would likely benefit from…

Humans face countless scenarios that require reasoning and judgment in daily life. However, existing large language model training methods primarily allow models to learn from existing textual content or solve predetermined problems,…

Artificial Intelligence · Computer Science 2026-01-27 Yin Cai , Zhouhong Gu , Juntao Zhang , Ping Chen