English
Related papers

Related papers: Discovering Causality for Efficient Cooperation in…

200 papers

Multiagent reinforcement learning (MARL) can solve complex cooperative tasks. However, the efficiency of existing MARL methods relies heavily on well-defined reward functions. Multiagent tasks with sparse reward feedback are especially…

Artificial Intelligence · Computer Science 2022-08-08 Qingxu Fu , Tenghai Qiu , Zhiqiang Pu , Jianqiang Yi , Wanmai Yuan

Autonomous operations of robots in unknown environments are challenging due to the lack of knowledge of the dynamics of the interactions, such as the objects' movability. This work introduces a novel Causal Reinforcement Learning approach…

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

In Multi-Agent Reinforcement Learning (MARL), specialized channels are often introduced that allow agents to communicate directly with one another. In this paper, we propose an alternative approach whereby agents communicate through an…

Artificial Intelligence · Computer Science 2022-05-26 Dianbo Liu , Vedant Shah , Oussama Boussif , Cristian Meo , Anirudh Goyal , Tianmin Shu , Michael Mozer , Nicolas Heess , Yoshua Bengio

We discuss the role of coordination as a direct learning objective in multi-agent reinforcement learning (MARL) domains. To this end, we present a novel means of quantifying coordination in multi-agent systems, and discuss the implications…

Multiagent Systems · Computer Science 2022-08-15 Sean L. Barton , Nicholas R. Waytowich , Derrik E. Asher

Modern reinforcement learning (RL) struggles to capture real-world cause-and-effect dynamics, leading to inefficient exploration due to extensive trial-and-error actions. While recent efforts to improve agent exploration have leveraged…

Machine Learning · Computer Science 2024-07-18 Minh Hoang Nguyen , Hung Le , Svetha Venkatesh

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Existing value-factorized based Multi-Agent deep Reinforce-ment Learning (MARL) approaches are well-performing invarious multi-agent cooperative environment under thecen-tralized training and decentralized execution(CTDE) scheme,where all…

Artificial Intelligence · Computer Science 2019-11-19 Runsheng Yu , Zhenyu Shi , Xinrun Wang , Rundong Wang , Buhong Liu , Xinwen Hou , Hanjiang Lai , Bo An

Agents capable of accomplishing complex tasks through multiple interactions with the environment have emerged as a popular research direction. However, in such multi-step settings, the conventional group-level policy optimization algorithm…

Machine Learning · Computer Science 2026-05-12 Leyang Shen , Yang Zhang , Chun Kai Ling , Xiaoyan Zhao , Tat-Seng Chua

Learning to coordinate is a daunting problem in multi-agent reinforcement learning (MARL). Previous works have explored it from many facets, including cognition between agents, credit assignment, communication, expert demonstration, etc.…

Multiagent Systems · Computer Science 2022-05-24 Yue Jin , Shuangqing Wei , Jian Yuan , Xudong Zhang

Multi-Agent Reinforcement Learning (MARL) provides a powerful framework for learning coordination in multi-agent systems. However, applying MARL to robotics still remains challenging due to high-dimensional continuous joint action spaces,…

Robotics · Computer Science 2025-10-03 Seoyeon Choi , Kanghyun Ryu , Jonghoon Ock , Negar Mehr

Most real-world domains can be formulated as multi-agent (MA) systems. Intentionality sharing agents can solve more complex tasks by collaborating, possibly in less time. True cooperative actions are beneficial for egoistic and collective…

Artificial Intelligence · Computer Science 2022-04-26 Philipp Dominic Siedler

Humans face countless scenarios that require reasoning and judgment in daily life. However, existing large language model training methods primarily allow models to learn from existing textual content or solve predetermined problems,…

Artificial Intelligence · Computer Science 2026-01-27 Yin Cai , Zhouhong Gu , Juntao Zhang , Ping Chen

The number of agents can be an effective curriculum variable for controlling the difficulty of multi-agent reinforcement learning (MARL) tasks. Existing work typically uses manually defined curricula such as linear schemes. We identify two…

Artificial Intelligence · Computer Science 2025-05-16 Wenshuai Zhao , Zhiyuan Li , Joni Pajarinen

Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge devices, it suffers from severe non-stationarity due to the…

Multi-Agent Reinforcement Learning (MARL) algorithms face the challenge of efficient exploration due to the exponential increase in the size of the joint state-action space. While demonstration-guided learning has proven beneficial in…

Multiagent Systems · Computer Science 2025-01-07 Peihong Yu , Manav Mishra , Alec Koppel , Carl Busart , Priya Narayan , Dinesh Manocha , Amrit Bedi , Pratap Tokekar

This paper considers multi-agent reinforcement learning (MARL) tasks where agents receive a shared global reward at the end of an episode. The delayed nature of this reward affects the ability of the agents to assess the quality of their…

Multiagent Systems · Computer Science 2022-01-13 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

We propose a new framework for multi-agent reinforcement learning (MARL), where the agents cooperate in a time-evolving network with latent community structures and mixed memberships. Unlike traditional neighbor-based or fixed interaction…

Machine Learning · Computer Science 2025-05-16 Zhaoyang Shi