English
Related papers

Related papers: Causality Detection for Efficient Multi-Agent Rein…

200 papers

Adequate strategizing of agents behaviors is essential to solving cooperative MARL problems. One intuitively beneficial yet uncommon method in this domain is predicting agents future behaviors and planning accordingly. Leveraging this…

Machine Learning · Computer Science 2022-12-15 Majd Ibrahim , Ammar Fayad

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

Team formation and the dynamics of team-based learning have drawn significant interest in the context of Multi-Agent Reinforcement Learning (MARL). However, existing studies primarily focus on unilateral groupings, predefined teams, or…

Multiagent Systems · Computer Science 2025-06-26 Koorosh Moslemi , Chi-Guhn Lee

Multi-agent reinforcement learning (MARL) is a widely used Artificial Intelligence (AI) technique. However, current studies and applications need to address its scalability, non-stationarity, and trustworthiness. This paper aims to review…

Artificial Intelligence · Computer Science 2024-06-07 Ziyuan Zhou , Guanjun Liu , Ying Tang

Multi-agent reinforcement learning is a standard framework for modeling multi-agent interactions applied in real-world scenarios. Inspired by experience sharing in human groups, learning knowledge parallel reusing between agents can…

Artificial Intelligence · Computer Science 2020-04-01 Yongyuan Liang , Bangwei Li

Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed…

Machine Learning · Computer Science 2026-03-24 Dong Li , Zhengzhang Chen , Xujiang Zhao , Linlin Yu , Zhong Chen , Yi He , Haifeng Chen , Chen Zhao

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

Action and observation delays exist prevalently in the real-world cyber-physical systems which may pose challenges in reinforcement learning design. It is particularly an arduous task when handling multi-agent systems where the delay of one…

Machine Learning · Computer Science 2020-09-01 Baiming Chen , Mengdi Xu , Zuxin Liu , Liang Li , Ding Zhao

Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge devices, it suffers from severe non-stationarity due to the…

Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high…

Machine Learning · Computer Science 2026-02-10 Huilin Yin , Zhikun Yang , Linchuan Zhang , Daniel Watzenig

Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's…

Machine Learning · Computer Science 2021-08-10 Sumedh A. Sontakke , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

We consider the problem of cooperative exploration where multiple robots need to cooperatively explore an unknown region as fast as possible. Multi-agent reinforcement learning (MARL) has recently become a trending paradigm for solving this…

Robotics · Computer Science 2023-04-12 Chao Yu , Xinyi Yang , Jiaxuan Gao , Jiayu Chen , Yunfei Li , Jijia Liu , Yunfei Xiang , Ruixin Huang , Huazhong Yang , Yi Wu , Yu Wang

Agents capable of accomplishing complex tasks through multiple interactions with the environment have emerged as a popular research direction. However, in such multi-step settings, the conventional group-level policy optimization algorithm…

Machine Learning · Computer Science 2026-05-12 Leyang Shen , Yang Zhang , Chun Kai Ling , Xiaoyan Zhao , Tat-Seng Chua

Due to the broad range of applications of multi-agent reinforcement learning (MARL), understanding the effects of adversarial attacks against MARL model is essential for the safe applications of this model. Motivated by this, we investigate…

Machine Learning · Computer Science 2023-07-18 Guanlin Liu , Lifeng Lai

Multi-agent reinforcement learning (MARL) has shown recent success in increasingly complex fixed-team zero-sum environments. However, the real world is not zero-sum nor does it have fixed teams; humans face numerous social dilemmas and must…

Machine Learning · Computer Science 2020-11-12 Bowen Baker

Mapping deep neural networks (DNNs) to hardware is critical for optimizing latency, energy consumption, and resource utilization, making it a cornerstone of high-performance accelerator design. Due to the vast and complex mapping space,…

Multi-Agent Reinforcement Learning (MARL) considers settings in which a set of coexisting agents interact with one another and their environment. The adaptation and learning of other agents induces non-stationarity in the environment…

Machine Learning · Computer Science 2020-06-09 Ian Davies , Zheng Tian , Jun Wang

Exploration in cooperative multi-agent reinforcement learning (MARL) remains challenging for value-based agents due to the absence of an explicit policy. Existing approaches include individual exploration based on uncertainty towards the…

Artificial Intelligence · Computer Science 2024-12-31 Guangchong Zhou , Zeren Zhang , Guoliang Fan

In the rapidly evolving field of multi-agent reinforcement learning (MARL), understanding the dynamics of open systems is crucial. Openness in MARL refers to the dynam-ic nature of agent populations, tasks, and agent types with-in a system.…

Machine Learning · Computer Science 2025-11-03 Alireza Saleh Abadi , Leen-Kiat Soh

Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but…

Machine Learning · Computer Science 2022-11-01 Jennifer She , Jayesh K. Gupta , Mykel J. Kochenderfer