English
Related papers

Related papers: Why Global Performance is a Poor Metric for Verify…

200 papers

Cooperative multi-agent reinforcement learning (MARL) is typically formalised as a Decentralised Partially Observable Markov Decision Process (Dec-POMDP), where agents must reason about the environment and other agents' behaviour. In…

Machine Learning · Computer Science 2025-07-25 Kale-ab Abebe Tessera , Leonard Hinckeldey , Riccardo Zamboni , David Abel , Amos Storkey

In real-world multi-agent reinforcement learning (MARL) applications, agents may not have perfect state information (e.g., due to inaccurate measurement or malicious attacks), which challenges the robustness of agents' policies. Though…

Machine Learning · Computer Science 2023-08-01 Sihong He , Songyang Han , Sanbao Su , Shuo Han , Shaofeng Zou , Fei Miao

Multi-Agent Reinforcement Learning (MARL) has shown promising results across several domains. Despite this promise, MARL policies often lack robustness and are therefore sensitive to small changes in their environment. This presents a…

Machine Learning · Computer Science 2023-10-18 Alexander Bukharin , Yan Li , Yue Yu , Qingru Zhang , Zhehui Chen , Simiao Zuo , Chao Zhang , Songan Zhang , Tuo Zhao

This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents…

Artificial Intelligence · Computer Science 2023-04-14 Talal Algumaei , Ruben Solozabal , Reda Alami , Hakim Hacid , Merouane Debbah , Martin Takac

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in AI research. However, many research endeavours heavily rely on parameter sharing among agents, which confines…

Machine Learning · Computer Science 2023-12-29 Yifan Zhong , Jakub Grudzien Kuba , Xidong Feng , Siyi Hu , Jiaming Ji , Yaodong Yang

We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse. The fundamental problem we tackle, called the order-picking problem, is how these worker agents must…

Multi-agent credit assignment is a fundamental challenge for cooperative multi-agent reinforcement learning (MARL), where a team of agents learn from shared reward signals. The Individual-Global-Max (IGM) condition is a widely used…

Machine Learning · Computer Science 2026-02-04 Wen-Tse Chen , Yuxuan Li , Shiyu Huang , Jiayu Chen , Jeff Schneider

Real-time dynamic scheduling is a crucial but notoriously challenging task in modern manufacturing processes due to its high decision complexity. Recently, reinforcement learning (RL) has been gaining attention as an impactful technique to…

Multiagent Systems · Computer Science 2024-09-23 Jaeyeon Jang , Diego Klabjan , Han Liu , Nital S. Patel , Xiuqi Li , Balakrishnan Ananthanarayanan , Husam Dauod , Tzung-Han Juang

In order for artificial agents to coordinate effectively with people, they must act consistently with existing conventions (e.g. how to navigate in traffic, which language to speak, or how to coordinate with teammates). A group's…

Artificial Intelligence · Computer Science 2019-03-14 Adam Lerer , Alexander Peysakhovich

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Agent faults pose a significant threat to the performance of multi-agent reinforcement learning (MARL) algorithms, introducing two key challenges. First, agents often struggle to extract critical information from the chaotic state space…

Machine Learning · Computer Science 2024-12-03 Yuchen Shi , Huaxin Pei , Liang Feng , Yi Zhang , Danya Yao

Significant advances have recently been achieved in Multi-Agent Reinforcement Learning (MARL) which tackles sequential decision-making problems involving multiple participants. However, MARL requires a tremendous number of samples for…

Multiagent Systems · Computer Science 2024-12-30 Xihuai Wang , Zhicheng Zhang , Weinan Zhang

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

Machine Learning · Computer Science 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

In cooperative Multi-Agent Reinforcement Learning (MARL) agents are required to learn behaviours as a team to achieve a common goal. However, while learning a task, some agents may end up learning sub-optimal policies, not contributing to…

Artificial Intelligence · Computer Science 2023-06-22 Rafael Pina , Varuna De Silva , Corentin Artaud

This paper proposes an exploration technique for multi-agent reinforcement learning (MARL) with graph-based communication among agents. We assume the individual rewards received by the agents are independent of the actions by the other…

Machine Learning · Computer Science 2025-08-11 Ainur Zhaikhan , Ali H. Sayed

As machine learning (ML) systems increasingly permeate high-stakes settings such as healthcare, transportation, military, and national security, concerns regarding their reliability have emerged. Despite notable progress, the performance of…

Machine Learning · Computer Science 2023-08-01 Anthony Corso , David Karamadian , Romeo Valentin , Mary Cooper , Mykel J. Kochenderfer

In this paper, we propose a novel approach for verifying the compliance of turn-based multi-agent reinforcement learning (TMARL) agents with complex requirements in stochastic multiplayer games. Our method overcomes the limitations of…

Artificial Intelligence · Computer Science 2025-01-07 Dennis Gross

Few multi-agent reinforcement learning (MARL) research on Google Research Football (GRF) focus on the 11v11 multi-agent full-game scenario and to the best of our knowledge, no open benchmark on this scenario has been released to the public.…

Machine Learning · Computer Science 2024-02-21 Yan Song , He Jiang , Zheng Tian , Haifeng Zhang , Yingping Zhang , Jiangcheng Zhu , Zonghong Dai , Weinan Zhang , Jun Wang

Inferring reward functions from demonstrations is a key challenge in reinforcement learning (RL), particularly in multi-agent RL (MARL), where large joint state-action spaces and complex inter-agent interactions complicate the task. While…

Machine Learning · Computer Science 2025-02-03 The Viet Bui , Tien Mai , Hong Thanh Nguyen

Multi-Agent Reinforcement Learning (MARL) is a branch of machine learning in which agents interact and learn optimal policies through trial and error, addressing complex scenarios where multiple agents interact and learn in the same…

Human-Computer Interaction · Computer Science 2025-12-03 Changhee Lee , Jeongmin Rhee , DongHwa Shin