English
Related papers

Related papers: Information State Embedding in Partially Observabl…

200 papers

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Deep reinforcement learning (RL) algorithms have achieved great success on a wide variety of sequential decision-making tasks. However, many of these algorithms suffer from high sample complexity when learning from scratch using…

Machine Learning · Statistics 2020-06-15 Michael Wan , Tanmay Gangwani , Jian Peng

Federated Learning is a fast growing area of ML where the training datasets are extremely distributed, all while dynamically changing over time. Models need to be trained on clients' devices without any guarantees for either homogeneity or…

Machine Learning · Computer Science 2021-10-20 Tae Jin Park , Kenichi Kumatani , Dimitrios Dimitriadis

Real-world multi-agent reinforcement learning (MARL) systems must often operate under stale observations, stochastic communication delays, and intermittent packet loss. Policies trained under idealized synchronous conditions frequently…

Multiagent Systems · Computer Science 2026-05-27 Maxim Mednikov , Oren Gal

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Yijing Xie , Shaoshuai Mou , Shreyas Sundaram

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively improve observation…

The use of skills (a.k.a., options) can greatly accelerate exploration in reinforcement learning, especially when only sparse reward signals are available. While option discovery methods have been proposed for individual agents, in…

Machine Learning · Computer Science 2023-09-22 Jiayu Chen , Marina Haliem , Tian Lan , Vaneet Aggarwal

Adaptive cooperation in multi-agent reinforcement learning (MARL) requires policies to express homogeneous, specialised, or mixed behaviours, yet achieving this adaptivity remains a critical challenge. While parameter sharing (PS) is…

Machine Learning · Computer Science 2025-10-30 Kale-ab Abebe Tessera , Arrasy Rahman , Amos Storkey , Stefano V. Albrecht

This paper introduces a novel, open-source MARL simulation framework for studying implicit cooperation in LEMs, modeled as a decentralized partially observable Markov decision process and implemented as a Gymnasium environment for MARL. Our…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Nelson Salazar-Pena , Alejandra Tabares , Andres Gonzalez-Mancera

Recently, deep reinforcement learning (RL) algorithms have made great progress in multi-agent domain. However, due to characteristics of RL, training for complex tasks would be resource-intensive and time-consuming. To meet this challenge,…

Artificial Intelligence · Computer Science 2021-05-26 Zijian Gao , Kele Xu , Bo Ding , Huaimin Wang , Yiying Li , Hongda Jia

We study the problem of learning multi-task, multi-agent policies for cooperative, temporal objectives, under centralized training, decentralized execution. In this setting, using automata to represent tasks enables the decomposition of…

Multiagent Systems · Computer Science 2025-11-05 Beyazit Yalcinkaya , Marcell Vazquez-Chanlatte , Ameesh Shah , Hanna Krasowski , Sanjit A. Seshia

Iterative combinatorial auctions are widely used in high stakes settings such as spectrum auctions. Such auctions can be hard to analyze, making it difficult for bidders to determine how to behave and for designers to optimize auction rules…

Computer Science and Game Theory · Computer Science 2024-07-25 Greg d'Eon , Neil Newman , Kevin Leyton-Brown

Multi-agent systems (MAS) are widely prevalent and crucially important in numerous real-world applications, where multiple agents must make decisions to achieve their objectives in a shared environment. Despite their ubiquity, the…

Multiagent Systems · Computer Science 2024-07-04 Dom Huh , Prasant Mohapatra

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered great success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g.,…

Machine Learning · Computer Science 2021-04-30 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ)…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Zhiyuan Yao , Zihan Ding , Thomas Clausen

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse. The fundamental problem we tackle, called the order-picking problem, is how these worker agents must…

We propose a unified mechanism for achieving coordination and communication in Multi-Agent Reinforcement Learning (MARL), through rewarding agents for having causal influence over other agents' actions. Causal influence is assessed using…

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to…

Artificial Intelligence · Computer Science 2023-10-20 Baofu Fang , Caiming Zheng , Hao Wang