A Novel Point-based Algorithm for Multi-agent Control Using the Common Information Approach
Artificial Intelligence
2023-04-11 v1 Multiagent Systems
Systems and Control
Systems and Control
Optimization and Control
Abstract
The Common Information (CI) approach provides a systematic way to transform a multi-agent stochastic control problem to a single-agent partially observed Markov decision problem (POMDP) called the coordinator's POMDP. However, such a POMDP can be hard to solve due to its extraordinarily large action space. We propose a new algorithm for multi-agent stochastic control problems, called coordinator's heuristic search value iteration (CHSVI), that combines the CI approach and point-based POMDP algorithms for large action spaces. We demonstrate the algorithm through optimally solving several benchmark problems.
Keywords
Cite
@article{arxiv.2304.04346,
title = {A Novel Point-based Algorithm for Multi-agent Control Using the Common Information Approach},
author = {Dengwang Tang and Ashutosh Nayyar and Rahul Jain},
journal= {arXiv preprint arXiv:2304.04346},
year = {2023}
}
Comments
11 pages, 4 figures