Dynamic Multi-Arm Bandit Game Based Multi-Agents Spectrum Sharing Strategy Design
Abstract
For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied in terms of maximizing the cumulative reward over a finite time horizon. An Upper Confidence Bound (UCB) algorithm is used to achieve the optimal solutions for the stochastic Multi-Arm Bandit (MAB) problem. Also, the MAB problem can also be solved from the Markov game framework perspective. Meanwhile, Thompson Sampling (TS) is also used as benchmark to evaluate the proposed approach performance. Numerical results are also provided regarding minimizing the expectation of the regret and choosing the best parameter for the upper confidence bound.
Cite
@article{arxiv.1711.04365,
title = {Dynamic Multi-Arm Bandit Game Based Multi-Agents Spectrum Sharing Strategy Design},
author = {Jingyang Lu and Lun Li and Dan Shen and Genshe Chen and Bin Jia and Erik Blasch and Khanh Pham},
journal= {arXiv preprint arXiv:1711.04365},
year = {2017}
}