English

Transfer of Fully Convolutional Policy-Value Networks Between Games and Game Variants

Machine Learning 2023-12-11 v1

Abstract

In this paper, we use fully convolutional architectures in AlphaZero-like self-play training setups to facilitate transfer between variants of board games as well as distinct games. We explore how to transfer trained parameters of these architectures based on shared semantics of channels in the state and action representations of the Ludii general game system. We use Ludii's large library of games and game variants for extensive transfer learning evaluations, in zero-shot transfer experiments as well as experiments with additional fine-tuning time.

Keywords

Cite

@article{arxiv.2102.12375,
  title  = {Transfer of Fully Convolutional Policy-Value Networks Between Games and Game Variants},
  author = {Dennis J. N. J. Soemers and Vegard Mella and Eric Piette and Matthew Stephenson and Cameron Browne and Olivier Teytaud},
  journal= {arXiv preprint arXiv:2102.12375},
  year   = {2023}
}