English

{\epsilon}-Optimally Solving Two-Player Zero-Sum POSGs

Computer Science and Game Theory 2025-11-17 v1

Abstract

We present a novel framework for {\epsilon}-optimally solving two-player zero-sum partially observable stochastic games (zs-POSGs). These games pose a major challenge due to the absence of a principled connection with dynamic programming (DP) techniques developed for two-player zero-sum stochastic games (zs-SGs). Prior attempts at transferring solution methods have lacked a lossless reduction, defined here as a transformation that preserves value functions, equilibrium strategies, and optimality structure, thereby limiting generalisation to ad-hoc algorithms. This work introduces the first lossless reduction from zs-POSGs to transition-independent zs-SGs, enabling the principled application of a broad class of DP-based methods. We show empirically that point-based value iteration (PBVI) algorithms, applied via this reduction, produce {\epsilon}-optimal strategies across a range of benchmark domains, consistently matching or outperforming existing state-of-the-art methods. Our results open a systematic pathway for algorithmic and theoretical transfer from SGs to partially observable settings.

Keywords

Cite

@article{arxiv.2511.11282,
  title  = {{\epsilon}-Optimally Solving Two-Player Zero-Sum POSGs},
  author = {Erwan Christian Escudie and Matthia Sabatelli and Olivier Buffet and Jilles Steeve Dibangoye},
  journal= {arXiv preprint arXiv:2511.11282},
  year   = {2025}
}
R2 v1 2026-07-01T07:37:27.758Z