English

Game of Thought: Robust Information Seeking with Large Language Models Using Game Theory

Computation and Language 2026-02-03 v1 Artificial Intelligence Computer Science and Game Theory

Abstract

Large Language Models (LLMs) are increasingly deployed in real-world scenarios where they may lack sufficient information to complete a given task. In such settings, the ability to actively seek out missing information becomes a critical capability. Existing approaches to enhancing this ability often rely on simplifying assumptions that degrade \textit{worst-case} performance. This is an issue with serious implications in high-stakes applications. In this work, we use the game of Twenty Questions to evaluate the information-seeking ability of LLMs. We introduce and formalize its adversarial counterpart, the Strategic Language Search (SLS) problem along with its variants as a two-player zero-sum extensive form game. We propose Game of Thought (GoT), a framework that applies game-theoretic techniques to approximate a Nash equilibrium (NE) strategy for the restricted variant of the game. Empirical results demonstrate that our approach consistently improves worst-case performance compared to (1) direct prompting-based methods and (2) heuristic-guided search methods across all tested settings.

Keywords

Cite

@article{arxiv.2602.01708,
  title  = {Game of Thought: Robust Information Seeking with Large Language Models Using Game Theory},
  author = {Langyuan Cui and Chun Kai Ling and Hwee Tou Ng},
  journal= {arXiv preprint arXiv:2602.01708},
  year   = {2026}
}

Comments

23 pages, 10 figures, under review at ICML 2026