English

Discovering Differences in Strategic Behavior Between Humans and LLMs

Artificial Intelligence 2026-02-12 v1 Computation and Language Computers and Society Human-Computer Interaction

Abstract

As Large Language Models (LLMs) are increasingly deployed in social and strategic scenarios, it becomes critical to understand where and why their behavior diverges from that of humans. While behavioral game theory (BGT) provides a framework for analyzing behavior, existing models do not fully capture the idiosyncratic behavior of humans or black-box, non-human agents like LLMs. We employ AlphaEvolve, a cutting-edge program discovery tool, to directly discover interpretable models of human and LLM behavior from data, thereby enabling open-ended discovery of structural factors driving human and LLM behavior. Our analysis on iterated rock-paper-scissors reveals that frontier LLMs can be capable of deeper strategic behavior than humans. These results provide a foundation for understanding structural differences driving differences in human and LLM behavior in strategic interactions.

Keywords

Cite

@article{arxiv.2602.10324,
  title  = {Discovering Differences in Strategic Behavior Between Humans and LLMs},
  author = {Caroline Wang and Daniel Kasenberg and Kim Stachenfeld and Pablo Samuel Castro},
  journal= {arXiv preprint arXiv:2602.10324},
  year   = {2026}
}
R2 v1 2026-07-01T10:30:48.768Z