English

Complexity as Advantage: A Regret-Based Perspective on Emergent Structure

Machine Learning 2025-11-07 v1 Information Theory math.IT

Abstract

We introduce Complexity as Advantage (CAA), a framework that defines the complexity of a system relative to a family of observers. Instead of measuring complexity as an intrinsic property, we evaluate how much predictive regret a system induces for different observers attempting to model it. A system is complex when it is easy for some observers and hard for others, creating an information advantage. We show that this formulation unifies several notions of emergent behavior, including multiscale entropy, predictive information, and observer-dependent structure. The framework suggests that "interesting" systems are those positioned to create differentiated regret across observers, providing a quantitative grounding for why complexity can be functionally valuable. We demonstrate the idea through simple dynamical models and discuss implications for learning, evolution, and artificial agents.

Keywords

Cite

@article{arxiv.2511.04590,
  title  = {Complexity as Advantage: A Regret-Based Perspective on Emergent Structure},
  author = {Oshri Naparstek},
  journal= {arXiv preprint arXiv:2511.04590},
  year   = {2025}
}

Comments

15 pages. Under preparation for submission to ICML 2026. Feedback welcome

R2 v1 2026-07-01T07:24:55.847Z