English

Multiplicative Turing Ensembles, Pareto's Law, and Creativity

Information Theory 2025-10-20 v2 Computational Complexity Mathematical Physics math.IT math.MP

Abstract

We study integer-valued multiplicative dynamics driven by i.i.d. prime multipliers and connect their macroscopic statistics to universal codelengths. We introduce the Multiplicative Turing Ensemble (MTE) and show how it arises naturally - though not uniquely - from ensembles of probabilistic Turing machines. Our modeling principle is variational: taking Elias' Omega codelength as an energy and imposing maximum entropy constraints yields a canonical Gibbs prior on integers and, by restriction, on primes. Under mild tail assumptions, this prior induces exponential tails for log-multipliers (up to slowly varying corrections), which in turn generate Pareto tails for additive gaps. We also prove time-average laws for the Omega codelength along MTE trajectories. Empirically, on Debian and PyPI package size datasets, a scaled Omega prior achieves the lowest KL divergence against codelength histograms. Taken together, the theory-data comparison suggests a qualitative split: machine-adapted regimes (Gibbs-aligned, finite first moment) exhibit clean averaging behavior, whereas human-generated complexity appears to sit beyond this regime, with tails heavy enough to produce an unbounded first moment, and therefore no averaging of the same kind.

Cite

@article{arxiv.2510.04167,
  title  = {Multiplicative Turing Ensembles, Pareto's Law, and Creativity},
  author = {Alexander Kolpakov and Aidan Rocke},
  journal= {arXiv preprint arXiv:2510.04167},
  year   = {2025}
}

Comments

23 pages, 2 figures, 1 table; auxiliary code available on GitHub (https://github.com/sashakolpakov/mte-pareto/)

R2 v1 2026-07-01T06:17:53.026Z