Multiplicative Turing Ensembles, Pareto's Law, and Creativity
Abstract
We study integer-valued multiplicative dynamics driven by i.i.d. prime multipliers and connect their macroscopic statistics to universal codelengths. We introduce the Multiplicative Turing Ensemble (MTE) and show how it arises naturally - though not uniquely - from ensembles of probabilistic Turing machines. Our modeling principle is variational: taking Elias' Omega codelength as an energy and imposing maximum entropy constraints yields a canonical Gibbs prior on integers and, by restriction, on primes. Under mild tail assumptions, this prior induces exponential tails for log-multipliers (up to slowly varying corrections), which in turn generate Pareto tails for additive gaps. We also prove time-average laws for the Omega codelength along MTE trajectories. Empirically, on Debian and PyPI package size datasets, a scaled Omega prior achieves the lowest KL divergence against codelength histograms. Taken together, the theory-data comparison suggests a qualitative split: machine-adapted regimes (Gibbs-aligned, finite first moment) exhibit clean averaging behavior, whereas human-generated complexity appears to sit beyond this regime, with tails heavy enough to produce an unbounded first moment, and therefore no averaging of the same kind.
Cite
@article{arxiv.2510.04167,
title = {Multiplicative Turing Ensembles, Pareto's Law, and Creativity},
author = {Alexander Kolpakov and Aidan Rocke},
journal= {arXiv preprint arXiv:2510.04167},
year = {2025}
}
Comments
23 pages, 2 figures, 1 table; auxiliary code available on GitHub (https://github.com/sashakolpakov/mte-pareto/)