English

Random noise increases Kolmogorov complexity and Hausdorff dimension

Information Theory 2019-01-17 v3 math.IT

Abstract

Consider a binary string xx of length nn whose Kolmogorov complexity is αn\alpha n for some α<1\alpha<1. We want to increase the complexity of xx by changing a small fraction of bits in xx. This is always possible: Buhrman, Fortnow, Newman and Vereshchagin (2005) showed that the increase can be at least δn\delta n for large nn (where δ\delta is some positive number that depends on α\alpha and the allowed fraction of changed bits). We consider a related question: what happens with the complexity of xx when we randomly change a small fraction of the bits (changing each bit independently with some probability τ\tau)? It turns out that a linear increase in complexity happens with high probability, but this increase is smaller than in the case of arbitrary change. We note that the amount of the increase depends on xx (strings of the same complexity could behave differently), and give an exact lower and upper bounds for this increase (with o(n)o(n) precision). The proof uses the combinatorial and probabilistic technique that goes back to Ahlswede, G\'acs and K\"orner (1976). For the reader's convenience (and also because we need a slightly stronger statement) we provide a simplified exposition of this technique, so the paper is self-contained.

Cite

@article{arxiv.1808.04626,
  title  = {Random noise increases Kolmogorov complexity and Hausdorff dimension},
  author = {Gleb Posobin and Alexander Shen},
  journal= {arXiv preprint arXiv:1808.04626},
  year   = {2019}
}

Comments

an extended version of STACS 2019 paper

R2 v1 2026-06-23T03:33:15.818Z