English
Related papers

Related papers: Two-Dimensional Kolmogorov Complexity and Validati…

200 papers

Infinite words, also known as streams, hold significant interest in computer science and mathematics, raising the natural question of how their complexity should be measured. We introduce cellular automaton reducibility as a measure of…

Formal Languages and Automata Theory · Computer Science 2026-01-30 Markel Zubia , Herman Geuvers

We show that Kolmogorov complexity and such its estimators as universal codes (or data compression methods) can be applied for hypotheses testing in a framework of classical mathematical statistics. The methods for identity testing and…

Computational Complexity · Computer Science 2007-05-23 Boris Ryabko , Jaakko Astola , Alex Gammerman

We discuss the computational complexity of solving linear programming problems by means of an analog computer. The latter is modeled by a dynamical system which converges to the optimal vertex solution. We analyze various probability…

Other Condensed Matter · Physics 2007-05-23 Yaniv S. Avizrats , Joshua Feinberg , Shmuel Fishman

Since human randomness production has been studied and widely used to assess executive functions (especially inhibition), many measures have been suggested to assess the degree to which a sequence is random-like. However, each of them…

Computational Complexity · Computer Science 2013-12-10 Nicolas Gauvrit , Hector Zenil , Jean-Paul Delahaye , Fernando Soler-Toscano

We prove various results connected together by the common thread of computability theory. First, we investigate a new notion of algorithmic dimension, the inescapable dimension, which lies between the effective Hausdorff and packing…

Logic · Mathematics 2022-09-14 David J. Webb

An a priori semimeasure (also known as "algorithmic probability" or "the Solomonoff prior" in the context of inductive inference) is defined as the transformation, by a given universal monotone Turing machine, of the uniform measure on the…

Statistics Theory · Mathematics 2016-06-29 Tom F. Sterkenburg

For a broad class of input-output maps, arguments based on the coding theorem from algorithmic information theory (AIT) predict that simple (low Kolmogorov complexity) outputs are exponentially more likely to occur upon uniform random…

Data Analysis, Statistics and Probability · Physics 2019-10-03 Kamaludin Dingle , Guillermo Valle Pérez , Ard A. Louis

A drawback of Kolmogorov-Chaitin complexity (K) as a function from s to the shortest program producing s is its noncomputability which limits its range of applicability. Moreover, when strings are short, the dependence of K on a particular…

Computational Complexity · Computer Science 2010-12-20 Jean-Paul Delahaye , Hector Zenil

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

Given a reference computer, Kolmogorov complexity is a well defined function on all binary strings. In the standard approach, however, only the asymptotic properties of such functions are considered because they do not depend on the…

Machine Learning · Computer Science 2007-05-23 Andrei N. Soklakov

In classical information theory, entropy rate and Kolmogorov complexity per symbol are related by a theorem of Brudno. In this paper, we prove a quantum version of this theorem, connecting the von Neumann entropy rate and two notions of…

Quantum Physics · Physics 2007-07-16 Fabio Benatti , Tyll Krueger , Markus Mueller , Rainer Siegmund-Schultze , Arleta Szkola

In dynamical systems such as cellular automata and iterated maps, it is often useful to look at a language or set of symbol sequences produced by the system. There are well-established classification schemes, such as the Chomsky hierarchy,…

Condensed Matter · Physics 2007-05-23 Kristian Lindgren , Cristopher Moore , Mats G. Nordahl

Suppose we are given an $n$-dimensional order-3 symmetric tensor $T \in (\mathbb{R}^n)^{\otimes 3}$ that is the sum of $r$ random rank-1 terms. The problem of recovering the rank-1 components is possible in principle when $r \lesssim n^2$…

Computational Complexity · Computer Science 2023-03-28 Alexander S. Wein

We formulate the conditional Kolmogorov complexity of x given y at precision r, where x and y are points in Euclidean spaces and r is a natural number. We demonstrate the utility of this notion in two ways. 1. We prove a point-to-set…

Computational Complexity · Computer Science 2016-12-02 Jack H. Lutz , Neil Lutz

We comment on some conceptual and and technical problems related to computational mechanics, point out some errors in several papers, and straighten out some wrong priority claims. We present explicitly the correct algorithm for…

Data Analysis, Statistics and Probability · Physics 2018-04-09 Peter Grassberger

The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to…

Computational Complexity · Computer Science 2024-09-20 Shuichi Hirahara , Zhenjian Lu , Mikito Nanashima

Predicting the runtime complexity of a programming code is an arduous task. In fact, even for humans, it requires a subtle analysis and comprehensive knowledge of algorithms to predict time complexity with high fidelity, given any code. As…

Machine Learning · Computer Science 2019-11-05 Jagriti Sikka , Kushal Satya , Yaman Kumar , Shagun Uppal , Rajiv Ratn Shah , Roger Zimmermann

The Turing degree of a real measures the computational difficulty of producing its binary expansion. Since Turing degrees are tailsets, it follows from Kolmogorov's 0-1 law that for any property which may or may not be satisfied by any…

Logic · Mathematics 2011-11-07 George Barmpalias , Adam R. Day , Andrew E. M. Lewis

We study algorithmic randomness and monotone complexity on product of the set of infinite binary sequences. We explore the following problems: monotone complexity on product space, Lambalgen's theorem for correlated probability,…

Information Theory · Computer Science 2010-06-29 Hayato Takahashi

We consider the typical asymptotic behaviour of cellular automata of higher dimension (greater than 2). That is, we take an initial configuration at random according to a Bernoulli (i.i.d) probability measure, iterate some cellular…

Dynamical Systems · Mathematics 2017-02-21 Martin Delacourt , Benjamin Hellouin de Menibus