English
Related papers

Related papers: On Kolmogorov Structure Functions

200 papers

Link prediction in graphs is an important task in the fields of network science and machine learning. We investigate a flexible means of regularization for link prediction based on an approximation of the Kolmogorov complexity of graphs…

Machine Learning · Computer Science 2021-02-24 Paris D. L. Flood , Ramon Viñas , Pietro Liò

Algorithmic information theory studies description complexity and randomness and is now a well known field of theoretical computer science and mathematical logic. There are several textbooks and monographs devoted to this theory where one…

Information Theory · Computer Science 2015-04-21 Alexander Shen

Using the theory of Kolmogorov complexity the notion of facticity {\phi}(x) of a string is defined as the amount of self-descriptive information it contains. It is proved that (under reasonable assumptions: the existence of an empty machine…

Information Theory · Computer Science 2012-03-13 Pieter Adriaans

Mutual information I in infinite sequences (and in their finite prefixes) is essential in theoretical analysis of many situations. Yet its right definition has been elusive for a long time. I address it by generalizing Kolmogorov Complexity…

Computational Complexity · Computer Science 2021-08-03 Leonid A. Levin

We present a fully automatic method for music classification, based only on compression of strings that represent the music pieces. The method uses no background knowledge about music whatsoever: it is completely general and can, without…

Sound · Computer Science 2016-08-31 Rudi Cilibrasi , Paul Vitanyi , Ronald de Wolf

Drawing on various notions from theoretical computer science, we present a novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings. The…

Information Theory · Computer Science 2015-03-13 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

Symmetry of information establishes a relation between the information that x has about y (denoted I(x : y)) and the information that y has about x (denoted I(y : x)). In classical information theory, the two are exactly equal, but in…

Information Theory · Computer Science 2012-06-25 Marius Zimand

In this paper we give a definition for quantum Kolmogorov complexity. In the classical setting, the Kolmogorov complexity of a string is the length of the shortest program that can produce this string as its output. It is a measure of the…

Quantum Physics · Physics 2007-05-23 Andre Berthiaume , Wim van Dam , Sophie Laplante

We sample a velocity field that has an inertial spectrum and a skewness that matches experimental data. In particular, we compute a self-consistent correction to the Kolmogorov exponent and find that for our model it is zero. We find that…

Other Condensed Matter · Physics 2025-10-20 Alex Arenas , Alexandre Chorin

This paper is motivated by a conjecture that BPP can be characterized in terms of polynomial-time nonadaptive reductions to the set of Kolmogorov-random strings. In this paper we show that an approach laid out in [Allender et al] to settle…

Computational Complexity · Computer Science 2015-07-01 Eric Allender , Harry Buhrman , Luke Friedman , Bruno Loff

In analogy of classical Kolmogorov complexity we develop a theory of the algorithmic information in bits contained in any one of continuously many pure quantum states: quantum Kolmogorov complexity. Classical Kolmogorov complexity coincides…

Quantum Physics · Physics 2007-05-23 Paul Vitanyi

The (prefix-free) Kolmogorov complexity of a finite binary string is the length of the shortest description of the string. This gives rise to some `standard' lowness notions for reals: A is K-trivial if its initial segments have the lowest…

Logic · Mathematics 2014-10-15 Ian Herbert

Diverse applications of Kolmogorov complexity to learning [CIKK16], circuit complexity [OPS19], cryptography [LP20], average-case complexity [Hir21], and proof search [Kra22] have been discovered in recent years. Since the running time of…

Computational Complexity · Computer Science 2022-05-31 Zhenjian Lu , Igor C. Oliveira

We show that the mutual information, in the sense of Kolmogorov complexity, of any pair of strings $x$ and $y$ is equal, up to logarithmic precision, to the length of the longest shared secret key that two parties, one having $x$ and the…

Information Theory · Computer Science 2019-04-30 Andrei Romashchenko , Marius Zimand

In this survey, we explore Andrei Nikolayevich Kolmogorov's seminal work in just one of his many facets: its influence Computer Science especially his viewpoint of what herein we call 'Algorithmic Theory of Informatics.' Can a computer file…

General Literature · Computer Science 2020-06-23 Sergei Levashkin , Victor Alexandrov , Adolfo Guzmán-Arenas

We consider a range of simply stated dynamic data structure problems on strings. An update changes one symbol in the input and a query asks us to compute some function of the pattern of length $m$ and a substring of a longer text. We give…

Data Structures and Algorithms · Computer Science 2018-02-20 Raphael Clifford , Allan Grønlund , Kasper Green Larsen , Tatiana Starikovskaya

We prove that the extremum stack of a discrete sequence is a minimal sufficient statistic for the class of all computable, causal, rate-independent functionals, in the sense of Kolmogorov complexity. Specifically, we establish K(Pi_n) -…

Information Theory · Computer Science 2026-05-20 Piotr Frydrych

This paper proposes new notions of polynomial depth (called monotone poly depth), based on a polynomial version of monotone Kolmogorov complexity. We show that monotone poly depth satisfies all desirable properties of depth notions i.e.,…

Computational Complexity · Computer Science 2015-03-17 Philippe Moser

In this paper with two equivalent representations of the information contained by a SAT formula, the reason why string generated by succinct SAT formula can be greatly compressed is firstly presented based on Kolmogorov complexity theory.…

Computational Complexity · Computer Science 2015-10-06 Feng Pan

A constructive version of Hausdorff dimension is developed using constructive supergales, which are betting strategies that generalize the constructive supermartingales used in the theory of individual random sequences. This constructive…

Computational Complexity · Computer Science 2007-05-23 Jack H. Lutz