English
Related papers

Related papers: Short lists for shortest descriptions in short tim…

200 papers

We summarize our recent findings, where we proposed a framework for learning a Kolmogorov model, for a collection of binary random variables. More specifically, we derive conditions that link outcomes of specific random variables, and…

Machine Learning · Computer Science 2018-06-07 Hadi Ghauch , Mikael Skoglund , Hossein Shokri-Ghadikolaei , Carlo Fischione , Ali H. Sayed

We investigate topological, combinatorial, statistical, and enumeration properties of finite graphs with high Kolmogorov complexity (almost all graphs) using the novel incompressibility method. Example results are: (i) the mean and variance…

Combinatorics · Mathematics 2007-05-23 Harry Buhrman , Ming Li , John Tromp , Paul Vitanyi

Algorithmic information theory studies description complexity and randomness and is now a well known field of theoretical computer science and mathematical logic. There are several textbooks and monographs devoted to this theory where one…

Information Theory · Computer Science 2015-04-21 Alexander Shen

Kolmogorov complexity of a finite binary word reflects both algorithmic structure and the empirical distribution of symbols appearing in the word. Words with symbol frequencies far from one half have smaller combinatorial richness and…

Computation · Statistics 2025-12-25 Brani Vidakovic

Some established and also novel techniques in the field of applications of algorithmic (Kolmogorov) complexity currently co-exist for the first time and are here reviewed, ranging from dominant ones such as statistical lossless compression…

Information Theory · Computer Science 2020-07-15 Hector Zenil

We introduce algorithmic information theory, also known as the theory of Kolmogorov complexity. We explain the main concepts of this quantitative approach to defining `information'. We discuss the extent to which Kolmogorov's and Shannon's…

Information Theory · Computer Science 2008-09-17 Peter D. Grunwald , Paul M. B. Vitanyi

The (prefix-free) Kolmogorov complexity of a finite binary string is the length of the shortest description of the string. This gives rise to some `standard' lowness notions for reals: A is K-trivial if its initial segments have the lowest…

Logic · Mathematics 2014-10-15 Ian Herbert

There is a parallelism between Shannon information theory and algorithmic information theory. In particular, the same linear inequalities are true for Shannon entropies of tuples of random variables and Kolmogorov complexities of tuples of…

Information Theory · Computer Science 2022-09-12 Bruno Bauwens , Peter Gács , Andrei Romashchenko , Alexander Shen

Effective complexity measures the information content of the regularities of an object. It has been introduced by M. Gell-Mann and S. Lloyd to avoid some of the disadvantages of Kolmogorov complexity, also known as algorithmic information…

Information Theory · Computer Science 2010-11-22 Nihat Ay , Markus Mueller , Arleta Szkola

This paper is motivated by a conjecture that BPP can be characterized in terms of polynomial-time nonadaptive reductions to the set of Kolmogorov-random strings. In this paper we show that an approach laid out in [Allender et al] to settle…

Computational Complexity · Computer Science 2015-07-01 Eric Allender , Harry Buhrman , Luke Friedman , Bruno Loff

Due to M\"{u}ller's theorem, the Kolmogorov complexity of a string was shown to be equal to its quantum Kolmogorov complexity. Thus there are no benefits to using quantum mechanics to compress classical information. The quantitative amount…

Computational Complexity · Computer Science 2024-07-04 Samuel Epstein

We study the possibility of scaling down algorithmic information quantities in tuples of correlated strings. In particular, we address a question raised by Alexander Shen: whether, for any triple of strings $(a, b, c)$, there exists a…

Information Theory · Computer Science 2025-10-29 Andrei Romashchenko

Any positive word comprised of random sequence of tokens form a finite alphabet can be reduced (without change of length) using an appropriate size Braid group relationships. Surprisingly the Braid relations dramatically reduce the…

Computational Complexity · Computer Science 2013-08-20 Dara O Shayda

Multilayer networks preserve full information about the different interactions among the constituents of a complex system, and have recently proven quite useful in modelling transportation networks, social circles, and the human brain. A…

Physics and Society · Physics 2020-06-29 Andrea Santoro , Vincenzo Nicosia

The even online Kolmogorov complexity of a string $x = x_1 x_2 \cdots x_{n}$ is the minimal length of a program that for all $i\le n/2$, on input $x_1x_3 \cdots x_{2i-1}$ outputs $x_{2i}$. The odd complexity is defined similarly. The sum of…

Computational Complexity · Computer Science 2025-07-15 Bruno Bauwens , Maria Marchenko

We prove a very general lower bound technique for quantum and randomized query complexity, that is easy to prove as well as to apply. To achieve this, we introduce the use of Kolmogorov complexity to query complexity. Our technique…

Quantum Physics · Physics 2007-05-23 Sophie Laplante , Frederic Magniez

The minimal Kolmogorov complexity of a total computable function that exceeds everywhere all total computable functions of complexity at most $n$, is $2^{n+O(1)}$. If we replace "everywhere" by "for all sufficiently large inputs", the…

Logic · Mathematics 2020-12-29 Alexander Shen

The main goal of this paper is to put some known results in a common perspective and to simplify their proofs. We start with a simple proof of a result from (Vereshchagin, 2002) saying that $\limsup_n\KS(x|n)$ (here $\KS(x|n)$ is…

Computational Complexity · Computer Science 2008-02-21 Laurent Bienvenu , Andrej Muchnik , Alexander Shen , Nikolay Vereshchagin

We study the problems of finding a shortest synchronizing word and its length for a given prefix code. This is done in two different settings: when the code is defined by an arbitrary decoder recognizing its star and when the code is…

Formal Languages and Automata Theory · Computer Science 2018-06-19 Andrew Ryzhikov , Marek Szykuła

This is a short introduction to Kolmogorov Complexity. The interested reader is referred to the text books by Cover & Thomas as well as Li & V\'itanyi, which cover the fields of information theory and Kolmogorov complexity in depth and with…

Computational Complexity · Computer Science 2010-05-17 Volker Nannen