English
Related papers

Related papers: A Short Introduction to Kolmogorov Complexity

200 papers

The Kolmogorov complexity of a string is the length of its shortest description. We define a second quantised Kolmogorov complexity where the length of a description is defined to be the average length of its superposition. We discuss this…

Quantum Physics · Physics 2008-09-17 Caroline Rogers , Vlatko Vedral , Rajagopal Nagarajan

Here we present in a single essay a combination and completion of the several aspects of the problem of randomness of individual objects which of necessity occur scattered in our texbook "An Introduction to Kolmogorov Complexity and Its…

Probability · Mathematics 2007-06-13 Paul M. B. Vitanyi

We introduce algorithmic information theory, also known as the theory of Kolmogorov complexity. We explain the main concepts of this quantitative approach to defining `information'. We discuss the extent to which Kolmogorov's and Shannon's…

Information Theory · Computer Science 2008-09-17 Peter D. Grunwald , Paul M. B. Vitanyi

Given a reference computer, Kolmogorov complexity is a well defined function on all binary strings. In the standard approach, however, only the asymptotic properties of such functions are considered because they do not depend on the…

Machine Learning · Computer Science 2007-05-23 Andrei N. Soklakov

The last theme of Kolmogorov's mathematics research was algorithmic theory of information, now often called Kolmogorov complexity theory. There are only two main publications of Kolmogorov (1965 and 1968-1969) on this topic. So Kolmogorov's…

Logic · Mathematics 2023-10-19 Alexey Semenov , Alexander Shen , Nikolay Vereshchagin

We develop a theory of the algorithmic information in bits contained in an individual pure quantum state. This extends classical Kolmogorov complexity to the quantum domain retaining classical descriptions. Quantum Kolmogorov complexity…

Quantum Physics · Physics 2016-11-17 Paul M. B. Vitanyi

In this paper, a representation of the information-disturbance theorem based on the quantum Kolmogorov complexity that was defined by P. Vitanyi has been examined. In the quantum information theory, the information-disturbance relationship,…

Quantum Physics · Physics 2011-05-16 Takayuki Miyadera

We present several application of simple topological arguments in problems of Kolmogorov complexity. Basically we use the standard fact from topology that the disk is simply connected. It proves to be enough to construct strings with some…

Discrete Mathematics · Computer Science 2015-01-27 Alexander Shen , Andrei Romashchenko

Diverse applications of Kolmogorov complexity to learning [CIKK16], circuit complexity [OPS19], cryptography [LP20], average-case complexity [Hir21], and proof search [Kra22] have been discovered in recent years. Since the running time of…

Computational Complexity · Computer Science 2022-05-31 Zhenjian Lu , Igor C. Oliveira

We initiate the theory of communication complexity of individual inputs held by the agents, rather than worst-case or average-case. We consider total, partial, and partially correct protocols, one-way versus two-way, with and without help…

Computational Complexity · Computer Science 2007-05-23 Harry Buhrman , Hartmut Klauck , Nikolai Vereshchagin , Paul Vitanyi

This work presents a study of Kolmogorov complexity for general quantum states from the perspective of deterministic-control quantum Turing Machines (dcq-TM). We extend the dcq-TM model to incorporate mixed state inputs and outputs, and…

Quantum Physics · Physics 2024-01-24 Mariano Lemus , Ricardo Faleiro , Paulo Mateus , Nikola Paunković , André Souto

Kolmogorov complexity is often used as a convenient language for counting and/or probabilistic existence proofs. However, there are some applications where Kolmogorov complexity is used in a more subtle way. We provide one (somehow)…

Discrete Mathematics · Computer Science 2024-05-16 Alexander Shen

We consider dynamical systems for which the spatial extension plays an important role. For these systems, the notions of attractor, epsilon-entropy and topological entropy per unit time and volume have been introduced previously. In this…

Dynamical Systems · Mathematics 2009-11-11 Claudio Bonanno , Pierre Collet

Is it possible to find a shortest description for a binary string? The well-known answer is "no, Kolmogorov complexity is not computable." Faced with this barrier, one might instead seek a short list of candidates which includes a laconic…

Computational Complexity · Computer Science 2014-02-14 Jason Teutsch

Information entropy is used to summarize transcriptome data, but ignoring zero count data contained them. Ignoring zero count data causes loss of information and sometimes it was difficult to distinguish between multiple transcriptomes.…

Cell Behavior · Quantitative Biology 2017-04-13 Panpaki Seekaki , Norichika Ogata

We revisit the fundamentals of Circuit Complexity and the nature of efficient computation from a fresh perspective. We present a framework for understanding Circuit Complexity through the lens of Information Theory with analogies to results…

Computational Complexity · Computer Science 2025-12-30 Luke Tonon

We survey and introduce concepts and tools located at the intersection of information theory and network biology. We show that Shannon's information entropy, compressibility and algorithmic complexity quantify different local and global…

Molecular Networks · Quantitative Biology 2015-12-14 Hector Zenil , Narsis A. Kiani , Jesper Tegnér

We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories:…

Information Theory · Computer Science 2020-07-21 Peter Grunwald , Paul Vitanyi

We survey the Kolmogorov's approach to the notion of randomness through the Kolmogorov complexity theory. The original motivation of Kolmogorov was to give up a quantitative definition of information. In this theory, an object is randomness…

Logic · Mathematics 2008-01-03 Marie Ferbus-Zanda , Serge Grigorieff

We give a basic overview of computational complexity, query complexity, and communication complexity, with quantum information incorporated into each of these scenarios. The aim is to provide simple but clear definitions, and to highlight…

Quantum Physics · Physics 2016-11-23 Richard Cleve