English
Related papers

Related papers: Kolmogorov complexity as a combinatorial tool

200 papers

Kolmogorov complexity is the length of the ultimately compressed version of a file (that is, anything which can be put in a computer). Formally, it is the length of a shortest program from which the file can be reconstructed. We discuss the…

Information Theory · Computer Science 2020-04-22 Paul Vitanyi

We survey the diverse approaches to the notion of information content: from Shannon entropy to Kolmogorov complexity. The main applications of Kolmogorov complexity are presented namely, the mathematical notion of randomness (which goes…

Logic · Mathematics 2008-01-03 Marie Ferbus-Zanda , Serge Grigorieff

If no optimal propositional proof system exists, we (and independently Pudl\'ak) prove that ruling out length $t$ proofs of any unprovable sentence is hard. This mapping from unprovable to hard-to-prove sentences powerfully translates facts…

Computational Complexity · Computer Science 2023-04-04 Hunter Monroe

We survey diverse approaches to the notion of information: from Shannon entropy to Kolmogorov complexity. Two of the main applications of Kolmogorov complexity are presented: randomness and classification. The survey is divided in two parts…

Logic in Computer Science · Computer Science 2010-10-20 Marie Ferbus-Zanda , Serge Grigorieff

We suggest necessary conditions of soficness of multidimensional shifts formulated in termsof resource-bounded Kolmogorov complexity. Using this technique we provide examples ofeffective and non-sofic shifts on $\mathbb{Z}^2$ with very low…

Discrete Mathematics · Computer Science 2022-05-24 Julien Destombes , Andrei Romashchenko

Behavior of natural and artificial agents consists of behavioral episodes or acts. This study introduces a quantitative measure of behavioral acts -- their apparent complexity. The measure is based on the concept of the Kolmogorov…

Quantitative Methods · Quantitative Biology 2017-11-15 Andrei Olifer

This paper proves a Kolmogorov-complexity-flavored sufficient condition for a set to be attractive and discusses some consequences of this condition.

Logic · Mathematics 2025-05-06 Tiago Royer

The crucial but very confidential fact is brought into evidence that, as Kolmogorov himself repeatedly claimed, the mathematical theory of probabilities cannot be applied to physical, factual probabilistic situations because the factual…

Quantum Physics · Physics 2010-02-10 Mioara Mugur-Schachter

It is discussed and surveyed a numerical method proposed before, that alternative to the usual compression method, provides an approximation to the algorithmic (Kolmogorov) complexity, particularly useful for short strings for which…

Computational Complexity · Computer Science 2011-09-01 Hector Zenil , Jean-Paul Delahaye

This is a short introduction to Kolmogorov Complexity. The interested reader is referred to the text books by Cover & Thomas as well as Li & V\'itanyi, which cover the fields of information theory and Kolmogorov complexity in depth and with…

Computational Complexity · Computer Science 2010-05-17 Volker Nannen

While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing…

Statistics Theory · Mathematics 2007-07-16 Peter Gacs , John Tromp , Paul Vitanyi

Many combinatorial proofs rely on induction. When these proofs are formulated in traditional language, they can be bulky and unmanageable. Coalgebras provide a language which can reduce reduce many inductive proofs in graded poset theory to…

Combinatorics · Mathematics 2022-10-07 MLE Slone

Is it possible to find a shortest description for a binary string? The well-known answer is "no, Kolmogorov complexity is not computable." Faced with this barrier, one might instead seek a short list of candidates which includes a laconic…

Computational Complexity · Computer Science 2014-02-14 Jason Teutsch

We summarize our recent findings, where we proposed a framework for learning a Kolmogorov model, for a collection of binary random variables. More specifically, we derive conditions that link outcomes of specific random variables, and…

Machine Learning · Computer Science 2018-06-07 Hadi Ghauch , Mikael Skoglund , Hossein Shokri-Ghadikolaei , Carlo Fischione , Ali H. Sayed

Given a set X of finite strings, one interesting question to ask is whether there exists a member of X which is simple conditional to all other members of X. Conditional simplicity is measured by low conditional Kolmogorov complexity. We…

Computational Complexity · Computer Science 2021-02-09 Samuel Epstein

We consider the problem of inferring the probability distribution associated with a language, given data consisting of an infinite sequence of elements of the languge. We do this under two assumptions on the algorithms concerned: (i) like a…

Machine Learning · Computer Science 2014-07-16 Paul M. B. Vitanyi , Nick Chater

The paper presents the main characteristics and a preliminary implementation of a novel computational framework named CompLog. Inspired by probabilistic programming systems like ProbLog, CompLog builds upon the inferential mechanisms…

Artificial Intelligence · Computer Science 2023-09-12 Giovanni Sileno , Jean-Louis Dessalles

Algorithmic information theory studies description complexity and randomness and is now a well known field of theoretical computer science and mathematical logic. There are several textbooks and monographs devoted to this theory where one…

Information Theory · Computer Science 2015-04-21 Alexander Shen

Poset games have been the object of mathematical study for over a century, but little has been written on the computational complexity of determining important properties of these games. In this introduction we develop the fundamentals of…

Computational Complexity · Computer Science 2015-06-26 Stephen A. Fenner , John Rogers

An extractor is a function that receives some randomness and either "improves" it or produces "new" randomness. There are statistical and algorithmical specifications of this notion. We study an algorithmical one called Kolmogorov…

Computational Complexity · Computer Science 2012-03-19 Daniil Musatov