English
Related papers

Related papers: Two-Dimensional Kolmogorov Complexity and Validati…

200 papers

Drawing on various notions from theoretical computer science, we present a novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings. The…

Information Theory · Computer Science 2015-03-13 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

We show that real-value approximations of Kolmogorov-Chaitin (K_m) using the algorithmic Coding theorem as calculated from the output frequency of a large set of small deterministic Turing machines with up to 5 states (and 2 symbols), is in…

Information Theory · Computer Science 2013-12-12 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

Computer science theory provides many different measures of complexity of a system including Kolmogorov complexity, logical depth, computational depth, and Levin complexity. However, these measures are all defined only for deterministic…

Computational Complexity · Computer Science 2025-08-05 David Wolpert , Jordan Scharnhorst

People solve different problems and know that some of them are simple, some are complex and some insoluble. The main goal of this work is to develop a mathematical theory of algorithmic complexity for problems. This theory is aimed at…

Computational Complexity · Computer Science 2008-07-08 Mark Burgin

TThe problem is to identify a probability associated with a set of natural numbers, given an infinite data sequence of elements from the set. If the given sequence is drawn i.i.d. and the probability mass function involved (the target)…

Machine Learning · Computer Science 2014-07-14 Paul M. B. Vitanyi , Nick Chater

We describe an alternative method (to compression) that combines several theoretical and experimental results to numerically approximate the algorithmic (Kolmogorov-Chaitin) complexity of all $\sum_{n=1}^82^n$ bit strings up to 8 bits long,…

Information Theory · Computer Science 2015-03-18 Jean-Paul Delahaye , Hector Zenil

While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing…

Statistics Theory · Mathematics 2007-07-16 Peter Gacs , John Tromp , Paul Vitanyi

The ability to precisely quantify similarity between various entities has been a fundamental complication in various problem spaces specifically in the classification of cellular images. Contemporary similarity measures applied in the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 D Yoan L. Mekontchou Yomba

Some established and also novel techniques in the field of applications of algorithmic (Kolmogorov) complexity currently co-exist for the first time and are here reviewed, ranging from dominant ones such as statistical lossless compression…

Information Theory · Computer Science 2020-07-15 Hector Zenil

We introduce a definition of algorithmic symmetry able to capture essential aspects of geometric symmetry. We review, study and apply a method for approximating the algorithmic complexity (also known as Kolmogorov-Chaitin complexity) of…

Computational Complexity · Computer Science 2018-03-07 Hector Zenil , Narsis A. Kiani , Jesper Tegnér

In Monoidal Computer I, we introduced a categorical model of computation where the formal reasoning about computability was supported by the simple and popular diagrammatic language of string diagrams. In the present paper, we refine and…

Logic in Computer Science · Computer Science 2014-02-25 Dusko Pavlovic

Kolmogorov complexity and algorithmic probability are defined only up to an additive resp. multiplicative constant, since their actual values depend on the choice of the universal reference computer. In this paper, we analyze a natural…

Information Theory · Computer Science 2010-03-29 Markus Mueller

In this paper, we introduce complexity-aware planning for finite-horizon deterministic finite automata with rewards as outputs, based on Kolmogorov complexity. Kolmogorov complexity is considered since it can detect computational…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Elis Stefansson , Karl H. Johansson

Given the widespread use of lossless compression algorithms to approximate algorithmic (Kolmogorov-Chaitin) complexity, and that lossless compression algorithms fall short at characterizing patterns other than statistical ones not different…

Information Theory · Computer Science 2017-08-15 Fernando Soler-Toscano , Hector Zenil

Previously referred to as `miraculous' in the scientific literature because of its powerful properties and its wide application as optimal solution to the problem of induction/inference, (approximations to) Algorithmic Probability (AP) and…

Information Theory · Computer Science 2018-04-16 Hector Zenil , Liliana Badillo , Santiago Hernández-Orozco , Francisco Hernández-Quiroz

Algorithmic statistics studies explanations of observed data that are good in the algorithmic sense: an explanation should be simple i.e. should have small Kolmogorov complexity and capture all the algorithmically discoverable regularities…

Information Theory · Computer Science 2017-07-14 Alexey Milovanov

1) We introduce random discrete Morse theory as a computational scheme to measure the complicatedness of a triangulation. The idea is to try to quantify the frequence of discrete Morse matchings with a certain number of critical cells. Our…

Computational Geometry · Computer Science 2014-04-21 Bruno Benedetti , Frank H. Lutz

Data Science and Machine learning have been growing strong for the past decade. We argue that to make the most of this exciting field we should resist the temptation of assuming that forecasting can be reduced to brute-force data analytics.…

Artificial Intelligence · Computer Science 2020-05-12 Hykel Hosni , Angelo Vulpiani

Algorithmic information theory studies description complexity and randomness and is now a well known field of theoretical computer science and mathematical logic. There are several textbooks and monographs devoted to this theory where one…

Information Theory · Computer Science 2015-04-21 Alexander Shen

We extend algorithmic information theory to quantum mechanics, taking a universal semicomputable density matrix (``universal probability'') as a starting point, and define complexity (an operator) as its negative logarithm. A number of…

Quantum Physics · Physics 2009-11-06 Peter Gacs
‹ Prev 1 2 3 10 Next ›