English
Related papers

Related papers: Kolmogorov Complexity of Categories

200 papers

For every total recursive time bound $t$, a constant fraction of all compressible (low Kolmogorov complexity) strings is $t$-bounded incompressible (high time-bounded Kolmogorov complexity); there are uncountably many infinite sequences of…

Computational Complexity · Computer Science 2009-08-11 E. G. Daylight , W. M. Koolen , P. M. B. Vitanyi

A classical result by Floyd ("On the non-existence of a phrase structure grammar for ALGOL 60", 1962) states that the complete syntax of any sensible programming language cannot be described by the ordinary kind of formal grammars…

Formal Languages and Automata Theory · Computer Science 2020-12-08 Alexander Okhotin

The amount of information in satisfiability problem (SAT) is considered. SAT can be polynomial-time solvable when the solving algorithm holds an exponential amount of information. It is also established that SAT Kolmogorov complexity is…

Computational Complexity · Computer Science 2024-07-26 Maciej Drozdowski

We present progress on the experimental validation of a fundamental and universally applicable vulnerability analysis framework that is capable of identifying new types of vulnerabilities before attackers innovate attacks. This new…

Networking and Internet Architecture · Computer Science 2007-05-23 Stephen F. Bush , Todd Hughes

In addition to the equations, physicists use the following additional difficult-to-formalize property: that the initial conditions and the value of the parameters must not be abnormal. We will describe a natural formalization of this…

General Physics · Physics 2007-05-23 Isaak A. Kunin , Vladik Kreinovich , Yuri A. Kuperin

How best to quantify the information of an object, whether natural or artifact, is a problem of wide interest. A related problem is the computability of an object. We present practical examples of a new way to address this problem. By…

Artificial Intelligence · Computer Science 2011-06-14 Fionn Murtagh

Arranging the bits of a random string or real into k columns of a two-dimensional array or higher dimensional structure is typically accompanied with loss in the Kolmogorov complexity of the columns, which depends on k. We quantify and…

Logic · Mathematics 2026-02-19 George Barmpalias , Xiaoyan Zhang

This work presents a study of Kolmogorov complexity for general quantum states from the perspective of deterministic-control quantum Turing Machines (dcq-TM). We extend the dcq-TM model to incorporate mixed state inputs and outputs, and…

Quantum Physics · Physics 2024-01-24 Mariano Lemus , Ricardo Faleiro , Paulo Mateus , Nikola Paunković , André Souto

Algorithmic statistics studies explanations of observed data that are good in the algorithmic sense: an explanation should be simple i.e. should have small Kolmogorov complexity and capture all the algorithmically discoverable regularities…

Information Theory · Computer Science 2017-07-14 Alexey Milovanov

For a broad class of input-output maps, arguments based on the coding theorem from algorithmic information theory (AIT) predict that simple (low Kolmogorov complexity) outputs are exponentially more likely to occur upon uniform random…

Data Analysis, Statistics and Probability · Physics 2019-10-03 Kamaludin Dingle , Guillermo Valle Pérez , Ard A. Louis

Recently, many results on the computational complexity of sorting algorithms were obtained using Kolmogorov complexity (the incompressibility method). Especially, the usually hard average-case analysis is ammenable to this method. Here we…

Data Structures and Algorithms · Computer Science 2009-05-28 Paul M. B. Vitanyi

We study practical approximations to Kolmogorov prefix complexity (K) using IMP2, a high-level programming language. Our focus is on investigating the interpreter optimality for this language as the reference machine for the Coding Theorem…

Information Theory · Computer Science 2024-08-01 Zoe Leyva-Acosta , Eduardo Acuña Yeomans , Francisco Hernandez-Quiroz

We study the possibility of scaling down algorithmic information quantities in tuples of correlated strings. In particular, we address a question raised by Alexander Shen: whether, for any triple of strings $(a, b, c)$, there exists a…

Information Theory · Computer Science 2025-10-29 Andrei Romashchenko

Multivariate information theory provides a general and principled framework for understanding how the components of a complex system are connected. Existing analyses are coarse in nature -- built up from characterizations of discrete…

Information Theory · Computer Science 2025-05-30 Kieran A. Murphy , Yujing Zhang , Dani S. Bassett

The theory of computational complexity focuses on functions and, hence, studies programs whose interactive behavior is reduced to a simple question/answer pattern. We propose a broader theory whose ultimate goal is expressing and analyzing…

Computational Complexity · Computer Science 2012-09-05 Ugo Dal Lago , Tobias Heindel , Damiano Mazza , Daniele Varacca

TThe problem is to identify a probability associated with a set of natural numbers, given an infinite data sequence of elements from the set. If the given sequence is drawn i.i.d. and the probability mass function involved (the target)…

Machine Learning · Computer Science 2014-07-14 Paul M. B. Vitanyi , Nick Chater

We propose a measure based upon the fundamental theoretical concept in algorithmic information theory that provides a natural approach to the problem of evaluating $n$-dimensional complexity by using an $n$-dimensional deterministic Turing…

Computational Complexity · Computer Science 2015-08-27 Hector Zenil , Fernando Soler-Toscano , Jean-Paul Delahaye , Nicolas Gauvrit

After reviewing unnormalized and normalized information distances based on incomputable notions of Kolmogorov complexity, we discuss how Kolmogorov complexity can be approximated by data compression algorithms. We argue that optimal…

Computational Complexity · Computer Science 2007-05-23 Alexei Kaltchenko

The existence of string functions, which are not polynomial time computable, but whose graph is checkable in polynomial time, is a basic assumption in cryptography. We prove that in the framework of algebraic complexity, there are no such…

Computational Complexity · Computer Science 2018-12-18 Peter Bürgisser

This is a chapter in the Encyclopedia of Robotics. It is devoted to the study of complexity of complete (or exact) algorithms for robot motion planning. The term ``complete'' indicates that an approach is guaranteed to find the correct…

Robotics · Computer Science 2020-03-31 Kiril Solovey