English
Related papers

Related papers: Kolmogorov Complexity Theory over the Reals

200 papers

This contribution investigates the computational complexity of simulating linear ordinary differential equations (ODEs) on digital computers. We provide an exact characterization of the complexity blowup for a class of ODEs of arbitrary…

Computational Complexity · Computer Science 2026-04-14 Adalbert Fono , Noah Wedlich , Holger Boche , Gitta Kutyniok

The main goal of this paper is to put some known results in a common perspective and to simplify their proofs. We start with a simple proof of a result from (Vereshchagin, 2002) saying that $\limsup_n\KS(x|n)$ (here $\KS(x|n)$ is…

Computational Complexity · Computer Science 2008-02-21 Laurent Bienvenu , Andrej Muchnik , Alexander Shen , Nikolay Vereshchagin

Turing Machines (TMs) are the canonical model of computation in computer science and physics. We combine techniques from algorithmic information theory and stochastic thermodynamics to analyze the thermodynamic costs of TMs. We consider two…

Statistical Mechanics · Physics 2023-08-06 Artemy Kolchinsky , David H. Wolpert

The paper proposes open problems in classical Kolmogorov complexity. Each problem is presented with background information and thus the article also surveys some recent studies in the area.

Information Theory · Computer Science 2022-03-30 Andrei Romashchenko , Alexander Shen , Marius Zimand

The even online Kolmogorov complexity of a string $x = x_1 x_2 \cdots x_{n}$ is the minimal length of a program that for all $i\le n/2$, on input $x_1x_3 \cdots x_{2i-1}$ outputs $x_{2i}$. The odd complexity is defined similarly. The sum of…

Computational Complexity · Computer Science 2025-07-15 Bruno Bauwens , Maria Marchenko

The (prefix-free) Kolmogorov complexity of a finite binary string is the length of the shortest description of the string. This gives rise to some `standard' lowness notions for reals: A is K-trivial if its initial segments have the lowest…

Logic · Mathematics 2014-10-15 Ian Herbert

We study the minimal complexity of tilings of a plane with a given tile set. We note that every tile set admits either no tiling or some tiling with O(n) Kolmogorov complexity of its n-by-n squares. We construct tile sets for which this…

Computational Complexity · Computer Science 2018-12-03 Bruno Durand , Leonid A. Levin , Alexander Shen

The clustering objects has become one of themes in many studies, and do not few researchers use the similarity to cluster the instances automatically. However, few research consider using Kommogorov Complexity to get information about…

Computational Complexity · Computer Science 2012-07-27 Mahyuddin K. M. Nasution

We show that numerical approximations of Kolmogorov complexity (K) applied to graph adjacency matrices capture some group-theoretic and topological properties of graphs and empirical networks ranging from metabolic to social networks. That…

Information Theory · Computer Science 2015-06-16 Hector Zenil , Fernando Soler-Toscano , Kamaludin Dingle , Ard A. Louis

This paper illustrates the richness of the concept of regular sets of time bounds and demonstrates its application to problems of computational complexity. There is a universe of bounds whose regular subsets allow to represent several time…

Computational Complexity · Computer Science 2013-09-24 Armin Hemmerling

Kolmogorov (1965) defined the complexity of a string $x$ as the minimal length of a program generating $x$. Obviously this definition depends on the choice of the programming language. Kolmogorov noted that there exist \emph{optimal}…

Information Theory · Computer Science 2025-06-23 Bruno Bauwens , Alexander Kozachinskiy , Alexander Shen

The normalized information distance is a universal distance measure for objects of all kinds. It is based on Kolmogorov complexity and thus uncomputable, but there are ways to utilize it. First, compression algorithms can be used to…

Information Retrieval · Computer Science 2008-09-16 Paul M. B. Vitanyi , Frank J. Balbach , Rudi L. Cilibrasi , Ming Li

While theoretical computer science primarily works with discrete models of computation, like the Turing machine and the wordRAM, there are many scenarios in which introducing real computation models is more adequate. We want to compare real…

Computational Complexity · Computer Science 2025-10-08 Thekla Hamm , Lucas Meijer , Tillmann Miltzow , Subhasree Patro

We prove various results connected together by the common thread of computability theory. First, we investigate a new notion of algorithmic dimension, the inescapable dimension, which lies between the effective Hausdorff and packing…

Logic · Mathematics 2022-09-14 David J. Webb

No free lunch theorems for supervised learning state that no learner can solve all problems or that all learners achieve exactly the same accuracy on average over a uniform distribution on learning problems. Accordingly, these theorems are…

Machine Learning · Computer Science 2024-06-11 Micah Goldblum , Marc Finzi , Keefer Rowan , Andrew Gordon Wilson

Information distance is a parameter-free similarity measure based on compression, used in pattern recognition, data mining, phylogeny, clustering, and classification. The notion of information distance is extended from pairs to multiples…

Computer Vision and Pattern Recognition · Computer Science 2009-05-21 Paul M. B. Vitanyi

We introduce a uniform representation of general objects that captures the regularities with respect to their structure. It allows a representation of a general class of objects including geometric patterns and images in a sparse, modular,…

Computational Complexity · Computer Science 2008-06-12 Hiroshi Ishikawa

Complexity theory can be viewed as the study of the relationship between computation and applications, understood the former as complexity classes and the latter as problems. Completeness results are clearly central to that view. Many…

Logic in Computer Science · Computer Science 2020-09-10 Flavio Ferrarotti , Senen Gonzalez , Klaus-Dieter Schewe , Jose Maria Turull-Torres

We describe an alternative method (to compression) that combines several theoretical and experimental results to numerically approximate the algorithmic (Kolmogorov-Chaitin) complexity of all $\sum_{n=1}^82^n$ bit strings up to 8 bits long,…

Information Theory · Computer Science 2015-03-18 Jean-Paul Delahaye , Hector Zenil

Computational complexity theory contains a corpus of theorems and conjectures regarding the time a Turing machine will need to solve certain types of problems as a function of the input size. Nature {\em need not} be a Turing machine and,…

Quantum Physics · Physics 2015-05-20 Javier Rodriguez-Laguna , Silvia N. Santalla