English
Related papers

Related papers: Kolmogorov complexity and generalized length funct…

200 papers

Let $K$ denote prefix-free Kolmogorov Complexity, and $K^A$ denote it relative to an oracle $A$. We show that for any $n$, $K^{\emptyset^{(n)}}$ is definable purely in terms of the unrelativized notion $K$. It was already known that…

Logic · Mathematics 2022-08-08 Rodney Downey , Lu Liu , Keng Meng Ng , Daniel Turetsky

By Kolmogorov Complexity,two number-theoretic problems are solved in different way than before,one problem is Maxim Kontsevich and Don Bernard Zagier's Problem 3 \emph{Exhibit at least one number which does not belong to} $ \mathcal{P}$…

Number Theory · Mathematics 2016-10-24 Yang Bai , Xiuli Wang

Data complexity is an important concept in the natural sciences and related areas, but lacks a rigorous and computable definition. In this paper, we focus on a particular sense of complexity that is high if the data is structured in a way…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Louis Mahon

Infinite words, also known as streams, hold significant interest in computer science and mathematics, raising the natural question of how their complexity should be measured. We introduce cellular automaton reducibility as a measure of…

Formal Languages and Automata Theory · Computer Science 2026-01-30 Markel Zubia , Herman Geuvers

Shannon's entropy is a definitive lower bound for statistical compression. Unfortunately, no such clear measure exists for the compressibility of repetitive strings. Thus, ad hoc measures are employed to estimate the repetitiveness of…

Data Structures and Algorithms · Computer Science 2023-11-16 Giulia Bernardini , Gabriele Fici , Paweł Gawrychowski , Solon P. Pissis

The paper gives estimations for the sizes of the the following sets: (1) the set of strings that have a given dependency with a fixed string, (2) the set of strings that are pairwise \alpha independent, (3) the set of strings that are…

Computational Complexity · Computer Science 2015-05-19 Marius Zimand

Compression is at the heart of intelligence. A theoretically optimal way to compress any sequence of data is to find the shortest program that outputs that sequence and then halts. However, such 'Kolmogorov compression' is uncomputable, and…

Computation and Language · Computer Science 2025-03-19 Ori Yoran , Kunhao Zheng , Fabian Gloeckle , Jonas Gehring , Gabriel Synnaeve , Taco Cohen

Information distance can be defined not only between two strings but also in a finite multiset of strings of cardinality greater than two. We give an elementary proof for expressing the information distance in terms of plain Kolmogorov…

Information Theory · Computer Science 2019-08-29 P. M. B. Vitanyi

A new class of distances appropriate for measuring similarity relations between sequences, say one type of similarity per distance, is studied. We propose a new ``normalized information distance'', based on the noncomputable notion of…

Computational Complexity · Computer Science 2011-11-09 Ming Li , Xin Chen , Xin Li , Bin Ma , Paul Vitanyi

Recently, many results on the computational complexity of sorting algorithms were obtained using Kolmogorov complexity (the incompressibility method). Especially, the usually hard average-case analysis is ammenable to this method. Here we…

Data Structures and Algorithms · Computer Science 2009-05-28 Paul M. B. Vitanyi

Kolmogorov complexity and algorithmic probability are defined only up to an additive resp. multiplicative constant, since their actual values depend on the choice of the universal reference computer. In this paper, we analyze a natural…

Information Theory · Computer Science 2010-03-29 Markus Mueller

In this survey, we explore Andrei Nikolayevich Kolmogorov's seminal work in just one of his many facets: its influence Computer Science especially his viewpoint of what herein we call 'Algorithmic Theory of Informatics.' Can a computer file…

General Literature · Computer Science 2020-06-23 Sergei Levashkin , Victor Alexandrov , Adolfo Guzmán-Arenas

In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these…

Information Theory · Computer Science 2017-07-12 Hector Zenil , Narsis Kiani , Jesper Tegnér

Let $S_{T}(k)$ denote the set of distinct substrings of length $k$ in a string $T$, then the $k$-th substring complexity is defined by its cardinality $|S_{T}(k)|$. Recently, $\delta = \max \{ |S_{T}(k)| / k : k \ge 1 \}$ is shown to be a…

Data Structures and Algorithms · Computer Science 2022-05-26 Akiyoshi Kawamoto , Tomohiro I

A sumtest for a discrete semimeasure $P$ is a function $f$ mapping bitstrings to non-negative rational numbers such that \[ \sum P(x)f(x) \le 1 \,. \] Sumtests are the discrete analogue of Martin-L\"of tests. The behavior of sumtests for…

Computational Complexity · Computer Science 2013-12-09 Bruno Bauwens

In a genetic algorithm, fluctuations of the entropy of a genome over time are interpreted as fluctuations of the information that the genome's organism is storing about its environment, being this reflected in more complex organisms. The…

Computational Engineering, Finance, and Science · Computer Science 2010-11-04 Manuel Cebrian , Manuel Alfonseca , Alfonso Ortega

Recently the theory of widths of Kolmogorov-Gelfand has received a great deal of interest due to its close relationship with the newly born area of Compressive Sensing in Signal Processing. However fundamental problems of the theory of…

Numerical Analysis · Mathematics 2011-03-11 Ognyan Kounchev

A selection of the relevant theorems of Probability Theory that comes directly from Kolmogorov's axioms, Set Theory basic results, definitions and rules of inference are listed and proven in a systematic approach, aiming the student who…

General Mathematics · Mathematics 2022-06-14 Diego J. Raposo

Numerous definitions for complexity have been proposed over the last half century, with little consensus achieved on how to use the term. A definition of complexity is supplied here that is closely related to the Kolmogorov Complexity and…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Russell K. Standish

We propose a more general definition of generic-case complexity, based on using a random process for generating inputs of an algorithm and using the time needed to generate an input as a way of measuring the size of that input.

Computational Complexity · Computer Science 2015-05-14 Ilya Kapovich