English
Related papers

Related papers: Possibilities and impossibilities in Kolmogorov co…

200 papers

We discuss an acceptance-rejection algorithm for the random number generation from the Kolmogorov distribution. Since the cumulative distribution function (CDF) is expressed as a series, in order to obtain the density function we need to…

Computation · Statistics 2022-08-30 Paolo Onorati , Brunero Liseo

Kolmogorov complexity of a finite binary word reflects both algorithmic structure and the empirical distribution of symbols appearing in the word. Words with symbol frequencies far from one half have smaller combinatorial richness and…

Computation · Statistics 2025-12-25 Brani Vidakovic

Given a reference computer, Kolmogorov complexity is a well defined function on all binary strings. In the standard approach, however, only the asymptotic properties of such functions are considered because they do not depend on the…

Machine Learning · Computer Science 2007-05-23 Andrei N. Soklakov

The rate of randomness (or dimension) of a string $\sigma$ is the ratio $C(\sigma)/|\sigma|$ where $C(\sigma)$ is the Kolmogorov complexity of $\sigma$. While it is known that a single computable transformation cannot increase the rate of…

Logic · Mathematics 2019-11-26 Laurent Bienvenu , Barbara F. Csima , Matthew Harrison-Trainor

While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing…

Statistics Theory · Mathematics 2007-07-16 Peter Gacs , John Tromp , Paul Vitanyi

In this article, we study a notion of the extraction rate of Turing functionals that translate between notions of randomness with respect to different underlying probability measures. We analyze several classes of extraction procedures: a…

Logic · Mathematics 2021-03-09 Douglas Cenzer , Christopher P. Porter

The main goal of this paper is to put some known results in a common perspective and to simplify their proofs. We start with a simple proof of a result from (Vereshchagin, 2002) saying that $\limsup_n\KS(x|n)$ (here $\KS(x|n)$ is…

Computational Complexity · Computer Science 2008-02-21 Laurent Bienvenu , Andrej Muchnik , Alexander Shen , Nikolay Vereshchagin

The information in an individual finite object (like a binary string) is commonly measured by its Kolmogorov complexity. One can divide that information into two parts: the information accounting for the useful regularity present in the…

Computational Complexity · Computer Science 2007-05-23 Paul Vitanyi

Some established and also novel techniques in the field of applications of algorithmic (Kolmogorov) complexity currently co-exist for the first time and are here reviewed, ranging from dominant ones such as statistical lossless compression…

Information Theory · Computer Science 2020-07-15 Hector Zenil

Randomness extraction is a key problem in cryptography and theoretical computer science. With the recent rapid development of quantum cryptography, quantum-proof randomness extraction has also been widely studied, addressing the security…

Quantum Physics · Physics 2024-01-15 Qian Li , Xiaoming Sun , Xingjian Zhang , Hongyi Zhou

Randomness extractors are algorithms that distill weak random sources into near-perfect random numbers. Two-source extractors enable this distillation process by combining two independent weak random sources. Raz's extractor (STOC '05) was…

Cryptography and Security · Computer Science 2025-06-19 Cameron Foreman , Lewis Wooltorton , Kevin Milner , Florian J. Curchod

Drawing on various notions from theoretical computer science, we present a novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings. The…

Information Theory · Computer Science 2015-03-13 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

We investigate topological, combinatorial, statistical, and enumeration properties of finite graphs with high Kolmogorov complexity (almost all graphs) using the novel incompressibility method. Example results are: (i) the mean and variance…

Combinatorics · Mathematics 2007-05-23 Harry Buhrman , Ming Li , John Tromp , Paul Vitanyi

In this paper we give a definition for quantum Kolmogorov complexity. In the classical setting, the Kolmogorov complexity of a string is the length of the shortest program that can produce this string as its output. It is a measure of the…

Quantum Physics · Physics 2007-05-23 Andre Berthiaume , Wim van Dam , Sophie Laplante

A method of random search based on Kolmogorov complexity is proposed and applied to two search problems in group theory. The method is provably effective but not practical, so the applications involve heuristic approximations. Perhaps…

Group Theory · Mathematics 2018-12-20 Robert H. Gilman

We summarize our recent findings, where we proposed a framework for learning a Kolmogorov model, for a collection of binary random variables. More specifically, we derive conditions that link outcomes of specific random variables, and…

Machine Learning · Computer Science 2018-06-07 Hadi Ghauch , Mikael Skoglund , Hossein Shokri-Ghadikolaei , Carlo Fischione , Ali H. Sayed

The word "complexity" is most often used as a meta--linguistic expression referring to certain intuitive characteristics of a natural system and/or its scientific description. These characteristics may include: sheer amount of data that…

History and Overview · Mathematics 2013-01-03 Yuri I. Manin

Depth of an object concerns a tradeoff between computation time and excess of program length over the shortest program length required to obtain the object. It gives an unconditional lower bound on the computation time from a given program…

Computational Complexity · Computer Science 2008-09-16 Luis Antunes , Armando Matos , Andre Souto , Paul Vitanyi

Although procedural generation is popular among game developers, academic research on the topic has primarily focused on new applications, with some research into empirical analysis. In this paper we relate theoretical work in information…

Artificial Intelligence · Computer Science 2023-05-04 Younès Rabii , Michael Cook

Randomness extraction against side information is the art of distilling from a given source a key which is almost uniform conditioned on the side information. This paper provides randomness extraction against quantum side information whose…

Information Theory · Computer Science 2019-11-11 Yodai Watanabe