English
Related papers

Related papers: Conditional Kolmogorov Complexity and Universal Pr…

200 papers

The Kolmogorov axioms for probability functions are placed in the context of signed meadows. A completeness theorem is stated and proven for the resulting equational theory of probability calculus. Elementary definitions of probability…

Logic · Mathematics 2016-12-23 Jan A. Bergstra , Alban Ponse

One implication of Bell's theorem is that there cannot in general be hidden variable models for quantum mechanics that both are noncontextual and retain the structure of a classical probability space. Thus, some hidden variable programs aim…

Quantum Physics · Physics 2017-02-01 Benjamin H. Feintzeig , Samuel C. Fletcher

The definition of conditional probability in case of continuous distributions was an important step in the development of mathematical theory of probabilities. How can we define this notion in algorithmic probability theory? In this survey…

Logic · Mathematics 2016-07-15 Bruno Bauwens , Alexander Shen , Hayato Takahashi

We provide another proof to the EL Theorem. We show the tradeoff between compressibility of codebooks and their communication capacity. A resource bounded version of the EL Theorem is proven. This is used to prove three instances of…

Computational Complexity · Computer Science 2023-09-13 Samuel Epstein

The multitime probability distributions obtained by repeatedly probing a quantum system via the measurement of an observable generally violate Kolmogorov's consistency property. Therefore, one cannot interpret such distributions as the…

We prove the formula C(a,b) = K(a|C(a,b)) + C(b|a,C(a,b)) + O(1) that expresses the plain complexity of a pair in terms of prefix and plain conditional complexities of its components.

Computational Complexity · Computer Science 2012-02-16 Bruno Bauwens , Alexander Shen

In 1933 Kolmogorov constructed a general theory that defines the modern concept of conditional probability. In 1955 Renyi fomulated a new axiomatic theory for probability motivated by the need to include unbounded measures. We introduce a…

Statistics Theory · Mathematics 2018-12-05 Gunnar Taraldsen , Jarle Tufto , Bo H. Lindqvist

Is it possible to find a shortest description for a binary string? The well-known answer is "no, Kolmogorov complexity is not computable." Faced with this barrier, one might instead seek a short list of candidates which includes a laconic…

Computational Complexity · Computer Science 2014-02-14 Jason Teutsch

The algorithmic Markov condition states that the most likely causal direction between two random variables X and Y can be identified as that direction with the lowest Kolmogorov complexity. Due to the halting problem, however, this notion…

Machine Learning · Computer Science 2017-02-23 Kailash Budhathoki , Jilles Vreeken

Diverse applications of Kolmogorov complexity to learning [CIKK16], circuit complexity [OPS19], cryptography [LP20], average-case complexity [Hir21], and proof search [Kra22] have been discovered in recent years. Since the running time of…

Computational Complexity · Computer Science 2022-05-31 Zhenjian Lu , Igor C. Oliveira

We introduce the notion of a probabilistic measure which takes values in hyperbolic numbers and which satisfies the system of axioms generalizing directly Kolmogorov's system of axioms. We show that this new measure verifies the usual…

Probability · Mathematics 2015-08-07 Daniel Alpay , Maria Elena Luna-Elizarrarás , Michael Shapiro

The Borel--Kolmogorov paradox of conditioning with respect to events of prior probability zero has fascinated students and researchers since its discovery more than 100 years ago. Classical conditioning is only valid with respect to events…

Probability · Mathematics 2022-04-04 Leon Bungert , Philipp Wacker

While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing…

Statistics Theory · Mathematics 2007-07-16 Peter Gacs , John Tromp , Paul Vitanyi

This paper studies sequence prediction based on the monotone Kolmogorov complexity Km=-log m, i.e. based on universal deterministic/one-part MDL. m is extremely close to Solomonoff's universal prior M, the latter being an excellent…

Information Theory · Computer Science 2007-07-16 Marcus Hutter

In addition to the equations, physicists use the following additional difficult-to-formalize property: that the initial conditions and the value of the parameters must not be abnormal. We will describe a natural formalization of this…

General Physics · Physics 2007-05-23 Isaak A. Kunin , Vladik Kreinovich , Yuri A. Kuperin

Quantization for a Borel probability measure refers to the idea of estimating a given probability by a discrete probability with support containing a finite number of elements. If in the quantization some of the elements in the support are…

Probability · Mathematics 2025-03-24 Pigar Biteng , Mathieu Caguiat , Tsianna Dominguez , Mrinal Kanti Roychowdhury

The word "complexity" is most often used as a meta--linguistic expression referring to certain intuitive characteristics of a natural system and/or its scientific description. These characteristics may include: sheer amount of data that…

History and Overview · Mathematics 2013-01-03 Yuri I. Manin

We show that by taking into account randomness of realization of experimental contexts it is possible to construct common Kolmogorov space for data collected for these contexts, although they can be incompatible. We call such a construction…

Quantum Physics · Physics 2015-06-19 Andrei Khrennikov

The underlying probabilistic theory for quantum mechanics is non-Kolmogorovian. The order in which physical observables will be important if they are incompatible (non-commuting). In particular, the notion of conditioning needs to be…

Quantum Physics · Physics 2019-07-30 John E. Gough

For a broad class of input-output maps, arguments based on the coding theorem from algorithmic information theory (AIT) predict that simple (low Kolmogorov complexity) outputs are exponentially more likely to occur upon uniform random…

Data Analysis, Statistics and Probability · Physics 2019-10-03 Kamaludin Dingle , Guillermo Valle Pérez , Ard A. Louis