English
Related papers

Related papers: Possibilities and impossibilities in Kolmogorov co…

200 papers

We consider the problem of extracting randomness from \textit{sumset sources}, a general class of weak sources introduced by Chattopadhyay and Li (STOC, 2016). An $(n,k,C)$-sumset source $\mathbf{X}$ is a distribution on $\{0,1\}^n$ of the…

Computational Complexity · Computer Science 2021-10-26 Eshan Chattopadhyay , Jyun-Jie Liao

Since human randomness production has been studied and widely used to assess executive functions (especially inhibition), many measures have been suggested to assess the degree to which a sequence is random-like. However, each of them…

Computational Complexity · Computer Science 2013-12-10 Nicolas Gauvrit , Hector Zenil , Jean-Paul Delahaye , Fernando Soler-Toscano

We consider the problem of inferring the probability distribution associated with a language, given data consisting of an infinite sequence of elements of the languge. We do this under two assumptions on the algorithms concerned: (i) like a…

Machine Learning · Computer Science 2014-07-16 Paul M. B. Vitanyi , Nick Chater

Kolmogorov complexity theory is used to tell what the algorithmic informational content of a string is. It is defined as the length of the shortest program that describes the string. We present a programming language that can be used to…

Category Theory · Mathematics 2013-06-13 Noson S. Yanofsky

Consider a binary string $x$ of length $n$ whose Kolmogorov complexity is $\alpha n$ for some $\alpha<1$. We want to increase the complexity of $x$ by changing a small fraction of bits in $x$. This is always possible: Buhrman, Fortnow,…

Information Theory · Computer Science 2019-01-17 Gleb Posobin , Alexander Shen

An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality…

Computation and Language · Computer Science 2024-10-17 Gonçalo R. A. Faria , Sweta Agrawal , António Farinhas , Ricardo Rei , José G. C. de Souza , André F. T. Martins

A selection of the relevant theorems of Probability Theory that comes directly from Kolmogorov's axioms, Set Theory basic results, definitions and rules of inference are listed and proven in a systematic approach, aiming the student who…

General Mathematics · Mathematics 2022-06-14 Diego J. Raposo

Numerous definitions for complexity have been proposed over the last half century, with little consensus achieved on how to use the term. A definition of complexity is supplied here that is closely related to the Kolmogorov Complexity and…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Russell K. Standish

Quantum random-number generators (QRNGs) can offer a means to generate information-theoretically provable random numbers, in principle. In practice, unfortunately, the quantum randomness is inevitably mixed with classical randomness due to…

Quantum Physics · Physics 2013-06-25 Xiongfeng Ma , Feihu Xu , He Xu , Xiaoqing Tan , Bing Qi , Hoi-Kwong Lo

Kolmogorov complexity and algorithmic probability are defined only up to an additive resp. multiplicative constant, since their actual values depend on the choice of the universal reference computer. In this paper, we analyze a natural…

Information Theory · Computer Science 2010-03-29 Markus Mueller

Randomness is a valuable resource in science, cryptography, engineering, and information technology. Quantum-mechanical sources of randomness are attractive because of the indeterminism of individual quantum processes. Here we consider the…

A composite likelihood is an inference function derived by multiplying a set of likelihood components. This approach provides a flexible framework for drawing inference when the likelihood function of a statistical model is computationally…

Methodology · Statistics 2024-12-10 Giuseppe Alfonzetti , Ruggero Bellio , Yunxiao Chen , Irini Moustaki

One of the most fundamental problems in distribution testing is the identity testing problem: given samples $x_1,\ldots,x_s$, the goal is to determine whether the samples are drawn from a target distribution $\mathcal{D}$. When…

Quantum Physics · Physics 2026-05-15 Bruno Cavalar , Eli Goldin , Matthew Gray , Taiga Hiroka , Min-Hsiu Hsieh , Tomoyuki Morimae

The theory of random real numbers is exceedingly well-developed, and fascinating from many points of view. It is also quite challenging mathematically. The present notes are intended as no more than a gateway to the larger theory. They…

Computational Complexity · Computer Science 2012-09-14 Daniel Osherson , Scott Weinstein

We study the problem of extracting a prescribed number of random bits by reading the smallest possible number of symbols from non-ideal stochastic processes. The related interval algorithm proposed by Han and Hoshi has asymptotically…

Information Theory · Computer Science 2012-09-05 Hongchao Zhou , Jehoshua Bruck

Kolmogorov complexity is the length of the ultimately compressed version of a file (that is, anything which can be put in a computer). Formally, it is the length of a shortest program from which the file can be reconstructed. We discuss the…

Information Theory · Computer Science 2020-04-22 Paul Vitanyi

This paper is a comment on the paper "Quantum Mechanics and Algorithmic Randomness" was written by Ulvi Yurtsever \cite{Yurtsever} and the briefly explanation of the algorithmic randomness of quantum measurements results. There are…

Quantum Physics · Physics 2017-04-07 Mohammad Shahbazi

Kolmogorov (1965) defined the complexity of a string $x$ as the minimal length of a program generating $x$. Obviously this definition depends on the choice of the programming language. Kolmogorov noted that there exist \emph{optimal}…

Information Theory · Computer Science 2025-06-23 Bruno Bauwens , Alexander Kozachinskiy , Alexander Shen

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

Machine Learning · Statistics 2018-12-17 Matthew A. Olson , Abraham J. Wyner

It is impossible to effectively modify a string in order to increase its Kolmogorov complexity. But is it possible to construct a few strings, not longer than the input string, so that most of them have larger complexity? We show that the…

Computational Complexity · Computer Science 2017-02-07 Marius Zimand
‹ Prev 1 3 4 5 6 7 10 Next ›