English
Related papers

Related papers: Nonuniform Kolmogorov extractors

200 papers

We provide tight upper and lower bounds on the expected minimum Kolmogorov complexity of binary classifiers that are consistent with labeled samples. The expected size is not more than complexity of the target concept plus the conditional…

Computational Complexity · Computer Science 2022-02-04 Samuel Epstein

A drawback of Kolmogorov-Chaitin complexity (K) as a function from s to the shortest program producing s is its noncomputability which limits its range of applicability. Moreover, when strings are short, the dependence of K on a particular…

Computational Complexity · Computer Science 2010-12-20 Jean-Paul Delahaye , Hector Zenil

By using the properties of the uniformly distributed sequences of real numbers on $(0,1)$, a short proof of a certain version of Kolmogorov strong law of large numbers is presented which essentially differs from Kolmogorov's original proof.

Probability · Mathematics 2016-01-13 Gogi R. Pantsulaia

Slice sampling is an efficient Markov Chain Monte Carlo algorithm to sample from an unnormalized density with acceptance ratio always $1$. However, when the variable to sample is unbounded, its "stepping-out" heuristic works only locally,…

Computation · Statistics 2020-10-06 Daichi Mochihashi

A border of a string is a non-empty prefix of the string that is also a suffix of the string, and a string is unbordered if it has no border other than itself. Loptev, Kucherov, and Starikovskaya [CPM 2015] conjectured the following: If we…

Data Structures and Algorithms · Computer Science 2018-12-18 Patrick Hagge Cording , Travis Gagie , Mathias Bæk Tejs Knudsen , Tomasz Kociumaka

This paper is motivated by a conjecture that BPP can be characterized in terms of polynomial-time nonadaptive reductions to the set of Kolmogorov-random strings. In this paper we show that an approach laid out in [Allender et al] to settle…

Computational Complexity · Computer Science 2015-07-01 Eric Allender , Harry Buhrman , Luke Friedman , Bruno Loff

In terms of the Dirac representation of sample mean and the weak convergence of empirical distributions that holds almost surely, we construct a new proof for a strong law of large numbers of Kolmogorov's type with i.i.d. random variables…

Probability · Mathematics 2020-09-02 Yu-Lin Chou

This paper considers estimation of a univariate density from an individual numerical sequence. It is assumed that (i) the limiting relative frequencies of the numerical sequence are governed by an unknown density, and (ii) there is a known…

Probability · Mathematics 2008-06-19 Andrew B. Nobel , Gusztav Morvai , Sanjeev R. Kulkarni

We provide, in an extremely simple way, an upper bound to the minimum number of unitary operators describing a general random-unitary channel.

Quantum Physics · Physics 2007-05-23 Francesco Buscemi

We investigate the problem of estimating the number of modes (i.e., local maxima) - a well known question in statistical inference - and we show how to do so without presmoothing the data. To this end, we modify the ideas of persistence…

Statistics Theory · Mathematics 2016-05-03 Ulrich Bauer , Axel Munk , Hannes Sieling , Max Wardetzky

We present an efficient algorithm that, given a discrete random variable $X$ and a number $m$, computes a random variable whose support is of size at most $m$ and whose Kolmogorov distance from $X$ is minimal, also for the one-sided…

Machine Learning · Statistics 2022-07-19 Liat Cohen , Tal Grinshpoun , Gera Weiss

It is shown that the Kolmogorov distance between the spectral distribution function of a random covariance matrix $\frac1p XX^T$, where $X$ is a $n\times p$ matrix with independent entries and the distribution function of the…

Probability · Mathematics 2007-12-24 F. Götze , A. Tikhomirov

We provide a unified method for constructing explicit distributions which are difficult for restricted models of computation to generate. Our constructions are based on a new notion of robust extractors, which are extractors that remain…

Computational Complexity · Computer Science 2026-05-11 Farzan Byramji , Daniel M. Kane , Jackson Morris , Anthony Ostuni

An extractor is a function that receives some randomness and either "improves" it or produces "new" randomness. There are statistical and algorithmical specifications of this notion. We study an algorithmical one called Kolmogorov…

Computational Complexity · Computer Science 2012-03-19 Daniil Musatov

A bounded Kolmogorov-Loveland selection rule is an adaptive strategy for recursively selecting a subsequence of an infinite binary sequence; such a subsequence may be interpreted as the query sequence of a time-bounded Turing machine. In…

Computational Complexity · Computer Science 2007-05-23 S. M. Kautz

The goal of randomness extraction is to distill (almost) perfect randomness from a weak source of randomness. When the source yields a classical string X, many extractor constructions are known. Yet, when considering a physical randomness…

Quantum Physics · Physics 2014-05-14 Mario Berta , Omar Fawzi , Stephanie Wehner

We consider the number of crossings in a random labelled tree with vertices in convex position. We give a new proof of the fact that this quantity is asymptotically Gaussian with mean $n^2/6$ and variance $n^3/45$. Furthermore, we give an…

Probability · Mathematics 2022-09-21 Santiago Arenas-Velilla , Octavio Arizmendi

The paper gives estimations for the sizes of the the following sets: (1) the set of strings that have a given dependency with a fixed string, (2) the set of strings that are pairwise \alpha independent, (3) the set of strings that are…

Computational Complexity · Computer Science 2015-05-19 Marius Zimand

How to generate provably true randomness with minimal assumptions? This question is important not only for the efficiency and the security of information processing, but also for understanding how extremely unpredictable events are possible…

Quantum Physics · Physics 2015-05-18 Kai-Min Chung , Yaoyun Shi , Xiaodi Wu

We show how to extend several basic concentration inequalities for simple random tensors $X = x_1 \otimes \cdots \otimes x_d$ where all $x_k$ are independent random vectors in $\mathbb{R}^n$ with independent coefficients. The new results…

Probability · Mathematics 2025-10-07 Roman Vershynin