English
Related papers

Related papers: The Extremum Stack is a Minimal Sufficient Statist…

200 papers

The classical coding theorem in Kolmogorov complexity states that if an $n$-bit string $x$ is sampled with probability $\delta$ by an algorithm with prefix-free domain then K$(x) \leq \log(1/\delta) + O(1)$. In a recent work, Lu and…

Computational Complexity · Computer Science 2022-04-19 Zhenjian Lu , Igor C. Oliveira , Marius Zimand

According to Kolmogorov complexity, every finite binary string is compressible to a shortest code -- its information content -- from which it is effectively recoverable. We investigate the extent to which this holds for infinite binary…

Information Theory · Computer Science 2019-01-23 George Barmpalias , Andrew Lewis-Pye

While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing…

Statistics Theory · Mathematics 2007-07-16 Peter Gacs , John Tromp , Paul Vitanyi

In 1974 Kolmogorov proposed a non-probabilistic approach to statistics and model selection. Let data be finite binary strings and models be finite sets of binary strings. Consider model classes consisting of models of given maximal…

Computational Complexity · Computer Science 2007-05-23 Nikolai Vereshchagin , Paul Vitanyi

A drawback of Kolmogorov-Chaitin complexity (K) as a function from s to the shortest program producing s is its noncomputability which limits its range of applicability. Moreover, when strings are short, the dependence of K on a particular…

Computational Complexity · Computer Science 2010-12-20 Jean-Paul Delahaye , Hector Zenil

The Kolmogorov complexity of x, denoted C(x), is the length of the shortest program that generates x. For such a simple definition, Kolmogorov complexity has a rich and deep theory, as well as applications to a wide variety of topics…

Computational Complexity · Computer Science 2017-02-17 Stephen Fenner , Lance Fortnow

We present an efficient algorithm that, given a discrete random variable $X$ and a number $m$, computes a random variable whose support is of size at most $m$ and whose Kolmogorov distance from $X$ is minimal, also for the one-sided…

Machine Learning · Statistics 2022-07-19 Liat Cohen , Tal Grinshpoun , Gera Weiss

We consider sufficient conditions for the existence of $k$-th powers of Hamiltonian cycles in $n$-vertex graphs $G$ with minimum degree $\mu n$ for arbitrarily small $\mu>0$. About 20 years ago Koml\'os, Sark\"ozy, and Szemer\'edi resolved…

Combinatorics · Mathematics 2019-10-01 Oliver Ebsen , Giulia S. Maesaka , Christian Reiher , Mathias Schacht , Bjarne Schülke

The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to…

Computational Complexity · Computer Science 2024-09-20 Shuichi Hirahara , Zhenjian Lu , Mikito Nanashima

We give the first almost-linear time algorithm for computing the \emph{maximal $k$-edge-connected subgraphs} of an undirected unweighted graph for any constant $k$. More specifically, given an $n$-vertex $m$-edge graph $G=(V,E)$ and a…

Data Structures and Algorithms · Computer Science 2023-07-04 Thatchaphol Saranurak , Wuwei Yuan

We introduce a machine free mathematical framework to get a natural formalization of some general notions of infinite computation in the context of Kolmogorov complexity. Namely, the classes Max^{X\to D}_{PR} and Max^{X\to D}_{Rec} of…

Logic · Mathematics 2008-01-07 Marie Ferbus-Zanda , Serge Grigorieff

In this paper we present a simple but powerful subgraph sampling primitive that is applicable in a variety of computational models including dynamic graph streams (where the input graph is defined by a sequence of edge/hyperedge insertions…

Data Structures and Algorithms · Computer Science 2015-05-08 Rajesh Chitnis , Graham Cormode , Hossein Esfandiari , MohammadTaghi Hajiaghayi , Andrew McGregor , Morteza Monemizadeh , Sofya Vorotnikova

We show that real-value approximations of Kolmogorov-Chaitin (K_m) using the algorithmic Coding theorem as calculated from the output frequency of a large set of small deterministic Turing machines with up to 5 states (and 2 symbols), is in…

Information Theory · Computer Science 2013-12-12 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

Given an edge-weighted graph, how many minimum $k$-cuts can it have? This is a fundamental question in the intersection of algorithms, extremal combinatorics, and graph theory. It is particularly interesting in that the best known bounds…

Data Structures and Algorithms · Computer Science 2019-06-04 Anupam Gupta , Euiwoong Lee , Jason Li

The minimum degree algorithm is one of the most widely-used heuristics for reducing the cost of solving large sparse systems of linear equations. It has been studied for nearly half a century and has a rich history of bridging techniques…

Data Structures and Algorithms · Computer Science 2023-04-11 Robert Cummings , Matthew Fahrbach , Animesh Fatehpuria

Algorithmic statistics studies explanations of observed data that are good in the algorithmic sense: an explanation should be simple i.e. should have small Kolmogorov complexity and capture all the algorithmically discoverable regularities…

Information Theory · Computer Science 2017-07-14 Alexey Milovanov

We use the incompressibility method based on Kolmogorov complexity to determine the total number of bits of routing information for almost all network topologies. In most models for routing, for almost all labeled graphs $\Theta (n^2)$ bits…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Harry Buhrman , Jaap-Henk Hoepman , Paul Vitanyi

We study deterministic extractors for oblivious bit-fixing sources (a.k.a. resilient functions) and exposure-resilient functions with small min-entropy: of the function's n input bits, k << n bits are uniformly random and unknown to the…

Computational Complexity · Computer Science 2010-12-14 Yakir Reshef , Salil Vadhan

An infinite binary sequence has randomness rate at least $\sigma$ if, for almost every $n$, the Kolmogorov complexity of its prefix of length $n$ is at least $\sigma n$. It is known that for every rational $\sigma \in (0,1)$, on one hand,…

Computational Complexity · Computer Science 2009-02-13 Marius Zimand

In the $k$-cut problem, we are given an edge-weighted graph and want to find the least-weight set of edges whose deletion breaks the graph into $k$ connected components. Algorithms due to Karger-Stein and Thorup showed how to find such a…

Data Structures and Algorithms · Computer Science 2019-11-22 Anupam Gupta , Euiwoong Lee , Jason Li
‹ Prev 1 2 3 10 Next ›