English
Related papers

Related papers: Optimal Coding Theorems in Time-Bounded Kolmogorov…

200 papers

This paper considers the average complexity of maximum likelihood (ML) decoding of convolutional codes. ML decoding can be modeled as finding the most probable path taken through a Markov graph. Integrated with the Viterbi algorithm (VA),…

Information Theory · Computer Science 2016-11-17 Jie Luo

An infinite binary sequence has randomness rate at least $\sigma$ if, for almost every $n$, the Kolmogorov complexity of its prefix of length $n$ is at least $\sigma n$. It is known that for every rational $\sigma \in (0,1)$, on one hand,…

Computational Complexity · Computer Science 2009-02-13 Marius Zimand

We study the problem of sampling an approximately uniformly random satisfying assignment for atomic constraint satisfaction problems i.e. where each constraint is violated by only one assignment to its variables. Let $p$ denote the maximum…

Data Structures and Algorithms · Computer Science 2021-02-17 Vishesh Jain , Huy Tuan Pham , Thuy-Duong Vuong

We consider the classic Set Cover problem in the data stream model. For $n$ elements and $m$ sets ($m\geq n$) we give a $O(1/\delta)$-pass algorithm with a strongly sub-linear $\tilde{O}(mn^{\delta})$ space and logarithmic approximation…

Data Structures and Algorithms · Computer Science 2016-05-03 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi , Ali Vakilian

It has been known for almost three decades that many $\mathrm{NP}$-hard optimization problems can be solved in polynomial time when restricted to structures of constant treewidth. In this work we provide the first extension of such results…

Computational Complexity · Computer Science 2016-02-09 Mateus de Oliveira Oliveira

In the \textsc{Maximum Degree Contraction} problem, input is a graph $G$ on $n$ vertices, and integers $k, d$, and the objective is to check whether $G$ can be transformed into a graph of maximum degree at most $d$, using at most $k$ edge…

Data Structures and Algorithms · Computer Science 2020-09-25 Saket Saurabh , Prafullkumar Tale

Due to M\"{u}ller's theorem, the Kolmogorov complexity of a string was shown to be equal to its quantum Kolmogorov complexity. Thus there are no benefits to using quantum mechanics to compress classical information. The quantitative amount…

Computational Complexity · Computer Science 2024-07-04 Samuel Epstein

Joseph Miller [16] and independently Andre Nies, Frank Stephan and Sebastiaan Terwijn [18] gave a complexity characterization of 2-random sequences in terms of plain Kolmogorov complexity C: they are sequences that have infinitely many…

Information Theory · Computer Science 2013-10-22 Bruno Bauwens

Consider the problem of finding a population or a probability distribution amongst many with the largest mean when these means are unknown but population samples can be simulated or otherwise generated. Typically, by selecting largest…

Probability · Mathematics 2018-09-11 Peter Glynn , Sandeep Juneja

We study in which way Kolmogorov complexity and instance complexity affect properties of r.e. sets. We show that the well-known 2log n upper bound on the Kolmogorov complexity of initial segments of r.e.\ sets is optimal and characterize…

Logic · Mathematics 2009-09-25 Martin Kummer

In this paper, we present near-optimal space bounds for Lp-samplers. Given a stream of updates (additions and subtraction) to the coordinates of an underlying vector x \in R^n, a perfect Lp sampler outputs the i-th coordinate with…

Data Structures and Algorithms · Computer Science 2010-12-23 Hossein Jowhari , Mert Sağlam , Gábor Tardos

For many kinds of prefix-free codes there are efficient and compact alternatives to the traditional tree-based representation. Since these put the codes into canonical form, however, they can only be used when we can choose the order in…

Data Structures and Algorithms · Computer Science 2021-04-02 Antonio Fariña , Travis Gagie , Szymon Grabowski , Giovanni Manzini , Gonzalo Navarro , Alberto Ordóñez

There are distributed graph algorithms for finding maximal matchings and maximal independent sets in $O(\Delta + \log^* n)$ communication rounds; here $n$ is the number of nodes and $\Delta$ is the maximum degree. The lower bound by Linial…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-13 Alkida Balliu , Sebastian Brandt , Juho Hirvonen , Dennis Olivetti , Mikaël Rabie , Jukka Suomela

We study the density estimation problem defined as follows: given $k$ distributions $p_1, \ldots, p_k$ over a discrete domain $[n]$, as well as a collection of samples chosen from a ``query'' distribution $q$ over $[n]$, output $p_i$ that…

Data Structures and Algorithms · Computer Science 2024-10-31 Anders Aamand , Alexandr Andoni , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Haike Xu

We initiate a systematic study of pseudo-deterministic quantum algorithms. These are quantum algorithms that, for any input, output a canonical solution with high probability. Focusing on the query complexity model, our main contributions…

Quantum Physics · Physics 2026-02-20 Hugo Aaronson , Tom Gur , Jiawei Li

Text compression schemes and compact data structures usually combine sophisticated probability models with basic coding methods whose average codeword length closely match the entropy of known distributions. In the frequent case where basic…

Information Theory · Computer Science 2019-10-02 N. Jesper Larsson

This paper investigates the size in bits of the LZ77 encoding, which is the most popular and efficient variant of the Lempel-Ziv encodings used in data compression. We prove that, for a wide natural class of variable-length encoders for…

Discrete Mathematics · Computer Science 2018-01-10 Dmitry Kosolobov

In this work, we study the limits of compressed data structures, i.e., structures that support various queries on an input text $T\in\Sigma^n$ using space proportional to the size of $T$ in compressed form. Nearly all fundamental queries…

Data Structures and Algorithms · Computer Science 2025-10-23 Dominik Kempa , Tomasz Kociumaka

A Random Access query to a string $T\in [0..\sigma)^n$ asks for the character $T[i]$ at a given position $i\in [0..n)$. In $O(n\log\sigma)$ bits of space, this fundamental task admits constant-time queries. While this is optimal in the…

Data Structures and Algorithms · Computer Science 2026-05-13 Anouk Duyster , Tomasz Kociumaka

This paper studies expurgated random-coding bounds and exponents for channel coding with a given (possibly suboptimal) decoding rule. Variations of Gallager's analysis are presented, yielding several asymptotic and non-asymptotic bounds on…

Information Theory · Computer Science 2016-11-17 Jonathan Scarlett , Li Peng , Neri Merhav , Alfonso Martinez , Albert Guillén i Fàbregas