English
Related papers

Related papers: Optimal redundancy in computations from random ora…

200 papers

We investigate the reason for the quantum speedup -- quantum algorithms requiring fewer computation steps than their classical counterparts. We extend their representation to the process of setting the problem. The initial measurement…

Quantum Physics · Physics 2015-10-26 Giuseppe Castagnoli

Dealing with the shear size and complexity of today's massive data sets requires computational platforms that can analyze data in a parallelized and distributed fashion. A major bottleneck that arises in such modern distributed computing…

Information Theory · Computer Science 2019-04-03 A. Salman Avestimehr , Seyed Mohammadreza Mousavi Kalan , Mahdi Soltanolkotabi

As parallelism becomes critically important in the semiconductor technology, high-performance computing, and cloud applications, parallel network systems will increasingly follow suit. Today, parallelism is an essential architectural…

Performance · Computer Science 2017-07-11 Anna Engelmann , Wolfgang Bziuk , Admela Jukan , Muriel Medard

Cyclic redundancy check (CRC) codes check if a codeword is correctly received. This paper presents an algorithm to design CRC codes that are optimized for the code-specific error behavior of a specified feedforward convolutional code. The…

Information Theory · Computer Science 2015-06-10 Chung-Yu Lou , Babak Daneshrad , Richard D. Wesel

Logistic Bandits have recently undergone careful scrutiny by virtue of their combined theoretical and practical relevance. This research effort delivered statistically efficient algorithms, improving the regret of previous strategies by…

Machine Learning · Computer Science 2022-01-20 Louis Faury , Marc Abeille , Kwang-Sung Jun , Clément Calauzènes

Avoiding overfitting is a central challenge in machine learning, yet many large neural networks readily achieve zero training loss. This puzzling contradiction necessitates new approaches to the study of overfitting. Here we quantify…

Information Theory · Computer Science 2022-10-13 Vudtiwat Ngampruetikorn , David J. Schwab

We consider the problem of communication over a network containing a hidden and malicious adversary that can control a subset of network resources, and aims to disrupt communications. We focus on omniscient node-based adversaries, i.e., the…

Information Theory · Computer Science 2016-05-09 Peida Tian , Sidharth Jaggi , Mayank Bakshi , Oliver Kosut

We address the problem of optimizing the throughput of network coded traffic in mobile networks operating in challenging environments where connectivity is intermittent and locally available memory space is limited. Random linear network…

Information Theory · Computer Science 2011-04-19 Gabriel Popa

Asymmetric Numeral Systems (ANS) is a class of entropy encoders that had an immense impact on the data compression, substituting arithmetic and Huffman coding. It was studied by different authors but the precise asymptotics of its…

Information Theory · Computer Science 2026-02-04 Dmitry Kosolobov

There are distributed graph algorithms for finding maximal matchings and maximal independent sets in $O(\Delta + \log^* n)$ communication rounds; here $n$ is the number of nodes and $\Delta$ is the maximum degree. The lower bound by Linial…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-13 Alkida Balliu , Sebastian Brandt , Juho Hirvonen , Dennis Olivetti , Mikaël Rabie , Jukka Suomela

In this paper, we introduce an achievability bound on the frame error rate of random tree code ensembles under a sequential decoding algorithm with a hard computational limit and consider the optimization of the random tree code ensembles…

Information Theory · Computer Science 2025-01-23 B. Tan Bacinoglu

Consider a sequence of bits where we are trying to predict the next bit from the previous bits. Assume we are allowed to say 'predict 0' or 'predict 1', and our payoff is +1 if the prediction is correct and -1 otherwise. We will say that at…

Data Structures and Algorithms · Computer Science 2012-10-11 Michael Kapralov , Rina Panigrahy

This paper presents a novel approach to address the constrained coding challenge of generating almost-balanced sequences. While strictly balanced sequences have been well studied in the past, the problem of designing efficient algorithms…

Information Theory · Computer Science 2024-05-15 Daniella Bar-Lev , Adir Kobovich , Orian Leitersdorf , Eitan Yaakobi

We analyze the Dawid-Rissanen prequential maximum likelihood codes relative to one-parameter exponential family models M. If data are i.i.d. according to an (essentially) arbitrary P, then the redundancy grows at rate c/2 ln n. We show that…

Machine Learning · Computer Science 2007-07-16 Peter Grunwald , Steven de Rooij

A Martin-L\"of test $\mathcal U$ is universal if it captures all non-Martin-L\"of random sequences, and it is optimal if for every ML-test $\mathcal V$ there is a $c \in \omega$ such that $\forall n(\mathcal{V}_{n+c} \subseteq…

Logic · Mathematics 2014-10-10 Rupert Hölzl , Paul Shafer

Erasure coding is a storage-efficient alternative to replication for achieving reliable data backup in distributed storage systems. During the storage process, traditional erasure codes require a unique source node to create and upload all…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Lluis Pamies-Juarez , Anwitaman Datta , Frédérique Oggier

Longest common extension queries (LCE queries) and runs are ubiquitous in algorithmic stringology. Linear-time algorithms computing runs and preprocessing for constant-time LCE queries have been known for over a decade. However, these…

Data Structures and Algorithms · Computer Science 2016-06-28 Maxime Crochemore , Costas S. Iliopoulos , Tomasz Kociumaka , Ritu Kundu , Solon P. Pissis , Jakub Radoszewski , Wojciech Rytter , Tomasz Waleń

A longstanding open problem in coding theory is to determine the best (asymptotic) rate $R_2(\delta)$ of binary codes with minimum constant (relative) distance $\delta$. An existential lower bound was given by Gilbert and Varshamov in the…

Information Theory · Computer Science 2021-12-20 Leonardo Nagami Coregliano , Fernando Granha Jeronimo , Chris Jones

A *dimension extractor* is an algorithm designed to increase the effective dimension -- i.e., the amount of computational randomness -- of an infinite binary sequence, in order to turn a "partially random" sequence into a "more random"…

Computational Complexity · Computer Science 2007-07-16 David Doty

Motivated by average-case trace reconstruction and coding for portable DNA-based storage systems, we initiate the study of \emph{coded trace reconstruction}, the design and analysis of high-rate efficiently encodable codes that can be…

Information Theory · Computer Science 2019-09-11 Mahdi Cheraghchi , Ryan Gabrys , Olgica Milenkovic , João Ribeiro