English
Related papers

Related papers: Redundancy Estimates for Word-Based Encoding of Se…

200 papers

Redundancy-aware extractive summarization systems score the redundancy of the sentences to be included in a summary either jointly with their salience information or separately as an additional sentence scoring step. Previous work shows the…

Computation and Language · Computer Science 2021-04-06 Keping Bi , Rahul Jha , W. Bruce Croft , Asli Celikyilmaz

This article is focused on some variations of Reed-Muller codes that yield improvements to the rate for a prescribed decoding performance under the Berlekamp-Massey-Sakata algorithm with majority voting. Explicit formulas for the…

Information Theory · Computer Science 2007-07-16 Maria Bras-Amorós , Michael E. O'Sullivan

The syntactic structure of a sentence is often represented using syntactic dependency trees. The sum of the distances between syntactically related words has been in the limelight for the past decades. Research on dependency distances led…

Computation and Language · Computer Science 2023-10-16 Lluís Alemany-Puig , Ramon Ferrer-i-Cancho

We consider the problem of constructing binary codes to recover from $k$-bit deletions with efficient encoding/decoding, for a fixed $k$. The single deletion case is well understood, with the Varshamov-Tenengolts-Levenshtein code from 1965…

Information Theory · Computer Science 2019-05-21 Joshua Brakensiek , Venkatesan Guruswami , Samuel Zbarsky

We investigate the stopping redundancy hierarchy of linear block codes and its connection to permutation decoding techniques. An element in the ordered list of stopping redundancy values represents the smallest number of possibly linearly…

Information Theory · Computer Science 2007-07-13 Thorsten Hehn , Olgica Milenkovic , Stefan Laendner , Johannes B. Huber

For zero-error function computation over directed acyclic networks, existing upper and lower bounds on the computation capacity are known to be loose. In this work we consider the problem of computing the arithmetic sum over a specific…

Information Theory · Computer Science 2016-01-28 Ardhendu Tripathy , Aditya Ramamoorthy

This document is written in order to establish a common base ground on which the majority of the relevant research about linear fountain codes can be analyzed and compared. As far as I am concerned, there is no unified approach that…

Information Theory · Computer Science 2014-07-16 Suayb S. Arslan

Over any discrete memoryless channel, we build codes such that: for one, their block error probabilities and code rates scale like random codes'; and for two, their encoding and decoding complexities scale like polar codes'. Quantitatively,…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

For variable-length coding with an almost-sure distortion constraint, Zhang et al. show that for discrete sources the redundancy is upper bounded by $\log n/n$ and lower bounded (in most cases) by $\log n/(2n)$, ignoring lower order terms.…

Information Theory · Computer Science 2026-01-21 Sharang M. Sriramu , Aaron B. Wagner

In this paper we provide a method to obtain tight lower bounds on the minimum redundancy achievable by a Huffman code when the probability distribution underlying an alphabet is only partially known. In particular, we address the case where…

Information Theory · Computer Science 2019-09-04 Ian Blanes , Miguel Hernández-Cabronero , Joan Serra-Sagristà , Michael W. Marcellin

In this paper we study the redundancy of Huffman codes. In particular, we consider sources for which the probability of one of the source symbols is known. We prove a conjecture of Ye and Yeung regarding the upper bound on the redundancy of…

Information Theory · Computer Science 2016-11-17 Soheil Mohajer , Payam Pakzad , Ali Kakhbod

The interest in channel models in which the data is sent as an unordered set of binary strings has increased lately, due to emerging applications in DNA storage, among others. In this paper we analyze the minimal redundancy of binary codes…

Information Theory · Computer Science 2019-10-29 Jin Sima , Netanel Raviv , Jehoshua Bruck

Consider a linear [n,k,d]_q code C. We say that that i-th coordinate of C has locality r, if the value at this coordinate can be recovered from accessing some other r coordinates of C. Data storage applications require codes with small…

Information Theory · Computer Science 2011-06-21 Parikshit Gopalan , Cheng Huang , Huseyin Simitci , Sergey Yekhanin

We consider computing systems that partition jobs into tasks, add redundancy through coding, and assign the encoded tasks to different computing nodes for parallel execution. The expected execution time depends on the level of redundancy.…

Information Theory · Computer Science 2025-10-29 Swapnil Saha , Emina Soljanin , Philip Whiting

Universal compression of patterns of sequences generated by independently identically distributed (i.i.d.) sources with unknown, possibly large, alphabets is investigated. A pattern is a sequence of indices that contains all consecutive…

Information Theory · Computer Science 2016-11-17 Gil I. Shamir

Reliability is an inherent challenge for the emerging nonvolatile technology of racetrack memories, and there exists a fundamental relationship between codes designed for racetrack memories and codes with constrained periodicity. Previous…

Information Theory · Computer Science 2022-08-29 Adir Kobovich , Orian Leitersdorf , Daniella Bar-Lev , Eitan Yaakobi

Large-scale distributed storage systems typically use erasure codes to provide durability of data in the face of failures. A set of $k$ blocks to be stored is encoded using an $[n, k]$ code to generate $n$ blocks that are then stored on…

Information Theory · Computer Science 2019-07-31 Francisco Maturana , K. V. Rashmi

The order statistics based list decoding techniques for linear binary block codes of small to medium block length are investigated. The construction of the list of the test error patterns is considered. The original order statistics…

Information Theory · Computer Science 2011-01-27 Saif E. A. Alnawayseh , Pavel Loskot

We study codes that can detect the exact number of deletions and insertions in concatenated binary strings. We construct optimal codes for the case of detecting up to $\del$ deletions. We prove the optimality of these codes by deriving a…

Information Theory · Computer Science 2021-05-04 Serge Kas Hanna , Rawad Bitar

The AWGNC, BSC, and max-fractional pseudocodeword redundancy of a code is defined as the smallest number of rows in a parity-check matrix such that the corresponding minimum pseudoweight is equal to the minimum Hamming distance of the code.…

Information Theory · Computer Science 2010-05-20 Jens Zumbragel , Mark F. Flanagan , Vitaly Skachek