English
Related papers

Related papers: Generalized Universal Coding of Integers

200 papers

This paper sheds light on universal coding with respect to classes of memoryless sources over a countable alphabet defined by an envelope function with finite and non-decreasing hazard rate. We prove that the auto-censuring AC code…

Statistics Theory · Mathematics 2014-03-11 Dominique Bontemps , Stéphane Boucheron , Elisabeth Gassiat

Csisz\'ar's channel coding theorem for multiple codebooks is generalized allowing the codeword lenghts differ across codebooks. Also in this case, for each codebook an error exponent can be achieved that equals the random coding exponent…

Information Theory · Computer Science 2017-01-24 Lóránt Farkas , Tamás Kói

We present a novel autoencoder-based approach for designing codes that provide unequal error protection (UEP) capabilities. The proposed design is based on a generalization of an autoencoder loss function that accommodates both message-wise…

Information Theory · Computer Science 2021-04-19 Vukan Ninkovic , Dejan Vukobratovic , Christian Häger , Henk Wymeersch , Alexandre Graell i Amat

Constant entropy rate (conditional entropies must remain constant as the sequence length increases) and uniform information density (conditional probabilities must remain constant as the sequence length increases) are two information…

Statistical Mechanics · Physics 2014-12-03 Ramon Ferrer-i-Cancho , Łukasz Dębowski , Fermín Moscoso del Prado Martín

We discuss the interest of escort distributions and R\'enyi entropy in the context of source coding. We first recall a source coding theorem by Campbell relating a generalized measure of length to the R\'enyi-Tsallis entropy. We show that…

Mathematical Physics · Physics 2011-09-16 J. -F. Bercher

The generalized Hamming weight (GHW) $d_r(C)$ of linear codes $C$ is a natural generalization of the minimum Hamming distance $d(C)(=d_1(C))$ and has become one of important research objects in coding theory since Wei's originary work [23]…

Information Theory · Computer Science 2014-10-13 Minghui Yang , Jin Li , Keqin Feng , Dongdai Lin

For a given independent and identically distributed (i.i.d.) source, Huffman code achieves the optimal average codeword length in the class of instantaneous code with a single code table. However, it is known that there exist time-variant…

Information Theory · Computer Science 2022-09-20 Kengo Hashimoto , Ken-ichi Iwata

Bounds on the entropy of patterns of sequences generated by independently identically distributed (i.i.d.) sources are derived. A pattern is a sequence of indices that contains all consecutive integer indices in increasing order of first…

Information Theory · Computer Science 2007-07-13 Gil I. Shamir

This paper deals with a universal coding problem for a certain kind of multiterminal source coding network called a generalized complementary delivery network. In this network, messages from multiple correlated sources are jointly encoded,…

Information Theory · Computer Science 2009-04-02 Akisato Kimura , Tomohiko Uyematsu , Shigeaki Kuzuoka , Shun Watanabe

The concept of group divisible codes, a generalization of group divisible designs with constant block size, is introduced in this paper. This new class of codes is shown to be useful in recursive constructions for constant-weight and…

Information Theory · Computer Science 2008-07-18 Yeow Meng Chee , Gennian Ge , Alan C. H. Ling

The distance distribution of a code is the vector whose $i^\text{th}$ entry is the number of pairs of codewords with distance $i$. We investigate the structure of the distance distribution for cyclic orbit codes, which are subspace codes…

Information Theory · Computer Science 2019-12-12 Heide Gluesing-Luerssen , Hunter Lehmann

Recently, usage of detecting regions facilitated the discovery of new circuits for fault-tolerantly implementing the surface code. Building on these ideas, we present LUCI, a framework for constructing fault-tolerant circuits flexible…

Quantum Physics · Physics 2026-03-10 Dripto M. Debroy , Matt McEwen , Craig Gidney , Noah Shutty , Adam Zalcman

Guessing Codeword Decoding (GCD) is a recently proposed soft-input forward error correction decoder for arbitrary binary linear codes. Inspired by recent proposals that leverage binary linear codebook structure to reduce the number of…

Information Theory · Computer Science 2024-12-23 Joseph Griffin , Peihong Yuan , Ken R. Duffy , Muriel Medard

We consider coding schemes for computationally bounded channels, which can introduce an arbitrary set of errors as long as (a) the fraction of errors is bounded with high probability by a parameter $p$ and (b) the process which adds the…

Information Theory · Computer Science 2013-03-01 Venkatesan Guruswami , Adam Smith

Shannon entropy is the shortest average codeword length a lossless compressor can achieve by encoding i.i.d. symbols. However, there are cases in which the objective is to minimize the \textit{exponential} average codeword length, i.e. when…

Information Theory · Computer Science 2024-06-10 Andrea Somazzi , Paolo Ferragina , Diego Garlaschelli

A universal decoding procedure is proposed for the intersymbol interference (ISI) Gaussian channels. The universality of the proposed decoder is in the sense of being independent of the various channel parameters, and at the same time,…

Information Theory · Computer Science 2014-03-18 Wasim Huleihel , Neri Merhav

Quantum unitaries of the form $\Sigma_{c}\ket{c}\bra{c}\otimes U_{c}$ are ubiquitous in quantum algorithms. This class encompasses not only standard uniformly controlled gates (UCGs) but also a wide range of circuits with uniformly…

Quantum Physics · Physics 2025-12-11 Chengzhuo Xu , Xiao Chen , Xi Li , Zhihao Liu , Zhigang Li

For a character $\chi$ of a finite group $G$, the number cod$(\chi):=|G:\mathrm{ker}(\chi)|/\chi(1)$ is called the codegree of $\chi$.In this paper, we give a solvability criterion for a finite group $G$ depending on the minimum of the…

Group Theory · Mathematics 2022-08-17 Dongfang Yang , Yu Zeng , Heng Lv

Extended variants of the recently introduced spread unary coding are described. These schemes, in which the length of the code word is fixed, allow representation of approximately n^2 numbers for n bits, rather than the n numbers of the…

Information Theory · Computer Science 2015-02-04 Subhash Kak

The exact common information between a set of random variables $X_1,...,X_n$ is defined as the minimum entropy of a shared random variable that allows for the exact distributive simulation of $X_1,...,X_n$. It has been established that, in…

Information Theory · Computer Science 2024-07-09 Osama Hanna , Xinlin Li , Suhas Diggavi , Christina Fragouli