English
Related papers

Related papers: Non prefix-free codes for constrained sequences

200 papers

A rateless code-i.e., a rate-compatible family of codes-has the property that codewords of the higher rate codes are prefixes of those of the lower rate ones. A perfect family of such codes is one in which each of the codes in the family is…

Information Theory · Computer Science 2011-06-07 Uri Erez , Mitchell D. Trott , Gregory W. Wornell

Using a mild variant of polar codes we design linear compression schemes compressing Hidden Markov sources (where the source is a Markov chain, but whose state is not necessarily observable from its output), and to decode from Hidden Markov…

Information Theory · Computer Science 2018-10-05 Venkatesan Guruswami , Preetum Nakkiran , Madhu Sudan

The following learning problem arises naturally in various applications: Given a finite sample from a categorical or count time series, can we learn a function of the sample that (nearly) maximizes the probability of correctly guessing the…

Statistics Theory · Mathematics 2026-05-27 J. -R. Chazottes , S. Gallo , D. Takahashi

Random Linear Network Coding (RLNC) provides a theoretically efficient method for coding. Some of its practical drawbacks are the complexity of decoding and the overhead due to the coding vectors. For computationally weak and battery-driven…

Networking and Internet Architecture · Computer Science 2015-09-16 Janus Heide , Morten V. Pedersen , Frank H. P. Fitzek , Muriel M edard

In this paper, we propose a source coding scheme that represents data from unknown distributions through frequency and support information. Existing encoding schemes often compress data by sacrificing computational efficiency or by assuming…

Information Theory · Computer Science 2024-10-28 Leah Woldemariam , Hang Liu , Anna Scaglione

This study investigates the fundamental limits of variable-length compression in which prefix-free constraints are not imposed (i.e., one-to-one codes are studied) and non-vanishing error probabilities are permitted. Due in part to a…

Information Theory · Computer Science 2021-10-05 Yuta Sakai , Recep Can Yavas , Vincent Y. F. Tan

This paper proposes a novel joint non-binary network-channel code for the Time-Division Decode-and-Forward Multiple Access Relay Channel (TD-DF-MARC), where the relay linearly combines -- over a non-binary finite field -- the coded…

Information Theory · Computer Science 2016-11-15 Mikel Hernaez , Pedro M. Crespo , Javier Del Ser

This paper introduces a novel framework for end-to-end learned video coding. Image compression is generalized through conditional coding to exploit information from reference frames, allowing to process intra and inter frames with the same…

Image and Video Processing · Electrical Eng. & Systems 2021-04-29 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Déforges

We investigate weakly constrained codes, in which specific patterns occur with prescribed frequencies rather than being strictly forbidden as in conventional constrained coding. We propose a capacity-achieving construction of a weakly…

Information Theory · Computer Science 2026-05-22 Prachi Mishra , Sidharth Jaggi , Navin Kashyap , Michael Langberg

The arbitrarily varying channel (AVC) is a channel model whose state is selected maliciously by an adversary. Fixed-blocklength coding assumes a worst-case bound on the adversary's capabilities, which leads to pessimistic results. This…

Information Theory · Computer Science 2009-10-06 Anand D. Sarwate , Michael Gastpar

For the discrete memoryless sources with a countably infinite alphabet, we prove that for any positive integer $k$, there exists a corresponding probability interval such that if the largest symbol probability $p_{1}$ falls in this…

Information Theory · Computer Science 2026-04-21 Hongyang Liu , Wei Yan

One key requirement for fountain (rateless) coding schemes is to achieve a high intermediate symbol recovery rate. Recent coding schemes have incorporated the use of a feedback channel to improve intermediate performance of traditional…

Information Theory · Computer Science 2016-11-17 Morteza Hashemi , Yuval Cassuto , Ari Trachtenberg

Universally decodable matrices can be used for coding purposes when transmitting over slow fading channels. These matrices are parameterized by positive integers $L$ and $n$ and a prime power $q$. Based on Pascal's triangle we give an…

Information Theory · Computer Science 2007-07-13 Pascal O. Vontobel , Ashwin Ganesan

We study the problem of transmitting classical information using quantum Gaussian states on a family of phase-noise channels with a finite decoherence time, such that the phase-reference is lost after $m$ consecutive uses of the…

Conditional Random Field (CRF) based neural models are among the most performant methods for solving sequence labeling problems. Despite its great success, CRF has the shortcoming of occasionally generating illegal sequences of tags, e.g.…

Machine Learning · Computer Science 2021-03-22 Tianwen Wei , Jianwei Qi , Shenghuan He , Songtao Sun

In this paper we analyze a specific class of rateless codes, called LT codes with unequal recovery time. These codes provide the option of prioritizing different segments of the transmitted data over other. The result is that segments are…

Information Theory · Computer Science 2012-04-23 Jesper H. Sørensen , Petar Popovski , Jan Østergaard

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

Continuous-variable cat codes are encodings into a single photonic or phononic mode that offer a promising avenue for hardware-efficient fault-tolerant quantum computation. Protecting information in a cat code requires measuring the mode's…

Quantum Physics · Physics 2025-11-12 Yijia Xu , Yixu Wang , Christophe Vuillot , Victor V. Albert

We observe that the technique of Markov contraction can be used to establish measure concentration for a broad class of non-contracting chains. In particular, geometric ergodicity provides a simple and versatile framework. This leads to a…

Probability · Mathematics 2013-12-06 Aryeh Kontorovich , Roi Weiss

Necessary conditions for asymptotically optimal sliding-block or stationary codes for source coding and rate-constrained simulation of memoryless sources are presented and used to motivate a design technique for trellis-encoded source…

Information Theory · Computer Science 2011-02-24 Mark Z. Mao , Robert M. Gray , Tamas Linder