English
Related papers

Related papers: Erasure/list exponents for Slepian-Wolf decoding

200 papers

This paper studies variable-length (VL) source coding of general sources with side-information. Novel one-shot coding theorems for coding with common side-information available at the encoder and the decoder and Slepian- Wolf (SW) coding…

Information Theory · Computer Science 2014-04-09 Shigeaki Kuzuoka , Shun Watanabe

Large language models (LLMs) achieve remarkable generative performance, yet their output quality is dependent on the decoding strategy. While sampling-based methods (e.g., top-k, nucleus) and search-and-select based methods (e.g., beam…

Machine Learning · Computer Science 2026-05-12 Benjamin Patrick Evans , Sumitra Ganesh , Leo Ardon

We introduce and compare computational techniques for sharp extreme event probability estimates in stochastic differential equations with small additive Gaussian noise. In particular, we focus on strategies that are scalable, i.e. their…

Computation · Statistics 2023-11-27 Timo Schorlepp , Shanyin Tong , Tobias Grafke , Georg Stadler

We formulate the classical decoding algorithm of alternant codes afresh based on interpolation as in Sudan's list decoding of Reed-Solomon codes, and thus get rid of the key equation and the linear recurring sequences in the theory. The…

Information Theory · Computer Science 2007-07-13 Kwankyu Lee

Reed-Solomon (RS) codes are an important class of non-binary error-correction codes. They are particularly competent in correcting burst errors, being widely applied in modern communications and data storage systems. This also thanks to…

Information Theory · Computer Science 2026-02-02 Xiaoqian Ye , Jingyu Lin , Junjie Huang , Li Chen , Chang-An Zhao

List-decoding and list-recovery are important generalizations of unique decoding that received considerable attention over the years. However, the optimal trade-off among list-decoding (resp. list-recovery) radius, list size, and the code…

Information Theory · Computer Science 2021-12-13 Eitan Goldberg , Chong Shangguan , Itzhak Tamo

A new class of folded subspace codes for noncoherent network coding is presented. The codes can correct insertions and deletions beyond the unique decoding radius for any code rate $R\in[0,1]$. An efficient interpolation-based decoding…

Information Theory · Computer Science 2015-04-22 Hannes Bartz , Vladimir Sidorenko

Distributed arithmetic coding (DAC) has been shown to be effective for Slepian-Wolf coding, especially for short data blocks. In this letter, we propose to use the DAC to compress momery-correlated sources. More specifically, the…

Information Theory · Computer Science 2021-01-08 Yong Fang , Jechang Jeong

In this paper, we propose {\em distributed network compression via memory}. We consider two spatially separated sources with correlated unknown source parameters. We wish to study the universal compression of a sequence of length $n$ from…

Information Theory · Computer Science 2012-10-09 Ahmad Beirami , Faramarz Fekri

We obtain a technique to reduce the computational complexity associated with decoding of Hermitian codes. In particular, we propose a method to compute the error locations and values using an uni-variate error locator and an uni-variate…

Information Theory · Computer Science 2007-12-12 Rachit Agarwal

In this paper, we establish a lemma in algebraic coding theory that frequently appears in the encoding and decoding of, e.g., Reed-Solomon codes, algebraic geometry codes, and affine variety codes. Our lemma corresponds to the…

Information Theory · Computer Science 2016-11-17 Hajime Matsui

We investigate threshold-based multi-trial decoding of concatenated codes with an inner Maximum-Likelihood decoder and an outer error/erasure (L+1)/L-extended Bounded Distance decoder, i.e. a decoder which corrects e errors and t erasures…

Information Theory · Computer Science 2012-02-07 Christian Senger , Vladimir R. Sidorenko , Martin Bossert , Victor V. Zyablov

We present a development of parts of rate-distortion theory and pattern- matching algorithms for lossy data compression, centered around a lossy version of the Asymptotic Equipartition Property (AEP). This treatment closely parallels the…

Probability · Mathematics 2007-07-16 A. Dembo , I. Kontoyiannis

We show that the probability of the exceptional set decays exponentially for a broad class of randomized algorithms approximating solutions of ODEs, admitting a certain error decomposition. This class includes randomized explicit and…

Numerical Analysis · Mathematics 2022-02-04 Tomasz Bochacik

In this work, we introduce a framework to study the effect of random operations on the combinatorial list-decodability of a code. The operations we consider correspond to row and column operations on the matrix obtained from the code by…

Information Theory · Computer Science 2014-08-12 Atri Rudra , Mary Wootters

Polar codes are the first error-correcting code proven to achieve channel capacity based on infinite code length. The Successive Cancellation List Flip (SCLF) decoding algorithm was proposed by flipping an erroneous bit during the next…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Fu-Siang Liang , Shan Lu , Yeong-Luh Ueng

The problem of channel coding with the erasure option is revisited for discrete memoryless channels. The interplay between the code rate, the undetected and total error probabilities is characterized. Using the information spectrum method,…

Information Theory · Computer Science 2015-10-22 Masahito Hayashi , Vincent Y. F. Tan

We present adaptive on-line schemes for lossy encoding of individual sequences under the conditions of the Wyner-Ziv (WZ) problem. In the first part of this article, a set of fixed-rate scalar source codes with zero delay is presented. We…

Information Theory · Computer Science 2009-08-12 Avraham Reani , Neri Merhav

In this paper, we apply the Feature Space Decomposition (FSD) method developed in [LS24, GLS25, LSSW26, ALSS26] to obtain, under fairly general conditions, matching upper and lower bounds for the population excess risk of spectral methods…

Statistics Theory · Mathematics 2026-05-18 Guillaume Lecué , Zhifan Li , Zong Shang

In this paper, we analyze classical data compression with quantum side information (also known as the classical-quantum Slepian-Wolf protocol) in the so-called large and moderate deviation regimes. In the non-asymptotic setting, the…

Quantum Physics · Physics 2020-12-11 Hao-Chung Cheng , Eric P. Hanson , Nilanjana Datta , Min-Hsiu Hsieh