English
Related papers

Related papers: Good Concatenated Code Ensembles for the Binary Er…

200 papers

This paper presents and analyzes a novel concatenated coding scheme for enabling error resilience in two distributed storage settings: one being storage using existing regenerating codes and the second being storage using locally repairable…

Information Theory · Computer Science 2013-12-12 Natalia Silberstein , Ankit Singh Rawat , Sriram Vishwanath

Retrieval-augmented code generation often conditions the decoder on large retrieved code snippets. This ties online inference cost to repository size and introduces noise from long contexts. We present Hierarchical Embedding Fusion (HEF), a…

Computation and Language · Computer Science 2026-03-10 Nikita Sorokin , Ivan Sedykh , Valentin Malykh

By a locally recoverable code (LRC), we will in this paper, mean a linear code in which a given code symbol can be recovered by taking a linear combination of at most $r$ other code symbols with $r << k$. A natural extension is to the local…

Information Theory · Computer Science 2018-12-07 S. B. Balaji , Ganesh R. Kini , P. Vijay Kumar

In this paper we study the iterative decoding threshold performance of non-binary spatially-coupled low-density parity-check (NB-SC-LDPC) code ensembles for both the binary erasure channel (BEC) and the binary-input additive white Gaussian…

Information Theory · Computer Science 2016-11-18 Lai Wei , Toshiaki Koike-Akino , David G. M. Mitchell , Thomas E. Fuja , Daniel J. Costello

Recent works on learned image compression perform encoding and decoding processes in a full-resolution manner, resulting in two problems when deployed for practical applications. First, parallel acceleration of the autoregressive entropy…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Yaojun Wu , Xin Li , Zhizheng Zhang , Xin Jin , Zhibo Chen

Irregular repeat-accumulate Root-Check LDPC codes based on Progressive Edge Growth (PEG) techniques for block-fading channels are proposed. The proposed Root-Check LDPC codes are {both suitable for channels under $F = 2, 3$ independent…

Information Theory · Computer Science 2014-02-25 A. G. D. Uchoa , C. T. Healy , R. C. de Lamare

Automorphism Ensemble (AE) decoding has recently drawn attention as a possible alternative to list decoding of polar codes. In this letter, we investigate the distribution of Partially-Symmetric Reed-Muller (PS-RM) codes, a family of polar…

Information Theory · Computer Science 2023-08-07 Charles Pillet , Valerio Bioglio , Pascal Giard

We study the application of polar codes in deletion channels by analyzing the cascade of a binary erasure channel (BEC) and a deletion channel. We show how polar codes can be used effectively on a BEC with a single deletion, and propose a…

Information Theory · Computer Science 2017-01-10 Eldho K. Thomas , Vincent Y. F. Tan , Alexander Vardy , Mehul Motani

Hadamard transform~(HT) as over the binary field provides a natural way to implement multiple-rate codes~(referred to as {\em HT-coset codes}), where the code length $N=2^p$ is fixed but the code dimension $K$ can be varied from $1$ to…

Information Theory · Computer Science 2023-07-19 Chulong Liang , Jingnan Hu , Xiao Ma , Baoming Bai

Recently, rate-$1/\omega$ zero-terminated and tail-biting convolutional codes (ZTCCs and TBCCs) with cyclic-redundancy-check (CRC)-aided list decoding have been shown to closely approach the random-coding union (RCU) bound for short…

Information Theory · Computer Science 2022-06-09 Wenhui Sui , Hengjie Yang , Brendan Towell , Ava Asmani , Richard D. Wesel

Ensemble models are widely used to solve complex tasks by their decomposition into multiple simpler tasks, each one solved locally by a single member of the ensemble. Decoding of error-correction codes is a hard problem due to the curse of…

Information Theory · Computer Science 2020-05-12 Tomer Raviv , Nir Raviv , Yair Be'ery

Assuming iterative decoding for binary erasure channels (BECs), a novel tree-based technique for upper bounding the bit error rates (BERs) of arbitrary, finite low-density parity-check (LDPC) codes is provided and the resulting bound can be…

Information Theory · Computer Science 2007-07-13 Chih-Chun Wang , Sanjeev R. Kulkarni , H. Vincent Poor

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

The paper provides a new perspective on peak- and average-constrained Gaussian channels. Such channels model optical wireless communication (OWC) systems which employ intensity-modulation with direct detection (IM/DD). First, the paper…

Information Theory · Computer Science 2023-03-20 Sarah Bahanshal , Ahmad Abdel-Qader , Anas Chaaban

Recent research has shown the great potential of deep learning algorithms in the hyperspectral image (HSI) classification task. Nevertheless, training these models usually requires a large amount of labeled data. Since the collection of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yonghao Xu , Bo Du , Liangpei Zhang

The capacity of a channel with an energy-harvesting (EH) encoder and a finite battery remains an open problem, even in the noiseless case. A key instance of this scenario is the binary EH channel (BEHC), where the encoder has a unit-sized…

Information Theory · Computer Science 2025-02-12 Eli Shemuel , Oron Sabag , Haim H. Permuter

We recently showed in [1] the superiority of certain structured coding matrices ensembles (such as partial row-orthogonal) for sparse superposition codes when compared with purely random matrices with i.i.d. entries, both…

Information Theory · Computer Science 2022-07-12 YuHao Liu , Teng Fu , Jean Barbier , TianQi Hou

We propose a universal ensemble for random selection of rate-distortion codes, which is asymptotically optimal in a sample-wise sense. According to this ensemble, each reproduction vector, $\hbx$, is selected independently at random under…

Information Theory · Computer Science 2022-12-26 Neri Merhav

This paper considers the performance of Reed-Muller (RM) codes transmitted over binary memoryless symmetric (BMS) channels under bitwise maximum-a-posteriori (bit-MAP) decoding. Its main result is that, for a fixed BMS channel, the family…

Information Theory · Computer Science 2023-06-14 Galen Reeves , Henry D. Pfister

We introduce a new erasure decoder that applies to arbitrary quantum LDPC codes. Dubbed the cluster decoder, it generalizes the decomposition idea of Vertical-Horizontal (VH) decoding introduced by Connelly et al. in 2022. Like the VH…

Information Theory · Computer Science 2024-12-13 Hanwen Yao , Mert Gökduman , Henry D. Pfister