English
Related papers

Related papers: Capacity on BMS Channels via Code Symmetry and Nes…

200 papers

Motivated by distributed storage applications, we investigate the degree to which capacity achieving encodings can be efficiently updated when a single information bit changes, and the degree to which such encodings can be efficiently…

Information Theory · Computer Science 2013-10-08 Arya Mazumdar , Venkat Chandar , Gregory W. Wornell

This work studies the problem of constructing capacity-achieving codes from an algorithmic perspective. Specifically, we prove that there exists a Turing machine which, given a discrete memoryless channel $p_{Y|X}$, a target rate $R$ less…

Information Theory · Computer Science 2025-11-06 Angelos Gkekas , Nikos A. Mitsiou , Ioannis Souldatos , George K. Karagiannidis

In this paper, we consider the problem of sequential transmission over the binary symmetric channel (BSC) with full, noiseless feedback. Naghshvar et al. proposed a one-phase encoding scheme, for which we refer to as the small-enough…

Information Theory · Computer Science 2020-05-29 Hengjie Yang , Richard D. Wesel

This work provides an algebraic framework for source coding with decoder side information and its dual problem, channel coding with encoder side information, showing that nested concatenated codes can achieve the corresponding…

Information Theory · Computer Science 2012-04-25 Felipe Cinelli Barbosa , Joerg Kliewer , Max H. M. Costa

The input-constrained binary erasure channel (BEC) with strictly causal feedback is studied. The channel input sequence must satisfy the $(0,k)$-runlength limited (RLL) constraint, i.e., no more than $k$ consecutive `$0$'s are allowed. The…

Information Theory · Computer Science 2017-12-08 Ori Peled , Oron Sabag , Haim H. Permuter

Blind Compressed Sensing (BCS) is an extension of Compressed Sensing (CS) where the optimal sparsifying dictionary is assumed to be unknown and subject to estimation (in addition to the CS sparse coefficients). Since the emergence of BCS,…

Information Theory · Computer Science 2015-08-11 Mohammad Aghagolzadeh , Hayder Radha

We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work…

Information Theory · Computer Science 2007-11-27 Andrea Montanari , Ruediger Urbanke

This paper presents a hybrid decoding architecture that serially couples a normalized min-sum (NMS) decoder with reinforced ordered statistics decoding (OSD) to achieve near-maximum likelihood (ML) performance for short linear block codes,…

Information Theory · Computer Science 2026-04-28 Guangwen Li , Xiao Yu

In this paper, we use reinforcement learning to find effective decoding strategies for binary linear codes. We start by reviewing several iterative decoding algorithms that involve a decision-making process at each step, including…

Information Theory · Computer Science 2019-12-10 Fabrizio Carpi , Christian Häger , Marco Martalò , Riccardo Raheli , Henry D. Pfister

In this paper we study the iterative decoding threshold performance of non-binary spatially-coupled low-density parity-check (NB-SC-LDPC) code ensembles for both the binary erasure channel (BEC) and the binary-input additive white Gaussian…

Information Theory · Computer Science 2016-11-18 Lai Wei , Toshiaki Koike-Akino , David G. M. Mitchell , Thomas E. Fuja , Daniel J. Costello

We study the problem of multi-bit watermarking for large language models (LLMs). We introduce a block-autoregressive model inspired by multi-token prediction, in which the encoder has limited non-causal access to token distributions within…

Information Theory · Computer Science 2026-05-19 Sidong Guo , Tyler Kann , Teodora Baluta , Matthieu R. Bloch

We present a constraint-coding scheme to correct asymmetric magnitude-$1$ errors in multi-level non-volatile memories. For large numbers of such errors, the scheme is shown to deliver better correction capability compared to known…

Information Theory · Computer Science 2017-09-12 Evyatar Hemo , Yuval Cassuto

The problem of channel coding with the erasure option is revisited for discrete memoryless channels. The interplay between the code rate, the undetected and total error probabilities is characterized. Using the information spectrum method,…

Information Theory · Computer Science 2015-10-22 Masahito Hayashi , Vincent Y. F. Tan

It is shown that for any binary-input discrete memoryless channel $W$ with symmetric capacity $I(W)$ and any rate $R <I(W)$, the probability of block decoding error for polar coding under successive cancellation decoding satisfies $P_e \le…

Information Theory · Computer Science 2009-04-06 Erdal Arikan , Emre Telatar

We propose a novel construction of product codes for high-density magnetic recording based on binary low-density parity check (LDPC) codes and binary image of Reed Solomon (RS) codes. Moreover, two novel algorithms are proposed to decode…

Information Theory · Computer Science 2012-01-06 Vo Tam Van , Seiichi Mita

We consider a peak-power-limited single-antenna block-stationary Gaussian fading channel where neither the transmitter nor the receiver knows the channel state information, but both know the channel statistics. This model subsumes most…

Information Theory · Computer Science 2016-11-17 Jun Chen , Venugopal V. Veeravalli

In this paper, the duality of erasures and defects will be investigated by comparing the binary erasure channel (BEC) and the binary defect channel (BDC). The duality holds for channel capacities, capacity achieving schemes, minimum…

Information Theory · Computer Science 2019-12-25 Yongjune Kim , B V K Vijaya Kumar

In this paper, we consider the application of Reed- Solomon (RS) channel coding for joint error correction and cooperative network coding on non-binary phase shift keying (PSK) modulated signals. The relay first decodes the RS channel coded…

Information Theory · Computer Science 2019-02-07 Elias Benamira , Fatiha Merazka , Gunes Karabulut Kurt

This paper studies the coherent and non-coherent multiuser multiple-input multiple-output (MU-MIMO) uplink system in the finite blocklength regime. The i.i.d. Gaussian codebook is assumed for each user. To be more specific, the BS first…

Information Theory · Computer Science 2022-10-04 Junjuan Feng , Hien Quoc Ngo , Michail Matthaiou

This paper studies the capacity of single-source single-sink noiseless networks under adversarial or arbitrary errors on no more than z edges. Unlike prior papers, which assume equal capacities on all links, arbitrary link capacities are…

Information Theory · Computer Science 2010-11-18 Sukwon Kim , Tracey Ho , Michelle Effros , Amir Salman Avestimehr