English
Related papers

Related papers: A Neyman-Pearson Approach to Universal Erasure and…

200 papers

The goal of a denoising algorithm is to reconstruct a signal from its noise-corrupted observations. Perfect reconstruction is seldom possible and performance is measured under a given fidelity criterion. In a recent work, the authors…

Information Theory · Computer Science 2009-11-11 George Gemelos , Styrmir Sigurjonsson , Tsachy Weissman

We propose a new class of error correction codes for low-delay streaming communication. We consider an online setup where a source packet arrives at the encoder every $M$ channel uses, and needs to be decoded with a maximum delay of $T$…

Information Theory · Computer Science 2016-11-17 Ahmed Badr , Pratik Patil , Ashish Khisti , Wai-Tian Tan , John Apostolopoulos

We discuss and analyze a list-message-passing decoder with verification for low-density parity-check (LDPC) codes on the q-ary symmetric channel (q-SC). Rather than passing messages consisting of symbol probabilities, this decoder passes…

Information Theory · Computer Science 2015-03-13 Fan Zhang , Henry D. Pfister

Undetected errors are important for linear codes, which are the only type of errors after hard decision and automatic-repeat-request (ARQ), but do not receive much attention on their correction. In concatenated channel coding, suboptimal…

Information Theory · Computer Science 2019-01-09 Jingzhao Wang , Yuan Luo

Over discrete memoryless channels (DMC), linear decoders (maximizing additive metrics) afford several nice properties. In particular, if suitable encoders are employed, the use of decoding algorithm with manageable complexities is…

Information Theory · Computer Science 2008-10-01 Emmanuel Abbe , Lizhong Zheng

This paper studies the problem of reconstructing a word given several of its noisy copies. This setup is motivated by several applications, among them is reconstructing strands in DNA-based storage systems. Under this paradigm, a word is…

Information Theory · Computer Science 2020-01-17 Omer Sabary , Eitan Yaakobi , Alexander Yucovich

This paper investigates decoding of binary linear block codes over the binary erasure channel (BEC). Of the current iterative decoding algorithms on this channel, we review the Recovery Algorithm and the Guess Algorithm. We then present a…

Information Theory · Computer Science 2007-07-13 J. Cai , C. Tjhai , M. Tomlinson , M. Ambroze , M. Ahmed

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

The deletion channel is the simplest point-to-point communication channel that models lack of synchronization. Input bits are deleted independently with probability d, and when they are not deleted, they are not affected by the channel.…

Information Theory · Computer Science 2011-05-02 Yashodhan Kanoria , Andrea Montanari

This paper presents new FEC codes for the erasure channel, LDPC-Band, that have been designed so as to optimize a hybrid iterative-Maximum Likelihood (ML) decoding. Indeed, these codes feature simultaneously a sparse parity check matrix,…

Information Theory · Computer Science 2009-01-23 Alexandre Soro , Mathieu Cunche , Jerome Lacan , Vincent Roca

An error-erasure channel is a simple noise model that introduces both errors and erasures. While the two types of errors can be corrected simultaneously with error-correcting codes, it is also known that any linear code allows for first…

Information Theory · Computer Science 2019-03-19 Yu Tsunoda , Yuichiro Fujiwara , Hana Ando , Peter Vandendriessche

This paper investigates universal polar coding schemes. In particular, a notion of ordering (called convolutional path) is introduced between probability distributions to determine when a polar compression (or communication) scheme designed…

Information Theory · Computer Science 2010-12-03 Emmanuel Abbe

This work develops a rate-distortion-based approach to stochastic Chase decoding of algebraic codes over binary memoryless symmetric (BMS) channels, replacing the heuristics traditionally used to determine flip probabilities with…

Information Theory · Computer Science 2026-05-20 Amit Berman , Ariel Doubchak , Uri Erez , Tal Philosof , Ilya Shapir

In this work we explore possibilities for coding when information worlds have different (semantic) values. We introduce a loss function that expresses the overall performance of a coding scheme for discrete channels and exchange the usual…

Information Theory · Computer Science 2015-03-19 Marcelo Firer , Luciano Panek , Laura Rifo

We present a novel global compression framework for deep neural networks that automatically analyzes each layer to identify the optimal per-layer compression ratio, while simultaneously achieving the desired overall compression. Our…

Machine Learning · Computer Science 2021-11-22 Lucas Liebenwein , Alaa Maalouf , Oren Gal , Dan Feldman , Daniela Rus

Exponential error bounds achievable by universal coding and decoding are derived for frame-asynchronous discrete memoryless %asynchronous multiple access channels with two senders, via the method of subtypes, a refinement of the method of…

Information Theory · Computer Science 2020-02-04 Lóránt Farkas , Tamás Kói

This paper investigates the construction of linear network codes for broadcasting a set of data packets to a number of users. The links from the source to the users are modeled as independent erasure channels. Users are allowed to inform…

Information Theory · Computer Science 2013-12-10 Chi Wan Sung , Linyu Huang , Ho Yuet Kwan , Kenneth W. Shum

The problem of blind identification of channel codes at a receiver involves identifying a code chosen by a transmitter from a known code-family, by observing the transmitted codewords through the channel. Most existing approaches for…

Information Theory · Computer Science 2026-03-04 Pramod Singh , Prasad Krishnan , Arti Yardi

This paper provides a dual domain derivation of the error exponent of maximum mutual information (MMI) decoding with constant composition codes, showing it coincides with that of maximum likelihood decoding for discrete memoryless channels.…

Information Theory · Computer Science 2025-07-25 AmirPouya Moeini , Albert Guillén i Fàbregas

This paper investigates the belief propagation decoding of spatially-coupled MacKay-Neal (SC-MN) codes over erasure channels with memory. We show that SC-MN codes with bounded degree universally achieve the symmetric information rate (SIR)…

Information Theory · Computer Science 2015-01-28 Masaru Fukushima , Takuya Okazaki , Kenta Kasai