English
Related papers

Related papers: Exact random coding error exponents of optimal bin…

200 papers

In this note, we investigate the performance of optimal double circulant even codes which are not self-dual, as measured by the decoding error probability in bounded distance decoding. To do this, we classify the optimal double circulant…

Combinatorics · Mathematics 2016-08-26 T. Aaron Gulliver , Masaaki Harada

A coding scheme for transmission of a bit maps a given bit to a sequence of channel inputs (called the codeword associated to the transmitted bit). In this paper, we study the problem of designing the best code for a discrete Poisson…

Information Theory · Computer Science 2021-04-16 Niloufar Ahmadypour , Amin Gohari

New bandwidth selectors for kernel density estimation with directional data are presented in this work. These selectors are based on asymptotic and exact error expressions for the kernel density estimator combined with mixtures of von Mises…

Methodology · Statistics 2020-09-22 Eduardo García-Portugués

A rate-dependent upper bound of the best achievable block error probability of polar codes with successive-cancellation decoding is derived.

Information Theory · Computer Science 2010-01-14 Toshiyuki Tanaka , Ryuhei Mori

Error exponents characterize the exponential decay, when increasing message length, of the probability of error of many error-correcting codes. To tackle the long standing problem of computing them exactly, we introduce a general,…

Disordered Systems and Neural Networks · Physics 2007-07-16 Thierry Mora , Olivier Rivoire

We consider the maximum coding rate achievable by uniformly-random codes for the deletion channel. We prove an upper bound that's within 0.1 of the best known lower bounds for all values of the deletion probability $d,$ and much closer for…

Information Theory · Computer Science 2022-10-17 Berivan Isik , Francisco Pernice , Tsachy Weissman

We present an optimal method for encoding cluster assignments of arbitrary data sets. Our method, Random Cycle Coding (RCC), encodes data sequentially and sends assignment information as cycles of the permutation defined by the order of…

Machine Learning · Computer Science 2024-12-03 Daniel Severo , Ashish Khisti , Alireza Makhzani

We analyze the trade-off between the undetected error probability (i.e., the probability that the channel decoder outputs an erroneous message without detecting the error) and the total error probability in the short blocklength regime. We…

Information Theory · Computer Science 2025-03-05 Alexander Sauter , A. Oguz Kislal , Giuseppe Durisi , Gianluigi Liva , Balazs Matuz , Erik G. Ström

The problem of mismatched decoding for discrete memoryless channels is addressed. A mismatched cognitive multiple-access channel is introduced, and an inner bound on its capacity region is derived using two alternative encoding methods:…

Information Theory · Computer Science 2013-05-03 Anelia Somekh-Baruch

Let $P = \{p(i)\}$ be a measure of strictly positive probabilities on the set of nonnegative integers. Although the countable number of inputs prevents usage of the Huffman algorithm, there are nontrivial $P$ for which known methods find a…

Information Theory · Computer Science 2007-07-13 Michael B. Baer

A general method of coding over expansions is proposed, which allows one to reduce the highly non-trivial problem of coding over continuous channels to a much simpler discrete ones. More specifically, the focus is on the additive…

Information Theory · Computer Science 2012-02-09 O. Ozan Koyluoglu , Kumar Appaiah , Hongbo Si , Sriram Vishwanath

This paper proposes a novel maximum-likelihood (ML) soft-decision decoding framework for linear block codes, termed error-building decoding (EBD). The complete decoding process can be performed using only the parity-check matrix, without…

Information Theory · Computer Science 2026-01-06 Guoda Qiu , Ling Liu , Yuejun Wei , Liping Li

In this paper q-ary Raptor codes under ML decoding are considered. An upper bound on the probability of decoding failure is derived using the weight enumerator of the outer code, or its expected weight enumerator if the outer code is drawn…

Information Theory · Computer Science 2016-11-21 Francisco Lázaro , Gianluigi Liva , Enrico Paolini , Gerhard Bauch

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2021-10-06 Mahdi Soleymani , Mohammad Vahid Jamali , Hessam Mahdavifar

This paper introduces a new counting code. Its design was motivated by distributed video coding where, for decoding, error correction methods are applied to improve predictions. Those error corrections sometimes fail which results in…

Information Theory · Computer Science 2008-02-04 Axel Lakus-Becker , Ka-Ming Leung

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

In this paper we study output coding for multi-label prediction. For a multi-label output coding to be discriminative, it is important that codewords for different label vectors are significantly different from each other. In the meantime,…

Machine Learning · Computer Science 2012-07-03 Yi Zhang , Jeff Schneider

The optimal binning is the optimal discretization of a variable into bins given a discrete or continuous numeric target. We present a rigorous and extensible mathematical programming formulation for solving the optimal binning problem for a…

Machine Learning · Computer Science 2022-12-12 Guillermo Navas-Palencia

We analyze the optimal trade-off between the error exponent and the excess-rate exponent for variable-rate Slepian-Wolf codes. In particular, we first derive upper (converse) bounds on the optimal error and excess-rate exponents, and then…

Information Theory · Computer Science 2014-11-07 Nir Weinberger , Neri Merhav

We consider binary systematic network codes and investigate their capability of decoding a source message either in full or in part. We carry out a probability analysis, derive closed-form expressions for the decoding probability and show…

Information Theory · Computer Science 2016-11-15 Andrew L. Jones , Ioannis Chatzigeorgiou , Andrea Tassi