English
Related papers

Related papers: Worst-case Redundancy of Optimal Binary AIFV Codes…

200 papers

We study finite-length bounds for source coding with side information for Markov sources and channel coding for channels with conditional Markovian additive noise. For this purpose, we propose two criteria for finite-length bounds. One is…

Information Theory · Computer Science 2017-01-10 Masahito Hayashi , Shun Watanabe

It is possible to improve upon Tunstall coding using a collection of multiple parse trees. The best such results so far are Iwata and Yamamoto's maximum cost AIVF codes. The most efficient algorithm for designing such codes is an iterative…

Data Structures and Algorithms · Computer Science 2024-05-14 Reza Hosseini Dolatabadi , Mordecai J. Golin , Arian Zamani

In this paper, we propose {\em distributed network compression via memory}. We consider two spatially separated sources with correlated unknown source parameters. We wish to study the universal compression of a sequence of length $n$ from…

Information Theory · Computer Science 2012-10-09 Ahmad Beirami , Faramarz Fekri

We address the problem of bounding below the probability of error under maximum likelihood decoding of a binary code with a known distance distribution used on a binary symmetric channel. An improved upper bound is given for the maximum…

Information Theory · Computer Science 2007-07-16 Alexander Barg , Andrew McGregor

We study the new problem of Huffman-like codes subject to individual restrictions on the code-word lengths of a subset of the source words. These are prefix codes with minimal expected code-word length for a random source where additionally…

Information Theory · Computer Science 2007-07-13 Paul M. B. Vitanyi , Zvi Lotker

Zero-error single-channel source coding has been studied extensively over the past decades. Its natural multi-channel generalization is however not well investigated. While the special case with multiple symmetric-alphabet channels was…

Information Theory · Computer Science 2021-05-11 Hoover H. F. Yin , Xishi Wang , Ka Hei Ng , Russell W. F. Lai , Lucien K. L. Ng , Jack P. K. Ma

This paper presents a new construction of error correcting codes which achieves optimal recovery of a streaming source over a packet erasure channel. The channel model considered is the sliding window erasure model, with burst and arbitrary…

Information Theory · Computer Science 2019-04-23 Damian Dudzicz , Silas L. Fong , Ashish Khisti

The explosion of the amount of data stored in cloud systems calls for more efficient paradigms for redundancy. While replication is widely used to ensure data availability, erasure correcting codes provide a much better trade-off between…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-16 Steve Jiekak , Anne-Marie Kermarrec , Nicolas Le Scouarnec , Gilles Straub , Alexandre Van Kempen

A (tandem) duplication of length $ k $ is an insertion of an exact copy of a substring of length $ k $ next to its original position. This and related types of impairments are of relevance in modeling communication in the presence of…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Vincent Y. F. Tan

Exponential error bounds for the finite-alphabet interference channel (IFC) with two transmitter-receiver pairs, are investigated under the random coding regime. Our focus is on optimum decoding, as opposed to heuristic decoding rules that…

Information Theory · Computer Science 2008-10-14 Raul Etkin , Neri Merhav , Erik Ordentlich

The noise model of deletions poses significant challenges in coding theory, with basic questions like the capacity of the binary deletion channel still being open. In this paper, we study the harder model of worst-case deletions, with a…

Information Theory · Computer Science 2014-11-26 Venkatesan Guruswami , Carol Wang

Minimal codes are linear codes where all non-zero codewords are minimal, i.e., whose support is not properly contained in the support of another codeword. The minimum possible length of such a $k$-dimensional linear code over $\mathbb{F}_q$…

Combinatorics · Mathematics 2025-06-06 Vladimir Chubenko , Sascha Kurz

We consider the problem of using polar codes over slow fading wireless channels. For design, we focus on a parallel slow fading channel with 2 blocks, and polar codes with rate <= 1/2. Motivated by Arikan's systematic polar code…

Information Theory · Computer Science 2016-10-18 Saurabha R Tavildar

We theoretically analyse the limits of robustness to test-time adversarial and noisy examples in classification. Our work focuses on deriving bounds which uniformly apply to all classifiers (i.e all measurable functions from features to…

Machine Learning · Statistics 2020-11-13 Elvis Dohmatob

Huffman coding is well known to be useful in certain decision problems involving minimizing the average number of (freely chosen) queries to determine an unknown random variable. However, in problems where the queries are more constrained,…

Information Theory · Computer Science 2022-10-11 Shuyuan Zhang , Jichen Sun , Shengkang Chen

We derive the optimum second-order coding rates, known as second-order capacities, for erasure and list decoding. For erasure decoding for discrete memoryless channels, we show that second-order capacity is $\sqrt{V}\Phi^{-1}(\epsilon_t)$…

Information Theory · Computer Science 2014-04-22 Vincent Y. F. Tan , Pierre Moulin

We consider the problem of learning optimal binary classification trees. Literature on the topic has burgeoned in recent years, motivated both by the empirical suboptimality of heuristic approaches and the tremendous improvements in…

Machine Learning · Statistics 2020-05-14 Sina Aghaei , Andres Gomez , Phebe Vayanos

Recently a construction of optimal non-constant dimension subspace codes, also termed projective space codes, has been reported in a paper of Honold-Kiermaier-Kurz. Restricted to binary codes in a 5-dimensional ambient space with minimum…

Information Theory · Computer Science 2017-01-26 Anirban Ghatak

We consider a secure source coding problem with a rate-limited helper. In particular, Alice observes an independent and identically distributed (i.i.d.) source X and wishes to transmit this source losslessly to Bob over a rate-limited link.…

Information Theory · Computer Science 2012-12-10 Ravi Tandon , Sennur Ulukus , Kannan Ramchandran

Inner and outer bounds are derived on the optimal performance of fixed length block codes on discrete memoryless channels with feedback and errors-and-erasures decoding. First an inner bound is derived using a two phase encoding scheme with…

Information Theory · Computer Science 2020-01-03 Baris Nakiboglu , Lizhong Zheng
‹ Prev 1 8 9 10 Next ›