English
Related papers

Related papers: Towards Weak Source Coding

200 papers

List-decoding and list-recovery are important generalizations of unique decoding that received considerable attention over the years. However, the optimal trade-off among list-decoding (resp. list-recovery) radius, list size, and the code…

Information Theory · Computer Science 2021-12-13 Eitan Goldberg , Chong Shangguan , Itzhak Tamo

A problem of index coding with side information was first considered by Y. Birk and T. Kol (IEEE INFOCOM, 1998). In the present work, a generalization of index coding scheme, where transmitted symbols are subject to errors, is studied.…

Information Theory · Computer Science 2011-01-17 Son Hoang Dau , Vitaly Skachek , Yeow Meng Chee

Universal variable-to-fixed (V-F) length coding of $d$-dimensional exponential family of distributions is considered. We propose an achievable scheme consisting of a dictionary, used to parse the source output stream, making use of the…

Information Theory · Computer Science 2017-08-02 Nematollah Iri , Oliver Kosut

We present a proof for the quantum channel coding theorem which relies on the fact that a randomly chosen code space typically is highly suitable for quantum error correction. In this sense, the proof is close to Shannon's original…

Quantum Physics · Physics 2007-12-18 Rochus Klesse

We present a new information-theoretic definition and associated results, based on list decoding in a source coding setting. We begin by presenting list-source codes, which naturally map a key length (entropy) to list size. We then show…

Information Theory · Computer Science 2012-10-09 Flavio du Pin Calmon , Muriel Médard , Linda M. Zeger , João Barros , Mark M. Christiansen , Ken. R. Duffy

We define a large class of quantum sources and prove a quantum analog of the asymptotic equipartition property. Our proof relies on using local measurements on the quantum source to obtain an associated classical source. The classical…

Quantum Physics · Physics 2009-10-28 Christopher King , Andrzej Lesniewski

Inspired by mobile satellite communication systems and the important and prevalent applications of computational tasks, we consider a distributed source coding model for compressing vector-linear functions, which consists of multiple…

Information Theory · Computer Science 2025-08-06 Xuan Guang , Xiufang Sun , Ruze Zhang

The rapidly improving performance of modern hardware renders convolutional codes obsolete, and allows for the practical implementation of more sophisticated correction codes such as low density parity check (LDPC) and turbo codes (TC). Both…

Information Theory · Computer Science 2015-03-20 Jarosław Duda , Paweł Korus

We study the universal coding under side-channel attacks posed and investigated by Oohama and Santoso (2022). They proposed a theoretical security model for Shannon cipher system under side-channel attacks, where the adversary is not only…

Information Theory · Computer Science 2024-05-14 Yasutada Oohama , Bagus Santoso

In the classical source coding problem, the compressed source is reconstructed at the decoder with respect to some distortion metric. Motivated by settings in which we are interested in more than simply reconstructing the compressed source,…

Information Theory · Computer Science 2023-10-03 Oğuzhan Kubilay Ülger , Elza Erkip

In this paper we study the redundancy of Huffman codes. In particular, we consider sources for which the probability of one of the source symbols is known. We prove a conjecture of Ye and Yeung regarding the upper bound on the redundancy of…

Information Theory · Computer Science 2016-11-17 Soheil Mohajer , Payam Pakzad , Ali Kakhbod

The problem of lossless data compression with side information available to both the encoder and the decoder is considered. The finite-blocklength fundamental limits of the best achievable performance are defined, in two different versions…

Information Theory · Computer Science 2021-02-23 Lampros Gavalakis , Ioannis Kontoyiannis

The problem of joint universal source coding and identification is considered in the setting of fixed-rate lossy coding of continuous-alphabet memoryless sources. For a wide class of bounded distortion measures, it is shown that any…

Information Theory · Computer Science 2007-07-13 Maxim Raginsky

Let $X$ be a set of items of size $n$ , which may contain some defective items denoted by $I$, where $I \subseteq X$. In group testing, a {\it test} refers to a subset of items $Q \subset X$. The test outcome is $1$ (positive) if $Q$…

Data Structures and Algorithms · Computer Science 2023-09-19 Nader H. Bshouty , Gergely Harcos

In this paper, we prove a local limit theorem for the chi-square distribution with $r > 0$ degrees of freedom and noncentrality parameter $\lambda \geq 0$. We use it to develop refined normal approximations for the survival function. Our…

Statistics Theory · Mathematics 2022-07-29 Frédéric Ouimet

Network coding theory studies the transmission of information in networks whose vertices may perform nontrivial encoding and decoding operations on data as it passes through the network. The main approach to deciding the feasibility of…

Information Theory · Computer Science 2010-01-12 Anna Blasiak , Robert Kleinberg

The Shannon capacity of a graph is an important graph invariant in information theory that is extremely difficult to compute. The Lovasz number, which is based on semidefinite programming relaxation, is a well-known upper bound for the…

Optimization and Control · Mathematics 2019-01-24 Yingjie Bi , Ao Tang

In this paper, we introduce new lower bounds on the distortion of scalar fixed-rate codes for lossy compression with side information available at the receiver. These bounds are derived by presenting the relevant random variables as a…

Information Theory · Computer Science 2014-11-18 Avraham Reani , Neri Merhav

We study error exponents for source coding with side information. Both achievable exponents and converse bounds are obtained for the following two cases: lossless source coding with coded information (SCCSI) and lossy source coding with…

Information Theory · Computer Science 2015-03-19 Benjamin G. Kelly , Aaron B. Wagner

A new ensemble of structured codes is introduced. These codes are called Quasi Linear Codes (QLC). The QLC's are constructed by taking subsets of linear codes. They have a looser structure compared to linear codes and are not closed under…

Information Theory · Computer Science 2016-02-16 F. Shirani , M. Heidari , S. S. Pradhan