English

How to Quantize $n$ Outputs of a Binary Symmetric Channel to $n-1$ Bits?

Information Theory 2017-05-03 v2 math.IT

Abstract

Suppose that YnY^n is obtained by observing a uniform Bernoulli random vector XnX^n through a binary symmetric channel with crossover probability α\alpha. The "most informative Boolean function" conjecture postulates that the maximal mutual information between YnY^n and any Boolean function b(Xn)\mathrm{b}(X^n) is attained by a dictator function. In this paper, we consider the "complementary" case in which the Boolean function is replaced by f:{0,1}n{0,1}n1f:\left\{0,1\right\}^n\to\left\{0,1\right\}^{n-1}, namely, an n1n-1 bit quantizer, and show that I(f(Xn);Yn)(n1)(1h(α))I(f(X^n);Y^n)\leq (n-1)\cdot\left(1-h(\alpha)\right) for any such ff. Thus, in this case, the optimal function is of the form f(xn)=(x1,,xn1)f(x^n)=(x_1,\ldots,x_{n-1}).

Keywords

Cite

@article{arxiv.1701.03119,
  title  = {How to Quantize $n$ Outputs of a Binary Symmetric Channel to $n-1$ Bits?},
  author = {Wasim Huleihel and Or Ordentlich},
  journal= {arXiv preprint arXiv:1701.03119},
  year   = {2017}
}

Comments

5 pages, accepted ISIT 2017