English

On the Most Informative Boolean Functions of the Very Noisy Channel

Information Theory 2019-07-18 v3 math.IT

Abstract

Let XnX^n be a uniformly distributed nn-dimensional binary vector, and YnY^n be the result of passing XnX^n through a binary symmetric channel (BSC) with crossover probability α\alpha. A recent conjecture postulated by Courtade and Kumar states that for any Boolean function f:{0,1}n{0,1}f:\{0,1\}^n\to\{0,1\}, I(f(Xn);Yn)1H(α)I(f(X^n);Y^n)\le 1-H(\alpha). Although the conjecture has been proved to be true in the dimension-free high noise regime by Samorodnitsky, here we present a calculus-based approach to show a dimension-dependent result by examining the second derivative of H(α)H(f(Xn)Yn)H(\alpha)-H(f(X^n)|Y^n) at α=1/2\alpha=1/2. Along the way, we show that the dictator function is the most informative function in the high noise regime.

Keywords

Cite

@article{arxiv.1807.11289,
  title  = {On the Most Informative Boolean Functions of the Very Noisy Channel},
  author = {Hengjie Yang and Richard D. Wesel},
  journal= {arXiv preprint arXiv:1807.11289},
  year   = {2019}
}

Comments

17 pages; 1 figure; the short version has been accepted to ISIT 2019; corrected multiple typos in the previous version