English

Greedy-Merge Degrading has Optimal Power-Law

Information Theory 2017-05-09 v2 math.IT

Abstract

Consider a channel with a given input distribution. Our aim is to degrade it to a channel with at most L output letters. One such degradation method is the so called "greedy-merge" algorithm. We derive an upper bound on the reduction in mutual information between input and output. For fixed input alphabet size and variable L, the upper bound is within a constant factor of an algorithm-independent lower bound. Thus, we establish that greedy-merge is optimal in the power-law sense.

Keywords

Cite

@article{arxiv.1701.02119,
  title  = {Greedy-Merge Degrading has Optimal Power-Law},
  author = {Assaf Kartowsky and Ido Tal},
  journal= {arXiv preprint arXiv:1701.02119},
  year   = {2017}
}

Comments

5 pages, submitted to ISIT 2017