English

Output Statistics of Random Binning: Tsallis Divergence and Its Applications

Information Theory 2024-11-25 v4 math.IT

Abstract

Random binning is a widely used technique in information theory with diverse applications. In this paper, we focus on the output statistics of random binning (OSRB) using the Tsallis divergence TαT_\alpha. We analyze all values of α(0,){}\alpha \in (0, \infty)\cup\{\infty\} and consider three scenarios: (i) the binned sequence is generated i.i.d., (ii) the sequence is randomly chosen from an ϵ\epsilon-typical set, and (iii) the sequence originates from an ϵ\epsilon-typical set and is passed through a non-memoryless virtual channel. Our proofs cover both achievability and converse results. To address the unbounded nature of TT_\infty, we extend the OSRB framework using R\'enyi's divergence with order infinity, denoted DD_\infty. As part of our exploration, we analyze a specific form of R\'enyi's conditional entropy and its properties. Additionally, we demonstrate the application of this framework in deriving achievability results for the wiretap channel, where Tsallis divergence serves as a security measure. The secure rate we obtain through the OSRB analysis matches the secure capacity for α(0,2]{}\alpha \in (0, 2]\cup\{{\infty}\} and serves as a potential candidate for the secure capacity when α(2,)\alpha \in (2, \infty).

Keywords

Cite

@article{arxiv.2304.12606,
  title  = {Output Statistics of Random Binning: Tsallis Divergence and Its Applications},
  author = {Masoud Kavian and Mohammad Mahdi Mojahedian and Mohammad Hossein Yassaee and Mahtab Mirmohseni and Mohammad Reza Aref},
  journal= {arXiv preprint arXiv:2304.12606},
  year   = {2024}
}