English

Change the coefficients of conditional entropies in extensivity

Mathematical Physics 2021-11-03 v1 Information Theory math.IT math.MP

Abstract

The Boltzmann--Gibbs entropy is a functional on the space of probability measures. When a state space is countable, one characterization of the Boltzmann--Gibbs entropy is given by the Shannon--Khinchin axioms, which consist of continuity, maximality, expandability and extensivity. Among these four properties, the extensivity is generalized in various ways. The extensivity of a functional is interpreted as the property that, for any random variables (X,Y)(X,Y) taking finitely many values in N\mathbb{N}, the difference between the value of the functional at the joint law of (X,Y)(X,Y) and that at the law of XX coincides with the linear combinations of the values at the conditional laws of YY given X=nX=n with coefficients given by the probabilities of each event X=nX=n. A generalization of the extensivity obtained by replacing the coefficients with a power of the probabilities of the events X=nX=n provides a characterization of the Tsallis entropy. In this paper, we first prove the impossibility to replace the coefficients with a non-power function of the probabilities of the events X=nX=n. Then we estimate the difference between the value at the joint law of (X,Y)(X,Y) and that at the law of XX for a general functional.

Keywords

Cite

@article{arxiv.2011.08370,
  title  = {Change the coefficients of conditional entropies in extensivity},
  author = {Asuka Takatsu},
  journal= {arXiv preprint arXiv:2011.08370},
  year   = {2021}
}

Comments

8 pages. Comments are welcome!