English

Generalized active information: extensions to unbounded domains

Information Theory 2021-11-15 v1 math.IT Statistics Theory Data Analysis, Statistics and Probability Statistics Theory

Abstract

In the last three decades, several measures of complexity have been proposed. Up to this point, most of such measures have only been developed for finite spaces. In these scenarios the baseline distribution is uniform. This makes sense because, among other things, the uniform distribution is the measure of maximum entropy over the relevant space. Active information traditionally assumes a finite interval universe of discourse but can be extended to other cases where maximum entropy is defined. Illustrating this is the purpose of this paper. Disequilibrium from maximum entropy, measured as active information, can be evaluated from baselines with unbounded support.

Keywords

Cite

@article{arxiv.2111.06865,
  title  = {Generalized active information: extensions to unbounded domains},
  author = {Daniel Andrés Díaz-Pachón and Robert J. Marks},
  journal= {arXiv preprint arXiv:2111.06865},
  year   = {2021}
}

Comments

15 pages, 1 figure

R2 v1 2026-06-24T07:36:40.186Z