Generalized active information: extensions to unbounded domains
Information Theory
2021-11-15 v1 math.IT
Statistics Theory
Data Analysis, Statistics and Probability
Statistics Theory
Abstract
In the last three decades, several measures of complexity have been proposed. Up to this point, most of such measures have only been developed for finite spaces. In these scenarios the baseline distribution is uniform. This makes sense because, among other things, the uniform distribution is the measure of maximum entropy over the relevant space. Active information traditionally assumes a finite interval universe of discourse but can be extended to other cases where maximum entropy is defined. Illustrating this is the purpose of this paper. Disequilibrium from maximum entropy, measured as active information, can be evaluated from baselines with unbounded support.
Keywords
Cite
@article{arxiv.2111.06865,
title = {Generalized active information: extensions to unbounded domains},
author = {Daniel Andrés Díaz-Pachón and Robert J. Marks},
journal= {arXiv preprint arXiv:2111.06865},
year = {2021}
}
Comments
15 pages, 1 figure