Axiomatic Origins of Mathematical Entropy: Grading Ordered Sets
Probability
2019-03-14 v1
Abstract
Shannon's entropy and other entropy-based concepts are derived from the new, more general concept of relative divergence of one "grading' function on a linearly ordered set from another such function. The definition of relative divergence is derived based on "common sense' assumptions about comparing grading functions. Shannon's entropy formulas emerge from the respective relative divergence ones, entropy based methods are extended to more general cases and some new applications.
Keywords
Cite
@article{arxiv.1903.05240,
title = {Axiomatic Origins of Mathematical Entropy: Grading Ordered Sets},
author = {Alexander Dukhovny},
journal= {arXiv preprint arXiv:1903.05240},
year = {2019}
}