English

Minimizing the CDF Path Length: A Novel Perspective on Uniformity and Uncertainty of Bounded Distributions

Methodology 2016-06-02 v2 Statistics Theory Statistics Theory

Abstract

An index of uniformity is developed as an alternative to the maximum-entropy principle for selecting continuous, differentiable probability distributions P\mathcal{P} subject to constraints CC. The uniformity index developed in this paper is motivated by the observation that among all differentiable probability distributions defined on a finite interval [a,b]R[a,b] \in \mathbb{R}, it is the uniform probability distribution that minimizes the path length of the associated cumulative distribution function FPF_{\mathcal{P}} on [a,b][a,b]. This intuition is extended to situations where there are constraints on the allowable probability distributions. In particular, constraints on the first and second raw moments of a distribution are discussed in detail, including the analytical form of the solutions and numerical studies of particular examples. The resulting "shortest path" distributions are found to be decidedly more heavy-tailed than the associated maximum-entropy distributions, suggesting that entropy and "CDF path length" measure two different aspects of uncertainty for bounded distributions.

Keywords

Cite

@article{arxiv.1508.01146,
  title  = {Minimizing the CDF Path Length: A Novel Perspective on Uniformity and Uncertainty of Bounded Distributions},
  author = {Michael E. Beyer},
  journal= {arXiv preprint arXiv:1508.01146},
  year   = {2016}
}

Comments

Draft Paper/Idea Sketch. 13 pages, 5 figures