English

Generalized Estimators, Slope, Efficiency, and Fisher Information Bounds

Statistics Theory 2022-11-04 v2 Statistics Theory

Abstract

Point estimators may not exist, need not be unique, and their distributions are not parameter invariant. Generalized estimators provide distributions that are parameter invariant, unique, and exist when point estimates do not. Comparing point estimators using variance is less useful when estimators are biased. A squared slope Λ\Lambda is defined that can be used to compare both point and generalized estimators and is unaffected by bias. Fisher information II and variance are fundamentally different quantities: the latter is defined at a distribution that need not belong to a family, while the former cannot be defined without a family of distributions, MM. Fisher information and Λ\Lambda are similar quantities as both are defined on the tangent bundle T ⁣MT\!M and II provides an upper bound, ΛI\Lambda\le I, that holds for all sample sizes -- asymptotics are not required. Comparing estimators using Λ\Lambda rather than variance supports Fisher's claim that II provides a bound even in small samples. Λ\Lambda-efficiency is defined that extends the efficiency of unbiased estimators based on variance. While defined by the slope, Λ\Lambda-efficiency is simply ρ2\rho^{2}, the square of the correlation between estimator and score function.

Keywords

Cite

@article{arxiv.2208.03630,
  title  = {Generalized Estimators, Slope, Efficiency, and Fisher Information Bounds},
  author = {Paul W. Vos},
  journal= {arXiv preprint arXiv:2208.03630},
  year   = {2022}
}

Comments

21 pages, 4 figures