English

Maximum likelihood estimates under $\mathbf{k}$-allele models with selection can be numerically unstable

Applications 2009-10-12 v1

Abstract

The stationary distribution of allele frequencies under a variety of Wright--Fisher kk-allele models with selection and parent independent mutation is well studied. However, the statistical properties of maximum likelihood estimates of parameters under these models are not well understood. Under each of these models there is a point in data space which carries the strongest possible signal for selection, yet, at this point, the likelihood is unbounded. This result remains valid even if all of the mutation parameters are assumed to be known. Therefore, standard simulation approaches used to approximate the sampling distribution of the maximum likelihood estimate produce numerically unstable results in the presence of substantial selection. We describe the Bayesian alternative where the posterior distribution tends to produce more accurate and reliable interval estimates for the selection intensity at a locus.

Keywords

Cite

@article{arxiv.0910.1664,
  title  = {Maximum likelihood estimates under $\mathbf{k}$-allele models with selection can be numerically unstable},
  author = {Erkan Ozge Buzbas and Paul Joyce},
  journal= {arXiv preprint arXiv:0910.1664},
  year   = {2009}
}

Comments

Published in at http://dx.doi.org/10.1214/09-AOAS237 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

R2 v1 2026-06-21T13:56:08.767Z