English

The site frequency spectrum for general coalescents

Populations and Evolution 2016-05-10 v2 Probability

Abstract

General genealogical processes such as Λ\Lambda- and Ξ\Xi-coalescents, which respectively model multiple and simultaneous mergers, have important applications in studying marine species, strong positive selection, recurrent selective sweeps, strong bottlenecks, large sample sizes, and so on. Recently, there has been significant progress in developing useful inference tools for such general models. In particular, inference methods based on the site frequency spectrum (SFS) have received noticeable attention. Here, we derive a new formula for the expected SFS for general Λ\Lambda- and Ξ\Xi-coalescents, which leads to an efficient algorithm. For time-homogeneous coalescents, the runtime of our algorithm for computing the expected SFS is O(n2)O(n^2), where nn is the sample size. This is a factor of n2n^2 faster than the state-of-the-art method. Furthermore, in contrast to existing methods, our method generalizes to time-inhomogeneous Λ\Lambda- and Ξ\Xi-coalescents with measures that factorize as Λ(dx)/ζ(t)\Lambda(dx)/\zeta(t) and Ξ(dx)/ζ(t)\Xi(dx)/\zeta(t), respectively, where ζ\zeta denotes a strictly positive function of time. The runtime of our algorithm in this setting is O(n3)O(n^3). We also obtain general theoretical results for the identifiability of the Λ\Lambda measure when ζ\zeta is a constant function, as well as for the identifiability of the function ζ\zeta under a fixed Ξ\Xi measure.

Keywords

Cite

@article{arxiv.1510.05631,
  title  = {The site frequency spectrum for general coalescents},
  author = {Jeffrey P. Spence and John A. Kamm and Yun S. Song},
  journal= {arXiv preprint arXiv:1510.05631},
  year   = {2016}
}

Comments

20 pages, 4 figure