English

Computing Extremely Accurate Quantiles Using t-Digests

Computation 2019-02-12 v1 Data Structures and Algorithms

Abstract

We present on-line algorithms for computing approximations of rank-based statistics that give high accuracy, particularly near the tails of a distribution, with very small sketches. Notably, the method allows a quantile qq to be computed with an accuracy relative to max(q,1q)\max(q, 1-q) rather than absolute accuracy as with most other methods. This new algorithm is robust with respect to skewed distributions or ordered datasets and allows separately computed summaries to be combined with no loss in accuracy. An open-source Java implementation of this algorithm is available from the author. Independent implementations in Go and Python are also available.

Keywords

Cite

@article{arxiv.1902.04023,
  title  = {Computing Extremely Accurate Quantiles Using t-Digests},
  author = {Ted Dunning and Otmar Ertl},
  journal= {arXiv preprint arXiv:1902.04023},
  year   = {2019}
}

Comments

22 pages, 10 figures

R2 v1 2026-06-23T07:37:54.399Z