English

A randomized online quantile summary in $O(\frac{1}{\varepsilon} \log \frac{1}{\varepsilon})$ words

Data Structures and Algorithms 2015-03-05 v1

Abstract

A quantile summary is a data structure that approximates to ε\varepsilon-relative error the order statistics of a much larger underlying dataset. In this paper we develop a randomized online quantile summary for the cash register data input model and comparison data domain model that uses O(1εlog1ε)O(\frac{1}{\varepsilon} \log \frac{1}{\varepsilon}) words of memory. This improves upon the previous best upper bound of O(1εlog3/21ε)O(\frac{1}{\varepsilon} \log^{3/2} \frac{1}{\varepsilon}) by Agarwal et. al. (PODS 2012). Further, by a lower bound of Hung and Ting (FAW 2010) no deterministic summary for the comparison model can outperform our randomized summary in terms of space complexity. Lastly, our summary has the nice property that O(1εlog1ε)O(\frac{1}{\varepsilon} \log \frac{1}{\varepsilon}) words suffice to ensure that the success probability is 1epoly(1/ε)1 - e^{-\text{poly}(1/\varepsilon)}.

Keywords

Cite

@article{arxiv.1503.01156,
  title  = {A randomized online quantile summary in $O(\frac{1}{\varepsilon} \log \frac{1}{\varepsilon})$ words},
  author = {David Felber and Rafail Ostrovsky},
  journal= {arXiv preprint arXiv:1503.01156},
  year   = {2015}
}

Comments

slight fixes to version submitted to ICALP 2015--mistake in time complexity, and a few minor numeric miscalculations in section 3