Stream quantiles via maximal entropy histograms
Data Structures and Algorithms
2014-09-26 v1
Abstract
We address the problem of estimating the running quantile of a data stream when the memory for storing observations is limited. We (i) highlight the limitations of approaches previously described in the literature which make them unsuitable for non-stationary streams, (ii) describe a novel principle for the utilization of the available storage space, and (iii) introduce two novel algorithms which exploit the proposed principle. Experiments on three large real-world data sets demonstrate that the proposed methods vastly outperform the existing alternatives.
Keywords
Cite
@article{arxiv.1409.7289,
title = {Stream quantiles via maximal entropy histograms},
author = {Ognjen Arandjelovic and Ducson Pham and Svetha Venkatesh},
journal= {arXiv preprint arXiv:1409.7289},
year = {2014}
}
Comments
appears in International Conference on Neural Information Processing, 2014