English

Universal sketches for the frequency negative moments and other decreasing streaming sums

Data Structures and Algorithms 2015-02-17 v2

Abstract

Given a stream with frequencies fdf_d, for d[n]d\in[n], we characterize the space necessary for approximating the frequency negative moments Fp=fdpF_p=\sum |f_d|^p, where p<0p<0 and the sum is taken over all items d[n]d\in[n] with nonzero frequency, in terms of nn, ϵ\epsilon, and m=fdm=\sum |f_d|. To accomplish this, we actually prove a much more general result. Given any nonnegative and nonincreasing function gg, we characterize the space necessary for any streaming algorithm that outputs a (1±ϵ)(1\pm\epsilon)-approximation to g(fd)\sum g(|f_d|), where again the sum is over items with nonzero frequency. The storage required is expressed in the form of the solution to a relatively simple nonlinear optimization problem, and the algorithm is universal for (1±ϵ)(1\pm\epsilon)-approximations to any such sum where the applied function is nonnegative, nonincreasing, and has the same or smaller space complexity as gg. This partially answers an open question of Nelson (IITK Workshop Kanpur, 2009).

Keywords

Cite

@article{arxiv.1408.5096,
  title  = {Universal sketches for the frequency negative moments and other decreasing streaming sums},
  author = {Vladimir Braverman and Stephen R. Chestnut},
  journal= {arXiv preprint arXiv:1408.5096},
  year   = {2015}
}

Comments

19 pages