English

Approximate Integration of streaming data

Social and Information Networks 2017-09-14 v1 Databases

Abstract

We approximate analytic queries on streaming data with a weighted reservoir sampling. For a stream of tuples of a Datawarehouse we show how to approximate some OLAP queries. For a stream of graph edges from a Social Network, we approximate the communities as the large connected components of the edges in the reservoir. We show that for a model of random graphs which follow a power law degree distribution, the community detection algorithm is a good approximation. Given two streams of graph edges from two Sources, we define the {\em Community Correlation} as the fraction of the nodes in communities in both streams. Although we do not store the edges of the streams, we can approximate the Community Correlation and define the {\em Integration of two streams}. We illustrate this approach with Twitter streams, associated with TV programs.

Keywords

Cite

@article{arxiv.1709.04290,
  title  = {Approximate Integration of streaming data},
  author = {Michel de Rougemont and Guillaume Vimont},
  journal= {arXiv preprint arXiv:1709.04290},
  year   = {2017}
}

Comments

17 pages;Revue des Nouvelles Technologies de l'Information, 2017

R2 v1 2026-06-22T21:41:44.937Z