English

Monitoring of Domain-Related Problems in Distributed Data Streams

Data Structures and Algorithms 2017-06-13 v1

Abstract

Consider a network in which nn distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes. That is, in any time step tt, it has to compute an output based on all values currently observed across all streams. To do so, nodes can send messages to the server and the server can broadcast messages to the nodes. The objective is the minimisation of communication while allowing the server to compute the desired output. We consider monitoring problems related to the domain DtD_t defined to be the set of values observed by at least one node at time tt. We provide randomised algorithms for monitoring DtD_t, (approximations of) the size Dt|D_t| and the frequencies of all members of DtD_t. Besides worst-case bounds, we also obtain improved results when inputs are parameterised according to the similarity of observations between consecutive time steps. This parameterisation allows to exclude inputs with rapid and heavy changes, which usually lead to the worst-case bounds but might be rather artificial in certain scenarios.

Keywords

Cite

@article{arxiv.1706.03568,
  title  = {Monitoring of Domain-Related Problems in Distributed Data Streams},
  author = {Pascal Bemmann and Felix Biermeier and Jan Bürmann and Arne Kemper and Till Knollmann and Steffen Knorr and Nils Kothe and Alexander Mäcker and Manuel Malatyali and Friedhelm Meyer auf der Heide and Sören Riechers and Johannes Schaefer and Jannik Sundermeier},
  journal= {arXiv preprint arXiv:1706.03568},
  year   = {2017}
}
R2 v1 2026-06-22T20:15:57.525Z