English

Distributed Spatial-Keyword kNN Monitoring for Location-aware Pub/Sub

Databases 2021-02-11 v3

Abstract

Recent applications employ publish/subscribe (Pub/Sub) systems so that publishers can easily receive attentions of customers and subscribers can monitor useful information generated by publishers. Due to the prevalence of smart devices and social networking services, a large number of objects that contain both spatial and keyword information have been generated continuously, and the number of subscribers also continues to increase. This poses a challenge to Pub/Sub systems: they need to continuously extract useful information from massive objects for each subscriber in real time. In this paper, we address the problem of k nearest neighbor monitoring on a spatial-keyword data stream for a large number of subscriptions. To scale well to massive objects and subscriptions, we propose a distributed solution, namely DkM-SKS. Given m workers, DkM-SKS divides a set of subscriptions into m disjoint subsets based on a cost model so that each worker has almost the same kNN-update cost, to maintain load balancing. DkM-SKS allows an arbitrary approach to updating kNN of each subscription, so with a suitable in-memory index, DkM-SKS can accelerate update efficiency by pruning irrelevant subscriptions for a given new object. We conduct experiments on real datasets, and the results demonstrate the efficiency and scalability of DkM-SKS.

Keywords

Cite

@article{arxiv.2101.12417,
  title  = {Distributed Spatial-Keyword kNN Monitoring for Location-aware Pub/Sub},
  author = {Shohei Tsuruoka and Daichi Amagata and Shunya Nishio and Takahiro Hara},
  journal= {arXiv preprint arXiv:2101.12417},
  year   = {2021}
}

Comments

10 pages