English

Adaptive filter ordering in Spark

Databases 2019-05-07 v1 Distributed, Parallel, and Cluster Computing

Abstract

This report describes a technical methodology to render the Apache Spark execution engine adaptive. It presents the engineering solutions, which specifically target to adaptively reorder predicates in data streams with evolving statistics. The system extension developed is available as an open-source prototype. Indicative experimental results show its overhead and sensitivity to tuning parameters.

Cite

@article{arxiv.1905.01349,
  title  = {Adaptive filter ordering in Spark},
  author = {Nikodimos Nikolaidis and Anastasios Gounaris},
  journal= {arXiv preprint arXiv:1905.01349},
  year   = {2019}
}

Comments

9 pages

R2 v1 2026-06-23T08:56:41.080Z