Efficient Iterative Processing in the SciDB Parallel Array Engine
Databases
2015-06-02 v1
Abstract
Many scientific data-intensive applications perform iterative computations on array data. There exist multiple engines specialized for array processing. These engines efficiently support various types of operations, but none includes native support for iterative processing. In this paper, we develop a model for iterative array computations and a series of optimizations. We evaluate the benefits of an optimized, native support for iterative array processing on the SciDB engine and real workloads from the astronomy domain.
Cite
@article{arxiv.1506.00307,
title = {Efficient Iterative Processing in the SciDB Parallel Array Engine},
author = {Emad Soroush and Magdalena Balazinska and Simon Krughoff and Andrew Connolly},
journal= {arXiv preprint arXiv:1506.00307},
year = {2015}
}