English

A mathematical formalization of data parallel operations

Distributed, Parallel, and Cluster Computing 2016-02-09 v1

Abstract

We give a mathematical formalization of `generalized data parallel' operations, a concept that covers such common scientific kernels as matrix-vector multiplication, multi-grid coarsening, load distribution, and many more. We show that from a compact specification such computational aspects as MPI messages or task dependencies can be automatically derived.

Keywords

Cite

@article{arxiv.1602.02409,
  title  = {A mathematical formalization of data parallel operations},
  author = {Victor Eijkhout},
  journal= {arXiv preprint arXiv:1602.02409},
  year   = {2016}
}
R2 v1 2026-06-22T12:45:02.247Z