English

Distributed-Something: scripts to leverage AWS storage and computing for distributed workflows at scale

Distributed, Parallel, and Cluster Computing 2023-07-03 v3

Abstract

Distributed-Something coordinates the distribution of any Dockerized workflow using on-demand computational infrastructure from Amazon Web Services to enable at-scale workflows where neither computing power nor data storage are limited by local availability while minimizing the time-consuming and confusing aspects of architecture coordination. We also provide Distributed-Something implementations of several bioimaging tools: Distributed-CellProfiler, -Fiji, and -OmeZarrCreator. All are open-source and available at http://GitHub.com/DistributedScience.

Keywords

Cite

@article{arxiv.2210.01073,
  title  = {Distributed-Something: scripts to leverage AWS storage and computing for distributed workflows at scale},
  author = {Erin Weisbart and Beth A. Cimini},
  journal= {arXiv preprint arXiv:2210.01073},
  year   = {2023}
}

Comments

7 pages, 1 figure, 1 supplementary table

R2 v1 2026-06-28T02:42:26.141Z