English

Dynamo -- Handling Scientific Data Across Sites and Storage Media

Distributed, Parallel, and Cluster Computing 2021-05-18 v2 High Energy Physics - Experiment

Abstract

Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small scale analysis facility.

Keywords

Cite

@article{arxiv.2003.11409,
  title  = {Dynamo -- Handling Scientific Data Across Sites and Storage Media},
  author = {Yutaro Iiyama and Benedikt Maier and Daniel Abercrombie and Maxim Goncharov and Christoph Paus},
  journal= {arXiv preprint arXiv:2003.11409},
  year   = {2021}
}

Comments

18 pages, 9 figures

R2 v1 2026-06-23T14:26:51.102Z