English

Managing, Analyzing and Sharing Research Data with Gen3 Data Commons

Distributed, Parallel, and Cluster Computing 2025-08-08 v1

Abstract

Gen3 is an open-source data platform for building data commons. A data commons is a cloud-based data platform for managing, analyzing, and sharing data with a research community. Gen3 has been used to build over a dozen data commons that in aggregate contain over 28 PB of data and 64 million FAIR data objects. To set up a Gen3 data commons, you first define a data model. Gen3 then autogenerates 1) a data portal for searching and exploring data in the commons; 2) a data portal for submitting data to the commons; and 3) FAIR APIs for accessing the data programmatically. Gen3 is built over a small number of standards-based software services, which are designed to support current and future Gen3 components so that Gen3 can interoperate with other data platforms and data ecosystems.

Keywords

Cite

@article{arxiv.2508.04944,
  title  = {Managing, Analyzing and Sharing Research Data with Gen3 Data Commons},
  author = {Craig Barnes and Kyle Burton and Michael S. Fitzsimons and Hara Prasad Juvvala and Brienna Larrick and Christopher Meyer and Pauline Ribeyre and Ao Liu and Clint Malson and Noah Metoki-Shlubsky and Andrii Prokhorenkov and Jawad Qureshi and Radhika Reddy and L. Philip Schumm and Mingfei Shao and Trevar Simmons and Alexander VanTol and Peter Vassilatos and Aarti Venkat and Robert L. Grossman},
  journal= {arXiv preprint arXiv:2508.04944},
  year   = {2025}
}

Comments

20 pages, 9 figures

R2 v1 2026-07-01T04:38:15.799Z