Many astronomy data centres still work on filesystems. Industry has moved on; current practice in computing infrastructure is to achieve Big Data scalability using object stores rather than POSIX file systems. This presents us with opportunities for portability and reuse of software underlying processing and archive systems but it also causes problems for legacy implementations in current data centers.
@article{arxiv.1907.13060,
title = {The demise of the filesystem and multi level service architecture},
author = {William O'Mullane and Niall Gaffney and Frossie Economou and Arfon M. Smith and J. Ross Thomson and Tim Jenness},
journal= {arXiv preprint arXiv:1907.13060},
year = {2019}
}
Comments
Submitted as decadal APC paper 2019. arXiv admin note: text overlap with arXiv:1905.05116