In this paper we describe the development of a streamlined framework for large-scale ATLAS pMSSM reinterpretations of LHC Run-2 analyses using containerised computational workflows. The project is looking to assess the global coverage of BSM physics and requires running O(5k) computational workflows representing pMSSM model points. Following ATLAS Analysis Preservation policies, many analyses have been preserved as containerised Yadage workflows, and after validation were added to a curated selection for the pMSSM study. To run the workflows at scale, we utilised the REANA reusable analysis platform. We describe how the REANA platform was enhanced to ensure the best concurrent throughput by internal service scheduling changes. We discuss the scalability of the approach on Kubernetes clusters from 500 to 5000 cores. Finally, we demonstrate a possibility of using additional ad-hoc public cloud infrastructure resources by running the same workflows on the Google Cloud Platform.
@article{arxiv.2403.03494,
title = {Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform},
author = {Marco Donadoni and Matthew Feickert and Lukas Heinrich and Yang Liu and Audrius Mečionis and Vladyslav Moisieienkov and Tibor Šimko and Giordon Stark and Marco Vidal García},
journal= {arXiv preprint arXiv:2403.03494},
year = {2024}
}
Comments
8 pages, 9 figures. Contribution to the Proceedings of the 26th International Conference on Computing In High Energy and Nuclear Physics (CHEP 2023)