English

Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows

Distributed, Parallel, and Cluster Computing 2025-06-03 v1

Abstract

The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration.

Keywords

Cite

@article{arxiv.2506.01744,
  title  = {Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows},
  author = {Brian D. Etz and David M. Rogers and Michael J. Brim and Ketan Maheshwari and Kellen Leland and Tyler J. Skluzacek and Jack Lange and Daniel Pelfrey and Jordan Webb and Patrick Widener and Ryan Adamson and Christopher Zimmer and Veronica G. Melesse Vergara and Mallikarjun Shankar and Sarp Oral and Rafael Ferreira da Silva},
  journal= {arXiv preprint arXiv:2506.01744},
  year   = {2025}
}
R2 v1 2026-07-01T02:54:35.445Z