English

LLMs as Packagers of HPC Software

Software Engineering 2025-11-11 v1 Artificial Intelligence Distributed, Parallel, and Cluster Computing

Abstract

High performance computing (HPC) software ecosystems are inherently heterogeneous, comprising scientific applications that depend on hundreds of external packages, each with distinct build systems, options, and dependency constraints. Tools such as Spack automate dependency resolution and environment management, but their effectiveness relies on manually written build recipes. As these ecosystems grow, maintaining existing specifications and creating new ones becomes increasingly labor-intensive. While large language models (LLMs) have shown promise in code generation, automatically producing correct and maintainable Spack recipes remains a significant challenge. We present a systematic analysis of how LLMs and context-augmentation methods can assist in the generation of Spack recipes. To this end, we introduce SpackIt, an end-to-end framework that combines repository analysis, retrieval of relevant examples, and iterative refinement through diagnostic feedback. We apply SpackIt to a representative subset of 308 open-source HPC packages to assess its effectiveness and limitations. Our results show that SpackIt increases installation success from 20% in a zero-shot setting to over 80% in its best configuration, demonstrating the value of retrieval and structured feedback for reliable package synthesis.

Keywords

Cite

@article{arxiv.2511.05626,
  title  = {LLMs as Packagers of HPC Software},
  author = {Caetano Melone and Daniel Nichols and Konstantinos Parasyris and Todd Gamblin and Harshitha Menon},
  journal= {arXiv preprint arXiv:2511.05626},
  year   = {2025}
}
R2 v1 2026-07-01T07:26:56.789Z