English

AI-coupled HPC Workflow Applications, Middleware and Performance

Distributed, Parallel, and Cluster Computing 2025-06-26 v2

Abstract

AI integration is revolutionizing the landscape of HPC simulations, enhancing the importance, use, and performance of AI-driven HPC workflows. This paper surveys the diverse and rapidly evolving field of AI-driven HPC and provides a common conceptual basis for understanding AI-driven HPC workflows. Specifically, we use insights from different modes of coupling AI into HPC workflows to propose six execution motifs most commonly found in scientific applications. The proposed set of execution motifs is by definition incomplete and evolving. However, they allow us to analyze the primary performance challenges underpinning AI-driven HPC workflows. We close with a listing of open challenges, research issues, and suggested areas of investigation including the the need for specific benchmarks that will help evaluate and improve the execution of AI-driven HPC workflows.

Keywords

Cite

@article{arxiv.2406.14315,
  title  = {AI-coupled HPC Workflow Applications, Middleware and Performance},
  author = {Wes Brewer and Ana Gainaru and Frédéric Suter and Feiyi Wang and Murali Emani and Shantenu Jha},
  journal= {arXiv preprint arXiv:2406.14315},
  year   = {2025}
}
R2 v1 2026-06-28T17:13:26.578Z