English

An Adaptive Distributed Stencil Abstraction for GPUs

Distributed, Parallel, and Cluster Computing 2026-03-17 v1

Abstract

The scientific computing ecosystem in Python is largely confined to single-node parallelism, creating a gap between high-level prototyping in NumPy and high-performance execution on modern supercomputers. The increasing prevalence of hardware accelerators and the need for energy efficiency have made resource adaptivity a critical requirement, yet traditional HPC abstractions remain rigid. To address these challenges, we present an adaptive, distributed abstraction for stencil computations on multi-node GPUs. This abstraction is built using CharmTyles, a framework based on the adaptive Charm++ runtime, and features a familiar NumPy-like syntax to minimize the porting effort from prototype to production code. We showcase the resource elasticity of our abstraction by dynamically rescaling a running application across a different number of nodes and present a performance analysis of the associated overheads. Furthermore, we demonstrate that our abstraction achieves significant performance improvements over both a specialized, high-performance stencil DSL and a generalized NumPy replacement.

Keywords

Cite

@article{arxiv.2512.19851,
  title  = {An Adaptive Distributed Stencil Abstraction for GPUs},
  author = {Aditya Bhosale and Laxmikant Kale},
  journal= {arXiv preprint arXiv:2512.19851},
  year   = {2026}
}
R2 v1 2026-07-01T08:37:42.149Z