English

Exploiting Task-Based Parallelism for the Red-Black Gauss-Seidel Method on 2D Grids

Distributed, Parallel, and Cluster Computing 2026-07-02 v1 Numerical Analysis

Abstract

Gauss-Seidel is a well-established iterative method for the solution of linear systems, and multicoloring has been widely used to increase parallelism in iterative solution techniques. Implementing multi-color Gauss-Seidel with conventional divide-and-conquer parallelization strategies, however, may be inefficient due to global synchronization requirements and load imbalances. Task-based programming models can mitigate these issues by enabling fine-grained parallelism, removing global barriers and allowing updates of different colors to partially overlap in time. In this work, we implement the red-black Gauss-Seidel method using two task-based programming models and compare them with a classical divide-and-conquer parallel implementation to evaluate the impact of fine-grained parallelism on execution efficiency. The red-black scheme serves as a representative example, as task-based approaches naturally extend to more general multi-color schemes arising from unstructured grids and wider stencils. Using the solve of the 2D Poisson equation as benchmark, our results show that task-based implementations can achieve performance comparable to conventional divide-and-conquer parallelization while providing greater resilience to hardware-level asynchronicity.

Cite

@article{arxiv.2607.01735,
  title  = {Exploiting Task-Based Parallelism for the Red-Black Gauss-Seidel Method on 2D Grids},
  author = {Shiting Long and Gustavo Ramirez-Hidalgo and Andreas Frommer and Dirk Pleiter},
  journal= {arXiv preprint arXiv:2607.01735},
  year   = {2026}
}