English

WarpSpeed: A High-Performance Library for Concurrent GPU Hash Tables

Distributed, Parallel, and Cluster Computing 2025-10-24 v2 Data Structures and Algorithms

Abstract

GPU hash tables are increasingly used to accelerate data processing, but their limited functionality restricts adoption in large-scale data processing applications. Current limitations include incomplete concurrency support and missing compound operations such as upserts. This paper presents WarpSpeed, a library of high-performance concurrent GPU hash tables with a unified benchmarking framework for performance analysis. WarpSpeed implements eight state-of-the-art Nvidia GPU hash table designs and provides a rich API designed for modern GPU applications. Our evaluation uses diverse benchmarks to assess both correctness and scalability, and we demonstrate real-world impact by integrating these hash tables into three downstream applications. We propose several optimization techniques to reduce concurrency overhead, including fingerprint-based metadata to minimize cache line probes and specialized Nvidia GPU instructions for lock-free queries. Our findings provide new insights into concurrent GPU hash table design and offer practical guidance for developing efficient, scalable data structures on modern GPUs.

Keywords

Cite

@article{arxiv.2509.16407,
  title  = {WarpSpeed: A High-Performance Library for Concurrent GPU Hash Tables},
  author = {Hunter McCoy and Prashant Pandey},
  journal= {arXiv preprint arXiv:2509.16407},
  year   = {2025}
}

Comments

Accepted to ALENEX`26

R2 v1 2026-07-01T05:46:40.044Z