English

Double-Precision Matrix Multiplication Emulation via Ozaki-II Scheme with FP8 Quantization

Distributed, Parallel, and Cluster Computing 2026-04-07 v2

Abstract

In this paper, we propose a method for emulating double-precision general matrix--matrix multiplication (DGEMM), a fundamental and performance-critical kernel in many high-performance computing applications. Ozaki-I and Ozaki-II are established DGEMM emulation schemes via low-precision matrix multiply-accumulate (MMA) units. For the Ozaki-I scheme, INT8-, FP8-, and FP16-based implementations have been proposed, all of which can be realized based on the same underlying algorithmic structure. In contrast, although INT8-based implementations of the Ozaki-II scheme have been reported, the original algorithm cannot be directly adapted to exploit FP8 MMA units. In several recent architectures, such as NVIDIA Blackwell Ultra and NVIDIA Rubin, INT8 performance has been reduced, making reliance on INT8 alone insufficient. Therefore, we introduce a novel technique to demonstrate DGEMM emulation based on the Ozaki-II scheme that operates on FP8 MMA units. Compared to the FP8-based Ozaki-I scheme, our method significantly reduces the computational cost and enables efficient FP64 emulation.

Keywords

Cite

@article{arxiv.2603.10634,
  title  = {Double-Precision Matrix Multiplication Emulation via Ozaki-II Scheme with FP8 Quantization},
  author = {Yuki Uchino and Katsuhisa Ozaki and Toshiyuki Imamura},
  journal= {arXiv preprint arXiv:2603.10634},
  year   = {2026}
}

Comments

12 pages, 8 figures

R2 v1 2026-07-01T11:14:28.617Z