English

Coded FFT and Its Communication Overhead

Information Theory 2018-05-28 v1 Distributed, Parallel, and Cluster Computing math.IT

Abstract

We propose a coded computing strategy and examine communication costs of coded computing algorithms to make distributed Fast Fourier Transform (FFT) resilient to errors during the computation. We apply maximum distance separable (MDS) codes to a widely used "Transpose" algorithm for parallel FFT. In the uncoded distributed FFT algorithm, the most expensive step is a single "all-to-all" communication. We compare this with communication overhead of coding in our coded FFT algorithm. We show that by using a systematic MDS code, the communication overhead of coding is negligible in comparison with the communication costs inherent in an uncoded FFT implementation if the number of parity nodes is at most o(logK)o(\log K), where KK is the number of systematic nodes.

Keywords

Cite

@article{arxiv.1805.09891,
  title  = {Coded FFT and Its Communication Overhead},
  author = {Haewon Jeong and Tze Meng Low and Pulkit Grover},
  journal= {arXiv preprint arXiv:1805.09891},
  year   = {2018}
}
R2 v1 2026-06-23T02:07:45.121Z