English

Optimal Approximate Matrix Multiplication over Sliding Window

Data Structures and Algorithms 2025-02-26 v1

Abstract

Matrix multiplication is a core operation in numerous applications, yet its exact computation becomes prohibitively expensive as data scales, especially in streaming environments where timeliness is critical. In many real-world scenarios, data arrives continuously, making it essential to focus on recent information via sliding windows. While existing approaches offer approximate solutions, they often suffer from suboptimal space complexities when extended to the sliding-window setting. In this work, we introduce SO-COD, a novel algorithm for approximate matrix multiplication (AMM) in the sliding-window streaming setting, where only the most recent data is retained for computation. Inspired by frequency estimation over sliding windows, our method tracks significant contributions, referred to as snapshots, from incoming data and efficiently updates them as the window advances. Given matrices XRdx×n\boldsymbol{X} \in \mathbb{R}^{d_x \times n} and YRdy×n\boldsymbol{Y} \in \mathbb{R}^{d_y \times n} for computing XYT\boldsymbol{X} \boldsymbol{Y}^T, we analyze two data settings. In the \emph{normalized} setting, where each column of the input matrices has a unit L2L_2 norm, SO-COD achieves an optimal space complexity of O(dx+dyϵ) O\left(\frac{d_x+d_y}{\epsilon}\right) . In the \emph{unnormalized} setting, where the square of column norms vary within a bounded range [1,R][1, R], we show that the space requirement is O(dx+dyϵlogR) O\left(\frac{d_x+d_y}{\epsilon}\log R\right) , which matches the theoretical lower bound for an ϵ\epsilon-approximation guarantee. Extensive experiments on synthetic and real-world datasets demonstrate that SO-COD effectively balances space cost and approximation error, making it a promising solution for large-scale, dynamic streaming matrix multiplication.

Keywords

Cite

@article{arxiv.2502.17940,
  title  = {Optimal Approximate Matrix Multiplication over Sliding Window},
  author = {Haoming Xian and Qintian Guo and Jun Zhang and Sibo Wang},
  journal= {arXiv preprint arXiv:2502.17940},
  year   = {2025}
}
R2 v1 2026-06-28T21:56:53.703Z