English

Tight Lower Bounds for Central String Queries in Compressed Space

Data Structures and Algorithms 2025-10-23 v1

Abstract

In this work, we study the limits of compressed data structures, i.e., structures that support various queries on an input text TΣnT\in\Sigma^n using space proportional to the size of TT in compressed form. Nearly all fundamental queries can currently be efficiently supported in O(δ(T)logO(1)n)O(\delta(T)\log^{O(1)}n) space, where δ(T)\delta(T) is the substring complexity, a strong compressibility measure that lower-bounds the optimal space to represent the text [Kociumaka, Navarro, Prezza, IEEE Trans. Inf. Theory 2023]. However, optimal query time has been characterized only for random access. We address this gap by developing tight lower bounds for nearly all other fundamental queries: (1) We prove that suffix array (SA), inverse suffix array (SA1^{-1}), longest common prefix (LCP) array, and longest common extension (LCE) queries all require Ω(logn/loglogn)\Omega(\log n/\log\log n) time within O(δ(T)logO(1)n)O(\delta(T)\log^{O(1)}n) space, matching known upper bounds. (2) We further show that other common queries, currently supported in O(loglogn)O(\log\log n) time and O(δ(T)logO(1)n)O(\delta(T)\log^{O(1)}n) space, including the Burrows-Wheeler Transform (BWT), permuted longest common prefix (PLCP) array, Last-to-First (LF), inverse LF, lexicographic predecessor (Φ\Phi), and inverse Φ\Phi queries, all require Ω(loglogn)\Omega(\log\log n) time, yielding another set of tight bounds. Our lower bounds hold even for texts over a binary alphabet. This work establishes a clean dichotomy: the optimal time complexity to support central string queries in compressed space is either Θ(logn/loglogn)\Theta(\log n/\log\log n) or Θ(loglogn)\Theta(\log\log n). This completes the theoretical foundation of compressed indexing, closing a crucial gap between upper and lower bounds and providing a clear target for future data structures: seeking either the optimal time in the smallest space or the fastest time in the optimal space, both of which are now known for central string queries.

Keywords

Cite

@article{arxiv.2510.19820,
  title  = {Tight Lower Bounds for Central String Queries in Compressed Space},
  author = {Dominik Kempa and Tomasz Kociumaka},
  journal= {arXiv preprint arXiv:2510.19820},
  year   = {2025}
}

Comments

Full version of a SODA 2026 paper

R2 v1 2026-07-01T07:00:17.457Z