English

Linear-Scaling Tensor Train Sketching

Numerical Analysis 2026-03-16 v2 Data Structures and Algorithms Numerical Analysis

Abstract

We introduce the TTStack sketch, a structured random projection tailored to the tensor train (TT) format that unifies existing TT-adapted sketching operators. By varying two integer parameters PP and RR, TTStack interpolates between the Khatri-Rao sketch (R=1R=1) and the Gaussian TT sketch (P=1P=1). We prove that TTStack satisfies an oblivious subspace embedding (OSE) property with parameters R=O(d(r+log1/δ))R = \mathcal{O}(d(r+\log 1/\delta)) and P=O(ε2)P = \mathcal{O}(\varepsilon^{-2}), and an oblivious subspace injection (OSI) property under the condition R=O(d)R = \mathcal{O}(d) and P=O(ε2(r+logr/δ))P = \mathcal{O}(\varepsilon^{-2}(r + \log r/\delta)). Both guarantees depend only linearly on the tensor order dd and on the subspace dimension rr, in contrast to prior constructions that suffer from exponential scaling in dd. As direct consequences, we derive quasi-optimal error bounds for the QB factorization and randomized TT rounding. The theoretical results are supported by numerical experiments on synthetic tensors, Hadamard products, and a quantum chemistry application.

Cite

@article{arxiv.2603.11009,
  title  = {Linear-Scaling Tensor Train Sketching},
  author = {Paul Cazeaux and Mi-Song Dupuy and Rodrigo Figueroa Justiniano},
  journal= {arXiv preprint arXiv:2603.11009},
  year   = {2026}
}
R2 v1 2026-07-01T11:15:05.899Z