Architectural Limits of Cloud TPUs in Finite-Field Cryptography
Abstract
We empirically characterise the cost-efficiency deficit between cloud Tensor Processing Units and GPUs for finite-field cryptography. Against A100 GPU baselines (cuZK), we measure a deficit across v5p and v4 architectures under an FP32-mantissa staging discipline, and a deficit using v5p's native \texttt{int32} accumulator. We analytically project this deficit into a fundamental arithmetic penalty (lacking wide-integer ALUs) and a spatial penalty. We demonstrate that evaluating concurrent multi-tenant deployments, where strict separation forces eager Montgomery reduction, yields a projected spatial collapse; relaxing this constraint theoretically recovers these spatial cycles, yet the underlying arithmetic penalty remains. To facilitate this characterisation, we deploy \codename as a measurement vehicle. By mapping low-degree polynomials onto matrix-form Number Theoretic Transforms, the scheduler stacks heterogeneous polynomials into dense 2D matrices, achieving K-dimension column occupancy on uniform workloads ( on mixed-degree traces). However, despite optimal K-dimension packing, severe M-dimension under-utilisation (e.g., on v4) combined with overwhelming VPU-bound Montgomery reduction stalls mathematically starve the systolic arrays. A post-hoc HLO validator ensures these measurements remain structurally isolated against the XLA fusion engine. Our findings empirically demonstrate the structural inadequacy of AI-optimised systolic arrays for exact, high-throughput field arithmetic.
Keywords
Cite
@article{arxiv.2605.25367,
title = {Architectural Limits of Cloud TPUs in Finite-Field Cryptography},
author = {Hung Dang and Xuan Phu Dang and Tue Nguyen},
journal= {arXiv preprint arXiv:2605.25367},
year = {2026}
}