English

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

Information Theory 2026-05-04 v6 Programming Languages math.IT

Abstract

Symbolic systems operate over precise identities: variables denote specific objects, pointers target precise memory locations, and database keys refer to singular records. Neural embeddings generalize by compressing away semantic detail, but this compression creates collision ambiguity: multiple distinct entities can share the same representation value. Exact identity recovery requires additional information precisely when representation fibers have size greater than one. The residual cost is controlled by a single combinatorial object: the collision-fiber geometry of the representation map π\pi. Let Aπ=maxuπ1(u)A_{\pi}=\max_u |\pi^{-1}(u)| be the largest collision fiber. The finite laws include a tight fixed-length converse Llog2AπL \ge \log_2 A_{\pi}, an exact finite-block scaling law, a pointwise adaptive budget log2π1(u)\lceil \log_2 |\pi^{-1}(u)|\rceil, and an exact fiberwise rate-distortion law for arbitrary finite sources via recoverable-mass decomposition across representation fibers. The uniform single-block formula D(L)=max(0,12L/a)D^\star(L)=\max(0,1-2^L/a) appears as a closed-form special case when all mass lies on one collision block, where a=Aπa = A_{\pi} is the collision block size. The same fiber geometry determines query complexity and canonical structure for distinguishing families. Because this residual ambiguity is structural rather than representation-specific, symbolic identity mechanisms (handles, keys, pointers, nominal tags) are the necessary system-level complement to any non-injective semantic representation. All main results are machine-checked in Lean 4.

Keywords

Cite

@article{arxiv.2601.14252,
  title  = {Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity},
  author = {Tristan Simas},
  journal= {arXiv preprint arXiv:2601.14252},
  year   = {2026}
}

Comments

Main PDF: 12 pages, 1 table. Supplementary: 4 pages, 2 tables. Lean 4 artifact available at https://doi.org/10.5281/zenodo.18123531

R2 v1 2026-07-01T09:12:54.546Z