Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity
Abstract
Symbolic systems operate over precise identities: variables denote specific objects, pointers target precise memory locations, and database keys refer to singular records. Neural embeddings generalize by compressing away semantic detail, but this compression creates collision ambiguity: multiple distinct entities can share the same representation value. Exact identity recovery requires additional information precisely when representation fibers have size greater than one. The residual cost is controlled by a single combinatorial object: the collision-fiber geometry of the representation map . Let be the largest collision fiber. The finite laws include a tight fixed-length converse , an exact finite-block scaling law, a pointwise adaptive budget , and an exact fiberwise rate-distortion law for arbitrary finite sources via recoverable-mass decomposition across representation fibers. The uniform single-block formula appears as a closed-form special case when all mass lies on one collision block, where is the collision block size. The same fiber geometry determines query complexity and canonical structure for distinguishing families. Because this residual ambiguity is structural rather than representation-specific, symbolic identity mechanisms (handles, keys, pointers, nominal tags) are the necessary system-level complement to any non-injective semantic representation. All main results are machine-checked in Lean 4.
Keywords
Cite
@article{arxiv.2601.14252,
title = {Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity},
author = {Tristan Simas},
journal= {arXiv preprint arXiv:2601.14252},
year = {2026}
}
Comments
Main PDF: 12 pages, 1 table. Supplementary: 4 pages, 2 tables. Lean 4 artifact available at https://doi.org/10.5281/zenodo.18123531