English

SLAM: Structural Linguistic Activation Marking for Language Models

Computation and Language 2026-05-12 v2 Artificial Intelligence

Abstract

LLM watermarks must be detectable without compromising text quality, yet most existing schemes bias the next-token distribution and pay for detection with measurable quality loss. We present SLAM (Structural Linguistic Activation Marking), a novel white-box watermarking scheme that sidesteps this cost by writing the mark into structural geometry rather than token frequencies: sparse autoencoders identify residual-stream directions encoding linguistic structure (e.g., voice, tense, clause order), and we causally steer those directions at generation time, leaving lexical sampling and semantics unconstrained. On Gemma-2 2B and 9B, SLAM achieves 100% detection accuracy with a quality cost of only 1-2 reward points - compared to 7.5-11.5 for KGW, EWD, and Unigram - with naturalness and diversity preserved at near-unwatermarked levels across both models. The trade-off is a complementary robustness profile: SLAM resists word-level edits but is vulnerable to paraphrase that restructures syntax (at a quality cost), the converse of token-distribution methods.

Keywords

Cite

@article{arxiv.2605.05443,
  title  = {SLAM: Structural Linguistic Activation Marking for Language Models},
  author = {Fabrice Harel-Canada and Amit Sahai},
  journal= {arXiv preprint arXiv:2605.05443},
  year   = {2026}
}

Comments

Under review

R2 v1 2026-07-01T12:53:42.491Z