English

LLM Watermark Evasion via Bias Inversion

Cryptography and Security 2026-05-28 v5 Artificial Intelligence

Abstract

Watermarking offers a promising solution for detecting LLM-generated content, yet its robustness under realistic query-free (black-box) evasion remains an open challenge. Existing query-free attacks often achieve limited success or severely distort semantic meaning. We bridge this gap by theoretically analyzing rewriting-based evasion, demonstrating that reducing the average conditional probability of sampling green tokens by a small margin causes the detection probability to decay exponentially. Guided by this insight, we propose the \emph{Bias-Inversion Rewriting Attack} (BIRA), a practical query-free method that applies a negative logit bias to a proxy suppression set identified via token surprisal. Empirically, BIRA achieves state-of-the-art evasion rates (>99%>99\%) across diverse watermarking schemes while preserving semantic fidelity substantially better than prior baselines. Our findings reveal a fundamental vulnerability in current watermarking methods and highlight the need for rigorous stress tests. Our code is available at \href{https://github.com/ml-postech/LLM-Watermark-Evasion-via-Bias-Inversion}{here}.

Keywords

Cite

@article{arxiv.2509.23019,
  title  = {LLM Watermark Evasion via Bias Inversion},
  author = {Jeongyeon Hwang and Sangdon Park and Jungseul Ok},
  journal= {arXiv preprint arXiv:2509.23019},
  year   = {2026}
}
R2 v1 2026-07-01T06:00:05.696Z