English
Related papers

Related papers: Debiasing Watermarks for Large Language Models via…

200 papers

Multi-bit watermarking has emerged as a promising solution for embedding imperceptible binary messages into Large Language Model (LLM)-generated text, enabling reliable attribution and tracing of malicious usage of LLMs. Despite recent…

Computation and Language · Computer Science 2026-04-17 Jiahao Xu , Rui Hu , Olivera Kotevska , Zikai Zhang

The rapid advancement of large language models (LLMs) has raised concerns regarding their potential misuse, particularly in generating fake news and misinformation. To address these risks, watermarking techniques for autoregressive language…

Cryptography and Security · Computer Science 2025-06-24 Koichi Nagatsuka , Terufumi Morishita , Yasuhiro Sogawa

As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse. Most detectors for identifying model-generated text are limited by their…

Cryptography and Security · Computer Science 2024-10-10 Zhenyu Xu , Victor S. Sheng

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

Computation and Language · Computer Science 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models (LMs). However, the robustness of the watermarking schemes has not been…

Computation and Language · Computer Science 2025-07-04 Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang

The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token…

Computation and Language · Computer Science 2023-11-17 Yuhang Li , Yihan Wang , Zhouxing Shi , Cho-Jui Hsieh

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily…

Cryptography and Security · Computer Science 2025-03-04 Yuhang Cai , Yaofei Wang , Donghui Hu , Chen Gu

We propose a methodology for planting watermarks in text from an autoregressive language model that are robust to perturbations without changing the distribution over text up to a certain maximum generation budget. We generate watermarked…

Machine Learning · Computer Science 2024-06-07 Rohith Kuditipudi , John Thickstun , Tatsunori Hashimoto , Percy Liang

Watermarking has emerged as a promising solution for tracing and authenticating text generated by large language models (LLMs). A common approach to LLM watermarking is to construct a green/red token list and assign higher or lower…

Cryptography and Security · Computer Science 2025-10-27 Li An , Yujian Liu , Yepeng Liu , Yuheng Bu , Yang Zhang , Shiyu Chang

Misuse of LLM-generated text can be curbed by watermarking techniques that embed implicit signals into the output. We propose a watermark that partitions the vocabulary at each decoding step into three sets (Green/Yellow/Red) with fixed…

Computation and Language · Computer Science 2025-12-23 Zhiqing Hu , Chenxu Zhao , Jiazhong Lu , Xiaolei Liu

Large language models now draft news, legal analyses, and software code with human-level fluency. At the same time, regulations such as the EU AI Act mandate that each synthetic passage carry an imperceptible, machine-verifiable mark for…

Artificial Intelligence · Computer Science 2025-11-14 Shinwoo Park , Hyejin Park , Hyeseon Ahn , Yo-Sub Han

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

Cryptography and Security · Computer Science 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

A new approach to linguistic watermarking of language models is presented in which information is imperceptibly inserted into the output text while preserving its readability and original meaning. A cross-attention mechanism is used to…

Computation and Language · Computer Science 2024-04-10 Folco Bertini Baldassini , Huy H. Nguyen , Ching-Chung Chang , Isao Echizen

With the widespread adoption of Large Language Models (LLMs), concerns about potential misuse have emerged. To this end, watermarking has been adapted to LLM, enabling a simple and effective way to detect and monitor generated text.…

Cryptography and Security · Computer Science 2024-07-22 Duy C. Hoang , Hung T. Q. Le , Rui Chu , Ping Li , Weijie Zhao , Yingjie Lao , Khoa D. Doan

Text watermarking plays a crucial role in ensuring the traceability and accountability of large language model (LLM) outputs and mitigating misuse. While promising, most existing methods assume perfect pseudorandomness. In practice,…

Statistics Theory · Mathematics 2026-01-21 T. Tony Cai , Xiang Li , Qi Long , Weijie J. Su , Garrett G. Wen

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

Machine Learning · Statistics 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect…

We show the viability of tackling misuses of large language models beyond the identification of machine-generated text. While existing zero-bit watermark methods focus on detection only, some malicious misuses demand tracing the adversary…

Computation and Language · Computer Science 2024-03-21 KiYoon Yoo , Wonhyuk Ahn , Nojun Kwak

Language model (LM) watermarking techniques inject a statistical signal into LM-generated content by substituting the random sampling process with pseudo-random sampling, using watermark keys as the random seed. Among these statistical…

Cryptography and Security · Computer Science 2024-06-06 Yihan Wu , Ruibo Chen , Zhengmian Hu , Yanshuo Chen , Junfeng Guo , Hongyang Zhang , Heng Huang

As large language models (LLMs) grow more powerful, concerns over copyright infringement of LLM-generated texts have intensified. LLM watermarking has been proposed to trace unauthorized redistribution or resale of generated content by…

Cryptography and Security · Computer Science 2025-08-05 Qihao Lin , Chen Tang , Lan zhang , Junyang zhang , Xiangyang Li