English
Related papers

Related papers: Watermarking Low-entropy Generation for Large Lang…

200 papers

We present a publicly-detectable watermarking scheme for LMs: the detection algorithm contains no secret information, and it is executable by anyone. We embed a publicly-verifiable cryptographic signature into LM output using rejection…

Machine Learning · Computer Science 2025-01-07 Jaiden Fairoze , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Mingyuan Wang

Large language models (LLMs) are increasingly integrated into real-world personalized applications through retrieval-augmented generation (RAG) mechanisms to supplement their responses with domain-specific knowledge. However, the valuable…

Cryptography and Security · Computer Science 2025-05-26 Junfeng Guo , Yiming Li , Ruibo Chen , Yihan Wu , Chenxi Liu , Yanshuo Chen , Heng Huang

Large Language Model (LLM) watermarking embeds detectable signals into generated text for copyright protection, misuse prevention, and content detection. While prior studies evaluate robustness using watermark removal attacks, these methods…

Cryptography and Security · Computer Science 2025-09-16 Zhaoxi Zhang , Xiaomei Zhang , Yanjun Zhang , He Zhang , Shirui Pan , Bo Liu , Asif Qumer Gill , Leo Yu Zhang

We study how to watermark LLM outputs, i.e. embedding algorithmically detectable signals into LLM-generated text to track misuse. Unlike the current mainstream methods that work with a fixed LLM, we expand the watermark design space by…

Machine Learning · Computer Science 2024-03-19 Xiaojun Xu , Yuanshun Yao , Yang Liu

To mitigate potential risks associated with language models, recent AI detection research proposes incorporating watermarks into machine-generated text through random vocabulary restrictions and utilizing this information for detection.…

Computation and Language · Computer Science 2024-02-14 Yu Fu , Deyi Xiong , Yue Dong

Potential harms of Large Language Models such as mass misinformation and plagiarism can be partially mitigated if there exists a reliable way to detect machine generated text. In this paper, we propose a new watermarking method to detect…

Computation and Language · Computer Science 2023-12-12 Kaan Efe Keleş , Ömer Kaan Gürbüz , Mucahid Kutlu

Multilingual watermarking aims to make large language model (LLM) outputs traceable across languages, yet current methods still fall short. Despite claims of cross-lingual robustness, they are evaluated only on high-resource languages. We…

Computation and Language · Computer Science 2026-03-26 Asim Mohamed , Martin Gubri

Watermarking algorithms for Large Language Models (LLMs) effectively identify machine-generated content by embedding and detecting hidden statistical features in text. However, such embedding leads to a decline in text quality, especially…

Cryptography and Security · Computer Science 2025-10-06 Yu Zhang , Shuliang Liu , Xu Yang , Xuming Hu

Large Language Models (LLMs) have demonstrated impressive capabilities in generating diverse and contextually rich text. However, concerns regarding copyright infringement arise as LLMs may inadvertently produce copyrighted material. In…

Text watermarking aims to subtly embed statistical signals into text by controlling the Large Language Model (LLM)'s sampling process, enabling watermark detectors to verify that the output was generated by the specified model. The…

Machine Learning · Computer Science 2025-05-13 Yixin Cheng , Hongcheng Guo , Yangming Li , Leonid Sigal

As open-source large language models (LLMs) like Llama3 become more capable, it is crucial to develop watermarking techniques to detect their potential misuse. Existing watermarking methods either add watermarks during LLM inference, which…

Computation and Language · Computer Science 2025-03-18 Yijie Xu , Aiwei Liu , Xuming Hu , Lijie Wen , Hui Xiong

LLM watermarking, which embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text, has become crucial in mitigating the potential misuse of large language models. However, the abundance of…

Cryptography and Security · Computer Science 2024-10-29 Leyi Pan , Aiwei Liu , Zhiwei He , Zitian Gao , Xuandong Zhao , Yijian Lu , Binglin Zhou , Shuliang Liu , Xuming Hu , Lijie Wen , Irwin King , Philip S. Yu

We demonstrate that while the current approaches for language model watermarking are effective for open-ended generation, they are inadequate at watermarking LM outputs for constrained generation tasks with low-entropy output spaces.…

Cryptography and Security · Computer Science 2026-01-21 Nghia T. Le , Alan Ritter , Kartik Goyal

Statistical watermarking techniques are well-established for sequentially decoded language models (LMs). However, these techniques cannot be directly applied to order-agnostic LMs, as the tokens in order-agnostic LMs are not generated…

Computation and Language · Computer Science 2024-10-18 Ruibo Chen , Yihan Wu , Yanshuo Chen , Chenxi Liu , Junfeng Guo , Heng Huang

Watermarking LLM-generated text is critical for content attribution and misinformation prevention. However, existing methods compromise text quality, require white-box model access and logit manipulation. These limitations exclude API-based…

Computation and Language · Computer Science 2026-01-13 Zhuohao Yu , Xingru Jiang , Weizheng Gu , Yidong Wang , Qingsong Wen , Shikun Zhang , Wei Ye

Watermarking (WM) is a critical mechanism for detecting and attributing AI-generated content. Current WM methods for Large Language Models (LLMs) are predominantly tailored for autoregressive (AR) models: They rely on tokens being generated…

Computation and Language · Computer Science 2026-01-21 Ofek Raban , Ethan Fetaya , Gal Chechik

Large Language Models (LLMs) are increasingly fine-tuned on smaller, domain-specific datasets to improve downstream performance. These datasets often contain proprietary or copyrighted material, raising the need for reliable safeguards…

Computation and Language · Computer Science 2025-10-06 Jingqi Zhang , Ruibo Chen , Yingqing Yang , Peihua Mai , Heng Huang , Yan Pang

Misuse of LLM-generated text can be curbed by watermarking techniques that embed implicit signals into the output. We propose a watermark that partitions the vocabulary at each decoding step into three sets (Green/Yellow/Red) with fixed…

Computation and Language · Computer Science 2025-12-23 Zhiqing Hu , Chenxu Zhao , Jiazhong Lu , Xiaolei Liu

Generative images have proliferated on Web platforms in social media and online copyright distribution scenarios, and semantic watermarking has increasingly been integrated into diffusion models to support reliable provenance tracking and…

Machine Learning · Computer Science 2026-02-26 Zheng Gao , Xiaoyu Li , Zhicheng Bao , Xiaoyan Feng , Jiaojiao Jiang

Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership. Previous data…

Cryptography and Security · Computer Science 2025-07-29 Xinyue Cui , Johnny Tian-Zheng Wei , Swabha Swayamdipta , Robin Jia