English
Related papers

Related papers: Unbiased Watermark for Large Language Models

200 papers

As open-source large language models (LLMs) like Llama3 become more capable, it is crucial to develop watermarking techniques to detect their potential misuse. Existing watermarking methods either add watermarks during LLM inference, which…

Computation and Language · Computer Science 2025-03-18 Yijie Xu , Aiwei Liu , Xuming Hu , Lijie Wen , Hui Xiong

Large language model (LLM) unlearning is critical in real-world applications where it is necessary to efficiently remove the influence of private, copyrighted, or harmful data from some users. Existing utility-centric unlearning metrics…

With the increasing use of large-language models (LLMs) like ChatGPT, watermarking has emerged as a promising approach for tracing machine-generated content. However, research on LLM watermarking often relies on simple perplexity or…

Computation and Language · Computer Science 2023-12-06 Karanpartap Singh , James Zou

The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token…

Computation and Language · Computer Science 2023-11-17 Yuhang Li , Yihan Wang , Zhouxing Shi , Cho-Jui Hsieh

The rapid growth of Large Language Models (LLMs) raises concerns about distinguishing AI-generated text from human content. Existing watermarking techniques, like \kgw, struggle with low watermark strength and stringent false-positive…

Machine Learning · Computer Science 2025-05-22 Zhuang Li , Qiuping Yi , Zongcheng Ji , Yijian Lu , Yanqi Li , Keyang Xiao , Hongliang Liang

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily…

Cryptography and Security · Computer Science 2025-03-04 Yuhang Cai , Yaofei Wang , Donghui Hu , Chen Gu

LLM watermarking, which embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text, has become crucial in mitigating the potential misuse of large language models. However, the abundance of…

Cryptography and Security · Computer Science 2024-10-29 Leyi Pan , Aiwei Liu , Zhiwei He , Zitian Gao , Xuandong Zhao , Yijian Lu , Binglin Zhou , Shuliang Liu , Xuming Hu , Lijie Wen , Irwin King , Philip S. Yu

In the present-day scenario, Large Language Models (LLMs) are establishing their presence as powerful instruments permeating various sectors of society. While their utility offers valuable support to individuals, there are multiple concerns…

Computation and Language · Computer Science 2025-07-01 Badr Youbi Idrissi , Monica Millunzi , Amelia Sorrenti , Lorenzo Baraldi , Daryna Dementieva

Large language models~(LLMs) have greatly advanced the frontiers of artificial intelligence, attaining remarkable improvement in model capacity. To assess the model performance, a typical approach is to construct evaluation benchmarks for…

Computation and Language · Computer Science 2023-11-06 Kun Zhou , Yutao Zhu , Zhipeng Chen , Wentong Chen , Wayne Xin Zhao , Xu Chen , Yankai Lin , Ji-Rong Wen , Jiawei Han

To mitigate the potential misuse of large language models (LLMs), recent research has developed watermarking algorithms, which restrict the generation process to leave an invisible trace for watermark detection. Due to the two-stage nature…

Computation and Language · Computer Science 2024-07-02 Shangqing Tu , Yuliang Sun , Yushi Bai , Jifan Yu , Lei Hou , Juanzi Li

The growing deployment of Large Language Models (LLMs) has raised concerns about their misuse in generating harmful or deceptive content. To address this issue, watermarking methods have been proposed to embed identifiable multi-bit…

Computation and Language · Computer Science 2026-05-12 Jiahao Xu , Rui Hu , Olivera Kotevska , Zikai Zhang

As large language models (LLMs) grow more powerful, concerns over copyright infringement of LLM-generated texts have intensified. LLM watermarking has been proposed to trace unauthorized redistribution or resale of generated content by…

Cryptography and Security · Computer Science 2025-08-05 Qihao Lin , Chen Tang , Lan zhang , Junyang zhang , Xiangyang Li

Watermarking has recently emerged as an effective strategy for detecting the generations of large language models (LLMs). The strength of a watermark typically depends strongly on the entropy afforded by the language model and the set of…

Computation and Language · Computer Science 2026-02-05 Dara Bahri , John Wieting

Amidst rising concerns about the internet being proliferated with content generated from language models (LMs), watermarking is seen as a principled way to certify whether text was generated from a model. Many recent watermarking techniques…

Cryptography and Security · Computer Science 2024-11-11 Saksham Rastogi , Danish Pruthi

Watermarking has emerged as a promising technique to track AI-generated content and differentiate it from authentic human creations. While prior work extensively studies watermarking for autoregressive large language models (LLMs) and image…

Cryptography and Security · Computer Science 2026-02-16 Avi Bagchi , Akhil Bhimaraju , Moulik Choraria , Daniel Alabi , Lav R. Varshney

Large language models (LLMs) have show great ability in various natural language tasks. However, there are concerns that LLMs are possible to be used improperly or even illegally. To prevent the malicious usage of LLMs, detecting…

Cryptography and Security · Computer Science 2024-04-02 Jie Ren , Han Xu , Yiding Liu , Yingqian Cui , Shuaiqiang Wang , Dawei Yin , Jiliang Tang

Watermarking for large language models (LLMs) has emerged as an effective tool for distinguishing AI-generated text from human-written content. Statistically, watermark schemes induce dependence between generated tokens and a pseudo-random…

Methodology · Statistics 2026-04-13 Weijie Su , Ruodu Wang , Zinan Zhao

Watermarking the outputs of large language models (LLMs) is critical for provenance tracing, content regulation, and model accountability. Existing approaches often rely on access to model internals or are constrained by static rules and…

Machine Learning · Computer Science 2025-06-23 Agnibh Dasgupta , Abdullah Tanvir , Xin Zhong

The widespread adoption of large language models (LLMs) necessitates reliable methods to detect LLM-generated text. We introduce SimMark, a robust sentence-level watermarking algorithm that makes LLMs' outputs traceable without requiring…

Computation and Language · Computer Science 2025-09-12 Amirhossein Dabiriaghdam , Lele Wang

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

Machine Learning · Computer Science 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer