English
Related papers

Related papers: A Watermark for Order-Agnostic Language Models

200 papers

Existing watermarking algorithms are vulnerable to paraphrase attacks because of their token-level design. To address this issue, we propose SemStamp, a robust sentence-level semantic watermarking algorithm based on locality-sensitive…

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect…

Embedding watermarks into the output of generative models is essential for establishing copyright and verifiable ownership over the generated content. Emerging diffusion model watermarking methods either embed watermarks in the frequency…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Yunzhuo Chen , Jordan Vice , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

In this paper, we initiate the study of \emph{multi-designated detector watermarking (MDDW)} for large language models (LLMs). This technique allows model providers to generate watermarked outputs from LLMs with two key properties: (i) only…

Cryptography and Security · Computer Science 2024-10-02 Zhengan Huang , Gongxian Zeng , Xin Mu , Yu Wang , Yue Yu

Contrastive learning has become a popular technique to pre-train image encoders, which could be used to build various downstream classification models in an efficient way. This process requires a large amount of data and computation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Yutong Wu , Han Qiu , Tianwei Zhang , Jiwei L , Meikang Qiu

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily…

Cryptography and Security · Computer Science 2025-03-04 Yuhang Cai , Yaofei Wang , Donghui Hu , Chen Gu

Detecting semantic types of columns in data lake tables is an important application. A key bottleneck in semantic type detection is the availability of human annotation due to the inherent complexity of data lakes. In this paper, we propose…

Databases · Computer Science 2024-08-30 Chenjie Li , Dan Zhang , Jin Wang

We show the viability of tackling misuses of large language models beyond the identification of machine-generated text. While existing zero-bit watermark methods focus on detection only, some malicious misuses demand tracing the adversary…

Computation and Language · Computer Science 2024-03-21 KiYoon Yoo , Wonhyuk Ahn , Nojun Kwak

Large language models (LLMs) demonstrate general intelligence across a variety of machine learning tasks, thereby enhancing the commercial value of their intellectual property (IP). To protect this IP, model owners typically allow user…

Cryptography and Security · Computer Science 2025-01-14 Kaiyi Pang , Tao Qi , Chuhan Wu , Minhao Bai , Minghu Jiang , Yongfeng Huang

Protecting the intellectual property of machine learning models is a hot topic and many watermarking schemes for deep neural networks have been proposed in the literature. Unfortunately, prior work largely neglected the investigation of…

Machine Learning · Computer Science 2024-10-08 Stefano Calzavara , Lorenzo Cazzaro , Donald Gera , Salvatore Orlando

This paper considers the problem of multi-bit generative watermarking for large language models under a worst-case false-alarm constraint. Prior work established a lower bound on the achievable miss-detection probability in the finite-token…

Information Theory · Computer Science 2026-04-13 Yu-Shin Huang , Chao Tian , Krishna Narayanan

As large language models (LLMs) become integral to applications such as question answering and content creation, reliable content attribution has become increasingly important. Watermarking is a promising approach, but most existing methods…

Cryptography and Security · Computer Science 2026-05-11 Ya Jiang , Massieh Kordi Boroujeny , Surender Suresh Kumar , Kai Zeng

Large Language Models (LLMs) can be misused to spread unwanted content at scale. Content watermarking deters misuse by hiding messages in content, enabling its detection using a secret watermarking key. Robustness is a core security…

Cryptography and Security · Computer Science 2025-05-22 Abdulrahman Diaa , Toluwani Aremu , Nils Lukas

Counterfactual (CF) explanations for ML model predictions provide actionable recourse recommendations to individuals adversely impacted by predicted outcomes. However, despite being preferred by end-users, CF explanations have been shown to…

Machine Learning · Computer Science 2024-10-22 Hangzhi Guo , Firdaus Ahmed Choudhury , Tinghua Chen , Amulya Yadav

Motivated by the problem of detecting AI-generated text, we consider the problem of watermarking the output of language models with provable guarantees. We aim for watermarks which satisfy: (a) undetectability, a cryptographic notion…

Cryptography and Security · Computer Science 2025-05-29 Noah Golowich , Ankur Moitra

Text watermarks in large language models (LLMs) are an increasingly important tool for detecting synthetic text and distinguishing human-written content from LLM-generated text. While most existing studies focus on determining whether…

Machine Learning · Statistics 2025-06-30 Xiang Li , Garrett Wen , Weiqing He , Jiayuan Wu , Qi Long , Weijie J. Su

Image generation algorithms are increasingly integral to diverse aspects of human society, driven by their practical applications. However, insufficient oversight in artificial Intelligence generated content (AIGC) can facilitate the spread…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenhao Luo , Zhangyi Shen , Ye Yao , Feng Ding , Guopu Zhu , Weizhi Meng

The rise of Large Language Models (LLMs) has heightened concerns about the misuse of AI-generated text, making watermarking a promising solution. Mainstream watermarking schemes for LLMs fall into two categories: logits-based and…

Computation and Language · Computer Science 2025-05-19 Yidan Wang , Yubing Ren , Yanan Cao , Binxing Fang

Text watermarking has emerged as a pivotal technique for identifying machine-generated text. However, existing methods often rely on arbitrary vocabulary partitioning during decoding to embed watermarks, which compromises the availability…

Computation and Language · Computer Science 2024-06-07 Liang Chen , Yatao Bian , Yang Deng , Deng Cai , Shuaiyi Li , Peilin Zhao , Kam-fai Wong

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully…

Machine Learning · Computer Science 2022-10-28 Qizhou Wang , Feng Liu , Yonggang Zhang , Jing Zhang , Chen Gong , Tongliang Liu , Bo Han