English
Related papers

Related papers: Perturb Your Data: Paraphrase-Guided Training Data…

200 papers

While large language models (LLMs) are extensively used, there are raising concerns regarding privacy, security, and copyright due to their opaque training data, which brings the problem of detecting pre-training data on the table. Current…

Computation and Language · Computer Science 2024-08-01 Anqi Zhang , Chaofeng Wu

Watermarking by altering token sampling probabilities based on red-green list is a promising method for tracing the origin of text generated by large language models (LLMs). However, existing watermark methods often struggle with a…

Cryptography and Security · Computer Science 2025-05-21 Zongqi Wang , Tianle Gu , Baoyuan Wu , Yujiu Yang

The advancement of Large Language Models (LLMs) has led to increasing concerns about the misuse of AI-generated text, and watermarking for LLM-generated text has emerged as a potential solution. However, it is challenging to generate…

Computation and Language · Computer Science 2024-06-11 Yepeng Liu , Yuheng Bu

Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowledge from a trained model, while maintaining its performance on standard tasks. While…

Machine Learning · Computer Science 2026-03-03 Yiwei Chen , Soumyadeep Pal , Yimeng Zhang , Qing Qu , Sijia Liu

Watermarking involves implanting an imperceptible signal into generated text that can later be detected via statistical tests. A prominent family of watermarking strategies for LLMs embeds this signal by upsampling a (pseudorandomly-chosen)…

Computation and Language · Computer Science 2024-10-22 Anirudh Ajith , Sameer Singh , Danish Pruthi

Watermarking has been proposed as a lightweight mechanism to identify AI-generated text, with schemes typically relying on perturbations to token distributions. While prior work shows that paraphrasing can weaken such signals, these attacks…

Computation and Language · Computer Science 2025-10-30 Gokul Ganesan

Watermarking is a promising defense against the misuse of large language models (LLMs), yet it remains vulnerable to scrubbing and spoofing attacks. This vulnerability stems from an inherent trade-off governed by watermark window size:…

Cryptography and Security · Computer Science 2025-12-09 Huanming Shen , Baizhou Huang , Xiaojun Wan

Large language models (LLMs) are increasingly integrated into academic workflows, with many conferences and journals permitting their use for tasks such as language refinement and literature summarization. However, their use in peer review…

Cryptography and Security · Computer Science 2025-11-13 Alexander Nemecek , Yuzhou Jiang , Erman Ayday

The widespread use of Large Language Models (LLMs) in text generation has raised increasing concerns about intellectual property disputes. Watermarking techniques, which embed meta information into AI-generated content (AIGC), have the…

Cryptography and Security · Computer Science 2026-04-15 Shangkun Che , Silin Du , Ge Gao

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

Machine Learning · Computer Science 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto

Existing sentence-level watermarking methods enhance robustness to paraphrasing by anchoring watermarks in sentence semantics. However, their prefix-based designs remain vulnerable to structural perturbations, such as sentence splitting and…

Cryptography and Security · Computer Science 2026-05-29 Yuexin Li , Wenjie Qu , Linyu Wu , Yulin Chen , Yufei He , Tri Cao , Bryan Hooi , Jiaheng Zhang

Large language models (LLMs) are highly sensitive to even small amounts of unsafe training data, making effective detection and filtering essential for trustworthy model development. Current state-of-the-art (SOTA) detection approaches…

Machine Learning · Computer Science 2025-10-13 Yijun Pan , Taiwei Shi , Jieyu Zhao , Jiaqi W. Ma

LLM watermarks allow tracing AI-generated texts by inserting a detectable signal into their generated content. Recent works have proposed a wide range of watermarking algorithms, each with distinct designs, usually built using a bottom-up…

Cryptography and Security · Computer Science 2026-02-09 Thibaud Gloaguen , Robin Staab , Nikola Jovanović , Martin Vechev

Recently, text watermarking algorithms for large language models (LLMs) have been proposed to mitigate the potential harms of text generated by LLMs, including fake news and copyright issues. However, current watermark detection algorithms…

Computation and Language · Computer Science 2024-05-28 Aiwei Liu , Leyi Pan , Xuming Hu , Shu'ang Li , Lijie Wen , Irwin King , Philip S. Yu

The recent success of generative AI highlights the crucial role of high-quality human feedback in building trustworthy AI systems. However, the increasing use of large language models (LLMs) by crowdsourcing workers poses a significant…

Artificial Intelligence · Computer Science 2025-11-07 Yichi Zhang , Jinlong Pang , Zhaowei Zhu , Yang Liu

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Ge Luo , Junqiang Huang , Manman Zhang , Zhenxing Qian , Sheng Li , Xinpeng Zhang

Misuse of LLM-generated text can be curbed by watermarking techniques that embed implicit signals into the output. We propose a watermark that partitions the vocabulary at each decoding step into three sets (Green/Yellow/Red) with fixed…

Computation and Language · Computer Science 2025-12-23 Zhiqing Hu , Chenxu Zhao , Jiazhong Lu , Xiaolei Liu

Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks introduce visually irrelevant tokens and disrupt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Qi Zheng , Shuliang Liu , Yu Huang , Sihang Jia , Jungang Li , Lyuhao Chen , Junhao Chen , Hanqian Li , Aiwei Liu , Yibo Yan , Xuming Hu

AI-generated text detection has attracted increasing attention as powerful language models approach human-level generation. Limited work is devoted to detecting (partially) AI-paraphrased texts. However, AI paraphrasing is commonly employed…

Computation and Language · Computer Science 2024-05-30 Yafu Li , Zhilin Wang , Leyang Cui , Wei Bi , Shuming Shi , Yue Zhang

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

Computation and Language · Computer Science 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang