中文
相关论文

相关论文: Perturb Your Data: Paraphrase-Guided Training Data…

200 篇论文

While large language models (LLMs) are extensively used, there are raising concerns regarding privacy, security, and copyright due to their opaque training data, which brings the problem of detecting pre-training data on the table. Current…

计算与语言 · 计算机科学 2024-08-01 Anqi Zhang , Chaofeng Wu

Watermarking by altering token sampling probabilities based on red-green list is a promising method for tracing the origin of text generated by large language models (LLMs). However, existing watermark methods often struggle with a…

密码学与安全 · 计算机科学 2025-05-21 Zongqi Wang , Tianle Gu , Baoyuan Wu , Yujiu Yang

The advancement of Large Language Models (LLMs) has led to increasing concerns about the misuse of AI-generated text, and watermarking for LLM-generated text has emerged as a potential solution. However, it is challenging to generate…

计算与语言 · 计算机科学 2024-06-11 Yepeng Liu , Yuheng Bu

Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowledge from a trained model, while maintaining its performance on standard tasks. While…

机器学习 · 计算机科学 2026-03-03 Yiwei Chen , Soumyadeep Pal , Yimeng Zhang , Qing Qu , Sijia Liu

Watermarking involves implanting an imperceptible signal into generated text that can later be detected via statistical tests. A prominent family of watermarking strategies for LLMs embeds this signal by upsampling a (pseudorandomly-chosen)…

计算与语言 · 计算机科学 2024-10-22 Anirudh Ajith , Sameer Singh , Danish Pruthi

Watermarking has been proposed as a lightweight mechanism to identify AI-generated text, with schemes typically relying on perturbations to token distributions. While prior work shows that paraphrasing can weaken such signals, these attacks…

计算与语言 · 计算机科学 2025-10-30 Gokul Ganesan

Watermarking is a promising defense against the misuse of large language models (LLMs), yet it remains vulnerable to scrubbing and spoofing attacks. This vulnerability stems from an inherent trade-off governed by watermark window size:…

密码学与安全 · 计算机科学 2025-12-09 Huanming Shen , Baizhou Huang , Xiaojun Wan

Large language models (LLMs) are increasingly integrated into academic workflows, with many conferences and journals permitting their use for tasks such as language refinement and literature summarization. However, their use in peer review…

密码学与安全 · 计算机科学 2025-11-13 Alexander Nemecek , Yuzhou Jiang , Erman Ayday

The widespread use of Large Language Models (LLMs) in text generation has raised increasing concerns about intellectual property disputes. Watermarking techniques, which embed meta information into AI-generated content (AIGC), have the…

密码学与安全 · 计算机科学 2026-04-15 Shangkun Che , Silin Du , Ge Gao

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

机器学习 · 计算机科学 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto

Existing sentence-level watermarking methods enhance robustness to paraphrasing by anchoring watermarks in sentence semantics. However, their prefix-based designs remain vulnerable to structural perturbations, such as sentence splitting and…

密码学与安全 · 计算机科学 2026-05-29 Yuexin Li , Wenjie Qu , Linyu Wu , Yulin Chen , Yufei He , Tri Cao , Bryan Hooi , Jiaheng Zhang

Large language models (LLMs) are highly sensitive to even small amounts of unsafe training data, making effective detection and filtering essential for trustworthy model development. Current state-of-the-art (SOTA) detection approaches…

机器学习 · 计算机科学 2025-10-13 Yijun Pan , Taiwei Shi , Jieyu Zhao , Jiaqi W. Ma

LLM watermarks allow tracing AI-generated texts by inserting a detectable signal into their generated content. Recent works have proposed a wide range of watermarking algorithms, each with distinct designs, usually built using a bottom-up…

密码学与安全 · 计算机科学 2026-02-09 Thibaud Gloaguen , Robin Staab , Nikola Jovanović , Martin Vechev

Recently, text watermarking algorithms for large language models (LLMs) have been proposed to mitigate the potential harms of text generated by LLMs, including fake news and copyright issues. However, current watermark detection algorithms…

计算与语言 · 计算机科学 2024-05-28 Aiwei Liu , Leyi Pan , Xuming Hu , Shu'ang Li , Lijie Wen , Irwin King , Philip S. Yu

The recent success of generative AI highlights the crucial role of high-quality human feedback in building trustworthy AI systems. However, the increasing use of large language models (LLMs) by crowdsourcing workers poses a significant…

人工智能 · 计算机科学 2025-11-07 Yichi Zhang , Jinlong Pang , Zhaowei Zhu , Yang Liu

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Ge Luo , Junqiang Huang , Manman Zhang , Zhenxing Qian , Sheng Li , Xinpeng Zhang

Misuse of LLM-generated text can be curbed by watermarking techniques that embed implicit signals into the output. We propose a watermark that partitions the vocabulary at each decoding step into three sets (Green/Yellow/Red) with fixed…

计算与语言 · 计算机科学 2025-12-23 Zhiqing Hu , Chenxu Zhao , Jiazhong Lu , Xiaolei Liu

Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks introduce visually irrelevant tokens and disrupt…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Qi Zheng , Shuliang Liu , Yu Huang , Sihang Jia , Jungang Li , Lyuhao Chen , Junhao Chen , Hanqian Li , Aiwei Liu , Yibo Yan , Xuming Hu

AI-generated text detection has attracted increasing attention as powerful language models approach human-level generation. Limited work is devoted to detecting (partially) AI-paraphrased texts. However, AI paraphrasing is commonly employed…

计算与语言 · 计算机科学 2024-05-30 Yafu Li , Zhilin Wang , Leyang Cui , Wei Bi , Shuming Shi , Yue Zhang

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

计算与语言 · 计算机科学 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang