English
Related papers

Related papers: Watermark Stealing in Large Language Models

200 papers

Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves…

Machine Learning · Computer Science 2024-06-07 Mingjia Huo , Sai Ashish Somayajula , Youwei Liang , Ruisi Zhang , Farinaz Koushanfar , Pengtao Xie

Deep neural networks have had enormous impact on various domains of computer science, considerably outperforming previous state of the art machine learning techniques. To achieve this performance, neural networks need large quantities of…

Cryptography and Security · Computer Science 2018-09-05 Dorjan Hitaj , Luigi V. Mancini

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect…

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Ge Luo , Junqiang Huang , Manman Zhang , Zhenxing Qian , Sheng Li , Xinpeng Zhang

We investigate the radioactivity of text generated by large language models (LLM), i.e. whether it is possible to detect that such synthetic input was used to train a subsequent LLM. Current methods like membership inference or active IP…

Cryptography and Security · Computer Science 2024-10-29 Tom Sander , Pierre Fernandez , Alain Durmus , Matthijs Douze , Teddy Furon

With the increasing use of large-language models (LLMs) like ChatGPT, watermarking has emerged as a promising approach for tracing machine-generated content. However, research on LLM watermarking often relies on simple perplexity or…

Computation and Language · Computer Science 2023-12-06 Karanpartap Singh , James Zou

We present a publicly-detectable watermarking scheme for LMs: the detection algorithm contains no secret information, and it is executable by anyone. We embed a publicly-verifiable cryptographic signature into LM output using rejection…

Machine Learning · Computer Science 2025-01-07 Jaiden Fairoze , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Mingyuan Wang

While the automated detection of cryptographic API misuses has progressed significantly, its precision diminishes for intricate targets due to the reliance on manually defined patterns. Large Language Models (LLMs) offer a promising…

Cryptography and Security · Computer Science 2026-03-19 Yifan Xia , Zichen Xie , Peiyu Liu , Kangjie Lu , Yan Liu , Wenhai Wang , Shouling Ji

To mitigate the potential misuse of large language models (LLMs), recent research has developed watermarking algorithms, which restrict the generation process to leave an invisible trace for watermark detection. Due to the two-stage nature…

Computation and Language · Computer Science 2024-07-02 Shangqing Tu , Yuliang Sun , Yushi Bai , Jifan Yu , Lei Hou , Juanzi Li

Motivated by the problem of detecting AI-generated text, we consider the problem of watermarking the output of language models with provable guarantees. We aim for watermarks which satisfy: (a) undetectability, a cryptographic notion…

Cryptography and Security · Computer Science 2025-05-29 Noah Golowich , Ankur Moitra

Invisible Image Watermarking is crucial for ensuring content provenance and accountability in generative AI. While Gen-AI providers are increasingly integrating invisible watermarking systems, the robustness of these schemes against forgery…

Cryptography and Security · Computer Science 2025-10-27 Ziping Dong , Chao Shuai , Zhongjie Ba , Peng Cheng , Zhan Qin , Qinglong Wang , Kui Ren

Large language models (LLMs) are increasingly integrated into academic workflows, with many conferences and journals permitting their use for tasks such as language refinement and literature summarization. However, their use in peer review…

Cryptography and Security · Computer Science 2025-11-13 Alexander Nemecek , Yuzhou Jiang , Erman Ayday

Watermarking AI-generated text is critical for combating misuse. Yet recent theoretical work argues that any watermark can be erased via random walk attacks that perturb text while preserving quality. However, such attacks rely on two key…

Cryptography and Security · Computer Science 2025-05-13 Fabrice Y Harel-Canada , Boran Erol , Connor Choi , Jason Liu , Gary Jiarui Song , Nanyun Peng , Amit Sahai

Watermarking for large language models (LLMs) is a promising approach for detecting LLM-generated text and enabling responsible deployment. However, existing watermarking methods are often vulnerable to semantic-invariant attacks, such as…

Cryptography and Security · Computer Science 2026-05-26 Zhenxin Ai , Haiyun He

The proliferation of Large Language Models (LLMs) necessitates efficient mechanisms to distinguish machine-generated content from human text. While statistical watermarking has emerged as a promising solution, existing methods suffer from…

Machine Learning · Computer Science 2026-02-20 Baihe Huang , Eric Xu , Kannan Ramchandran , Jiantao Jiao , Michael I. Jordan

Deep neural networks are valuable assets considering their commercial benefits and huge demands for costly annotation and computation resources. To protect the copyright of DNNs, backdoor-based ownership verification becomes popular…

Cryptography and Security · Computer Science 2023-09-12 Guanhao Gan , Yiming Li , Dongxian Wu , Shu-Tao Xia

Phishing attacks are becoming increasingly sophisticated, underscoring the need for detection systems that strike a balance between high accuracy and computational efficiency. This paper presents a comparative evaluation of traditional…

Cryptography and Security · Computer Science 2025-12-25 Jikesh Thapa , Gurrehmat Chahal , Serban Voinea Gabreanu , Yazan Otoum

Distinguishing AI-generated code from human-written code is becoming crucial for tasks such as authorship attribution, content tracking, and misuse detection. Based on this, N-gram-based watermarking schemes have emerged as prominent, which…

Cryptography and Security · Computer Science 2025-07-09 Gehao Zhang , Eugene Bagdasarian , Juan Zhai , Shiqing Ma

Potential harms of large language models can be mitigated by watermarking model output, i.e., embedding signals into generated text that are invisible to humans but algorithmically detectable from a short span of tokens. We propose a…

Machine Learning · Computer Science 2024-05-03 John Kirchenbauer , Jonas Geiping , Yuxin Wen , Jonathan Katz , Ian Miers , Tom Goldstein

Text content created by humans or language models is often stolen or misused by adversaries. Tracing text provenance can help claim the ownership of text content or identify the malicious users who distribute misleading content like…

Cryptography and Security · Computer Science 2021-12-16 Xi Yang , Jie Zhang , Kejiang Chen , Weiming Zhang , Zehua Ma , Feng Wang , Nenghai Yu