English
Related papers

Related papers: Is The Watermarking Of LLM-Generated Code Robust?

200 papers

Recent progress in large language models enables the creation of realistic machine-generated content. Watermarking is a promising approach to distinguish machine-generated text from human text, embedding statistical signals in the output…

Cryptography and Security · Computer Science 2026-02-25 Patrick Chao , Yan Sun , Edgar Dobriban , Hamed Hassani

We investigate the radioactivity of text generated by large language models (LLM), i.e. whether it is possible to detect that such synthetic input was used to train a subsequent LLM. Current methods like membership inference or active IP…

Cryptography and Security · Computer Science 2024-10-29 Tom Sander , Pierre Fernandez , Alain Durmus , Matthijs Douze , Teddy Furon

The rapid growth of Large Language Models (LLMs) raises concerns about distinguishing AI-generated text from human content. Existing watermarking techniques, like \kgw, struggle with low watermark strength and stringent false-positive…

Machine Learning · Computer Science 2025-05-22 Zhuang Li , Qiuping Yi , Zongcheng Ji , Yijian Lu , Yanqi Li , Keyang Xiao , Hongliang Liang

Large language models (LLMs) are pre-trained and post-trained on vast amounts of loosely curated data, raising the possibility that these models may have been trained on proprietary datasets or the same benchmarks used for evaluation. This…

Machine Learning · Computer Science 2026-05-11 Pengrun Huang , Kamalika Chaudhuri , Yu-Xiang Wang

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

Cryptography and Security · Computer Science 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

Cryptography and Security · Computer Science 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

With the increasing use of large-language models (LLMs) like ChatGPT, watermarking has emerged as a promising approach for tracing machine-generated content. However, research on LLM watermarking often relies on simple perplexity or…

Computation and Language · Computer Science 2023-12-06 Karanpartap Singh , James Zou

Large-language models (LLMs) are now able to produce text that is, in many cases, seemingly indistinguishable from human-generated content. This has fueled the development of watermarks that imprint a ``signal'' in LLM-generated text with…

Cryptography and Security · Computer Science 2025-05-15 Dor Tsur , Carol Xuan Long , Claudio Mayrink Verdun , Hsiang Hsu , Haim Permuter , Flavio P. Calmon

With the advent of large language models (LLMs), numerous software service providers (SSPs) are dedicated to developing LLMs customized for code generation tasks, such as CodeLlama and Copilot. However, these LLMs can be leveraged by…

Cryptography and Security · Computer Science 2025-04-22 Kaiwen Ning , Jiachi Chen , Qingyuan Zhong , Tao Zhang , Yanlin Wang , Wei Li , Jingwen Zhang , Jianxing Yu , Yuming Feng , Weizhe Zhang , Zibin Zheng

Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership. Previous data…

Cryptography and Security · Computer Science 2025-07-29 Xinyue Cui , Johnny Tian-Zheng Wei , Swabha Swayamdipta , Robin Jia

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

Computation and Language · Computer Science 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

Computation and Language · Computer Science 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising method for addressing potential harm and biases from LLMs,…

Cryptography and Security · Computer Science 2024-12-09 Lingjie Chen , Ruizhong Qiu , Siyu Yuan , Zhining Liu , Tianxin Wei , Hyunsik Yoo , Zhichen Zeng , Deqing Yang , Hanghang Tong

Existing watermarking methods for large language models (LLMs) mainly embed watermark by adjusting the token sampling prediction or post-processing, lacking intrinsic coupling with LLMs, which may significantly reduce the semantic quality…

Cryptography and Security · Computer Science 2025-10-17 Siyuan Bao , Ying Shi , Zhiguang Yang , Hanzhou Wu , Xinpeng Zhang

Text watermarking algorithms are crucial for protecting the copyright of textual content. Historically, their capabilities and application scenarios were limited. However, recent advancements in large language models (LLMs) have…

Computation and Language · Computer Science 2024-08-12 Aiwei Liu , Leyi Pan , Yijian Lu , Jingjing Li , Xuming Hu , Xi Zhang , Lijie Wen , Irwin King , Hui Xiong , Philip S. Yu

Recent advancements in Large Language Models (LLMs) raised concerns over potential misuse, such as for spreading misinformation. In response two counter measures emerged: machine learning-based detectors that predict if text is synthetic,…

Machine Learning · Computer Science 2025-04-17 David Khachaturov , Robert Mullins , Ilia Shumailov , Sumanth Dathathri

Watermarking by altering token sampling probabilities based on red-green list is a promising method for tracing the origin of text generated by large language models (LLMs). However, existing watermark methods often struggle with a…

Cryptography and Security · Computer Science 2025-05-21 Zongqi Wang , Tianle Gu , Baoyuan Wu , Yujiu Yang

Watermarking has emerged as a promising way to detect LLM-generated text, by augmenting LLM generations with later detectable signals. Recent work has proposed multiple families of watermarking schemes, several of which focus on preserving…

Cryptography and Security · Computer Science 2025-02-25 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

Machine Learning · Statistics 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

LLM watermarking has attracted attention as a promising way to detect AI-generated content, with some works suggesting that current schemes may already be fit for deployment. In this work we dispute this claim, identifying watermark…

Machine Learning · Computer Science 2024-06-25 Nikola Jovanović , Robin Staab , Martin Vechev