English
Related papers

Related papers: Optimizing watermarks for large language models

200 papers

Large Language Models (LLMs) have demonstrated potential as effective search relevance evaluators. However, there is a lack of comprehensive guidance on which models consistently perform optimally across various contexts or within specific…

Machine Learning · Computer Science 2024-10-29 Silvia Terragni , Hoang Cuong , Joachim Daiber , Pallavi Gudipati , Pablo N. Mendes

With the increasing use of large-language models (LLMs) like ChatGPT, watermarking has emerged as a promising approach for tracing machine-generated content. However, research on LLM watermarking often relies on simple perplexity or…

Computation and Language · Computer Science 2023-12-06 Karanpartap Singh , James Zou

Potential harms of large language models can be mitigated by watermarking model output, i.e., embedding signals into generated text that are invisible to humans but algorithmically detectable from a short span of tokens. We propose a…

Machine Learning · Computer Science 2024-05-03 John Kirchenbauer , Jonas Geiping , Yuxin Wen , Jonathan Katz , Ian Miers , Tom Goldstein

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

Computation and Language · Computer Science 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

Computation and Language · Computer Science 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves…

Machine Learning · Computer Science 2024-06-07 Mingjia Huo , Sai Ashish Somayajula , Youwei Liang , Ruisi Zhang , Farinaz Koushanfar , Pengtao Xie

Various watermarking methods (``watermarkers'') have been proposed to identify LLM-generated texts; yet, due to the lack of unified evaluation platforms, many critical questions remain under-explored: i) What are the strengths/limitations…

Cryptography and Security · Computer Science 2025-10-01 Jiacheng Liang , Zian Wang , Lauren Hong , Shouling Ji , Ting Wang

Amidst rising concerns about the internet being proliferated with content generated from language models (LMs), watermarking is seen as a principled way to certify whether text was generated from a model. Many recent watermarking techniques…

Cryptography and Security · Computer Science 2024-11-11 Saksham Rastogi , Danish Pruthi

Watermarking has recently emerged as an effective strategy for detecting the outputs of large language models (LLMs). Most existing schemes require white-box access to the model's next-token probability distribution, which is typically not…

Cryptography and Security · Computer Science 2026-02-24 Dara Bahri , John Wieting

In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on…

Cryptography and Security · Computer Science 2024-05-03 Minhao Bai , Kaiyi Pang , Yongfeng Huang

Large Language Models (LLMs) have experienced rapid advancements, with applications spanning a wide range of fields, including sentiment classification, review generation, and question answering. Due to their efficiency and versatility,…

Cryptography and Security · Computer Science 2025-06-17 Yugeng Liu , Tianshuo Cong , Michael Backes , Zheng Li , Yang Zhang

Text watermarking has emerged as a pivotal technique for identifying machine-generated text. However, existing methods often rely on arbitrary vocabulary partitioning during decoding to embed watermarks, which compromises the availability…

Computation and Language · Computer Science 2024-06-07 Liang Chen , Yatao Bian , Yang Deng , Deng Cai , Shuaiyi Li , Peilin Zhao , Kam-fai Wong

Watermarking has emerged as a crucial method to distinguish AI-generated text from human-created text. Current watermarking approaches often lack formal optimality guarantees or address the scheme and detector design separately. In this…

Cryptography and Security · Computer Science 2025-10-28 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

Cryptography and Security · Computer Science 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising method for addressing potential harm and biases from LLMs,…

Cryptography and Security · Computer Science 2024-12-09 Lingjie Chen , Ruizhong Qiu , Siyu Yuan , Zhining Liu , Tianxin Wei , Hyunsik Yoo , Zhichen Zeng , Deqing Yang , Hanghang Tong

Text watermarking for Large Language Models (LLMs) has made significant progress in detecting LLM outputs and preventing misuse. Current watermarking techniques offer high detectability, minimal impact on text quality, and robustness to…

Cryptography and Security · Computer Science 2025-01-29 Aiwei Liu , Sheng Guan , Yiming Liu , Leyi Pan , Yifei Zhang , Liancheng Fang , Lijie Wen , Philip S. Yu , Xuming Hu

We present the first in depth study on the robustness of existing watermarking techniques applied to code generated by large language models (LLMs). As LLMs increasingly contribute to software development, watermarking has emerged as a…

Cryptography and Security · Computer Science 2025-08-21 Tarun Suresh , Shubham Ugare , Gagandeep Singh , Sasa Misailovic

Since ChatGPT was introduced in November 2022, embedding (nearly) unnoticeable statistical signals into text generated by large language models (LLMs), also known as watermarking, has been used as a principled approach to provable detection…

Statistics Theory · Mathematics 2025-08-28 Xiang Li , Feng Ruan , Huiyuan Wang , Qi Long , Weijie J. Su

Large Language Model (LLM) watermarking embeds detectable signals into generated text for copyright protection, misuse prevention, and content detection. While prior studies evaluate robustness using watermark removal attacks, these methods…

Cryptography and Security · Computer Science 2025-09-16 Zhaoxi Zhang , Xiaomei Zhang , Yanjun Zhang , He Zhang , Shirui Pan , Bo Liu , Asif Qumer Gill , Leo Yu Zhang

Composing language models (LMs) into multi-step language programs and automatically optimizing their modular prompts is now a mainstream paradigm for building AI systems, but the tradeoffs in this space have only scarcely been studied…

Computation and Language · Computer Science 2025-02-28 Shangyin Tan , Lakshya A Agrawal , Arnav Singhvi , Liheng Lai , Michael J Ryan , Dan Klein , Omar Khattab , Koushik Sen , Matei Zaharia