English
Related papers

Related papers: Mark My Words: Analyzing and Evaluating Language M…

200 papers

We present REMARK-LLM, a novel efficient, and robust watermarking framework designed for texts generated by large language models (LLMs). Synthesizing human-like content using LLMs necessitates vast computational resources and extensive…

Cryptography and Security · Computer Science 2024-04-09 Ruisi Zhang , Shehzeen Samarah Hussain , Paarth Neekhara , Farinaz Koushanfar

With the rapid advancement and extensive application of artificial intelligence technology, large language models (LLMs) are extensively used to enhance production, creativity, learning, and work efficiency across various domains. However,…

Cryptography and Security · Computer Science 2024-09-04 Yuqing Liang , Jiancheng Xiao , Wensheng Gan , Philip S. Yu

As large language models (LLM) are increasingly used for text generation tasks, it is critical to audit their usages, govern their applications, and mitigate their potential harms. Existing watermark techniques are shown effective in…

Machine Learning · Computer Science 2024-08-09 Chaoyi Zhu , Jeroen Galjaard , Pin-Yu Chen , Lydia Y. Chen

Potential harms of large language models can be mitigated by watermarking model output, i.e., embedding signals into generated text that are invisible to humans but algorithmically detectable from a short span of tokens. We propose a…

Machine Learning · Computer Science 2024-05-03 John Kirchenbauer , Jonas Geiping , Yuxin Wen , Jonathan Katz , Ian Miers , Tom Goldstein

Amidst rising concerns about the internet being proliferated with content generated from language models (LMs), watermarking is seen as a principled way to certify whether text was generated from a model. Many recent watermarking techniques…

Cryptography and Security · Computer Science 2024-11-11 Saksham Rastogi , Danish Pruthi

We present the first in depth study on the robustness of existing watermarking techniques applied to code generated by large language models (LLMs). As LLMs increasingly contribute to software development, watermarking has emerged as a…

Cryptography and Security · Computer Science 2025-08-21 Tarun Suresh , Shubham Ugare , Gagandeep Singh , Sasa Misailovic

The rapid advancement of large language models (LLMs) has made it increasingly difficult to distinguish between text written by humans and machines. Addressing this, we propose a novel method for generating watermarks that strategically…

Computation and Language · Computer Science 2024-05-15 Georg Niess , Roman Kern

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

Multimedia · Computer Science 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on…

Cryptography and Security · Computer Science 2024-05-03 Minhao Bai , Kaiyi Pang , Yongfeng Huang

We consider the emerging problem of identifying the presence and use of watermarking schemes in widely used, publicly hosted, closed source large language models (LLMs). We introduce a suite of baseline algorithms for identifying watermarks…

Machine Learning · Computer Science 2023-05-31 Leonard Tang , Gavin Uberti , Tom Shlomi

Large Language Models (LLMs) have demonstrated remarkable capabilities, but their training requires extensive data and computational resources, rendering them valuable digital assets. Therefore, it is essential to watermark LLMs to protect…

Cryptography and Security · Computer Science 2025-10-21 Shuai Li , Kejiang Chen , Jun Jiang , Jie Zhang , Qiyi Yao , Kai Zeng , Weiming Zhang , Nenghai Yu

We study the problem of watermarking large language models (LLMs) generated text -- one of the most promising approaches for addressing the safety challenges of LLM usage. In this paper, we propose a rigorous theoretical framework to…

Computation and Language · Computer Science 2023-10-16 Xuandong Zhao , Prabhanjan Ananth , Lei Li , Yu-Xiang Wang

Watermarking has recently emerged as an effective strategy for detecting the generations of large language models (LLMs). The strength of a watermark typically depends strongly on the entropy afforded by the language model and the set of…

Computation and Language · Computer Science 2026-02-05 Dara Bahri , John Wieting

Large language models (LLMs) are pre-trained and post-trained on vast amounts of loosely curated data, raising the possibility that these models may have been trained on proprietary datasets or the same benchmarks used for evaluation. This…

Machine Learning · Computer Science 2026-05-11 Pengrun Huang , Kamalika Chaudhuri , Yu-Xiang Wang

Large language models (LLMs) can be trained or fine-tuned on data obtained without the owner's consent. Verifying whether a specific LLM was trained on particular data instances or an entire dataset is extremely challenging. Dataset…

Computation and Language · Computer Science 2025-10-07 Eyal German , Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

Computation and Language · Computer Science 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

Large Language Models (LLMs) have experienced rapid advancements, with applications spanning a wide range of fields, including sentiment classification, review generation, and question answering. Due to their efficiency and versatility,…

Cryptography and Security · Computer Science 2025-06-17 Yugeng Liu , Tianshuo Cong , Michael Backes , Zheng Li , Yang Zhang

Watermarking has emerged as a promising way to detect LLM-generated text, by augmenting LLM generations with later detectable signals. Recent work has proposed multiple families of watermarking schemes, several of which focus on preserving…

Cryptography and Security · Computer Science 2025-02-25 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

Watermarking generative-AI systems, such as LLMs, has gained considerable interest, driven by their enhanced capabilities across a wide range of tasks. Although current approaches have demonstrated that small, context-dependent shifts in…

Computation and Language · Computer Science 2024-03-29 Piotr Molenda , Adian Liusie , Mark J. F. Gales

Watermarking is a technique that involves embedding nearly unnoticeable statistical signals within generated content to help trace its source. This work focuses on a scenario where an untrusted third-party user sends prompts to a trusted…

Machine Learning · Computer Science 2024-10-29 Xingchi Li , Guanxun Li , Xianyang Zhang