English
Related papers

Related papers: On the Learnability of Watermarks for Language Mod…

200 papers

Large language model (LLM) unlearning is critical in real-world applications where it is necessary to efficiently remove the influence of private, copyrighted, or harmful data from some users. Existing utility-centric unlearning metrics…

While watermarks for closed LLMs have matured and have been included in large-scale deployments, these methods are not applicable to open-source models, which allow users full control over the decoding process. This setting is understudied…

Cryptography and Security · Computer Science 2025-02-18 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

As artificial intelligence surpasses human capabilities in text generation, the necessity to authenticate the origins of AI-generated content has become paramount. Unbiased watermarks offer a powerful solution by embedding statistical…

Computation and Language · Computer Science 2025-08-07 Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

Computation and Language · Computer Science 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

Neural approaches to ranking based on pre-trained language models are highly effective in ad-hoc search. However, the computational expense of these models can limit their application. As such, a process known as knowledge distillation is…

Information Retrieval · Computer Science 2024-11-05 Vishakha Suresh Kalal , Andrew Parry , Sean MacAvaney

Large language models (LLMs) can be trained or fine-tuned on data obtained without the owner's consent. Verifying whether a specific LLM was trained on particular data instances or an entire dataset is extremely challenging. Dataset…

Computation and Language · Computer Science 2025-10-07 Eyal German , Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

The burgeoning complexity of contemporary deep learning models, while achieving unparalleled accuracy, has inadvertently introduced deployment challenges in resource-constrained environments. Knowledge distillation, a technique aiming to…

Machine Learning · Computer Science 2023-10-05 Sia Gholami , Marwan Omar

The growing use of large language models (LLMs) for sensitive applications has highlighted the need for effective watermarking techniques to ensure the provenance and accountability of AI-generated text. However, most existing watermarking…

Computation and Language · Computer Science 2026-04-07 Yepeng Liu , Xuandong Zhao , Christopher Kruegel , Dawn Song , Yuheng Bu

Recent advancements in large language models (LLMs) have highlighted the risk of misusing them, raising the need for accurate detection of LLM-generated content. In response, a viable solution is to inject imperceptible identifiers into…

Computation and Language · Computer Science 2025-02-11 Minjia Mao , Dongjun Wei , Zeyu Chen , Xiao Fang , Michael Chau

Machine learning models are being used in an increasing number of critical applications; thus, securing their integrity and ownership is critical. Recent studies observed that adversarial training and watermarking have a conflicting…

Machine Learning · Computer Science 2024-01-09 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

The effectiveness of watermark algorithms in AI-generated text identification has garnered significant attention. Concurrently, an increasing number of watermark algorithms have been proposed to enhance the robustness against various…

Cryptography and Security · Computer Science 2024-10-01 Xianheng Feng , Jian Liu , Kui Ren , Chun Chen

Watermarking combines an imperceptible change to an input image that will trigger a detector, to assert provenance and protect intellectual property. The literature has shown great interest in attacks on watermarking schemes: attackers are…

Cryptography and Security · Computer Science 2026-05-19 Maria Bulychev , Neil G. Marchant , Benjamin I. P. Rubinstein

Text watermarks in large language models (LLMs) are increasingly used to detect synthetic text, mitigating misuse cases like fake news and academic dishonesty. While existing watermarking detection techniques primarily focus on classifying…

Computation and Language · Computer Science 2025-06-13 Xuandong Zhao , Chenwen Liao , Yu-Xiang Wang , Lei Li

The performance of autoregressive models on natural language generation tasks has dramatically improved due to the adoption of deep, self-attentive architectures. However, these gains have come at the cost of hindering inference speed,…

Computation and Language · Computer Science 2020-10-30 Alexander Lin , Jeremy Wohlwend , Howard Chen , Tao Lei

As large language models (LLMs) generate texts with increasing fluency and realism, there is a growing need to identify the source of texts to prevent the abuse of LLMs. Text watermarking techniques have proven reliable in distinguishing…

Computation and Language · Computer Science 2024-04-04 Lean Wang , Wenkai Yang , Deli Chen , Hao Zhou , Yankai Lin , Fandong Meng , Jie Zhou , Xu Sun

Generative image modeling enables a wide range of applications but raises ethical concerns about responsible deployment. This paper introduces an active strategy combining image watermarking and Latent Diffusion Models. The goal is for all…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Pierre Fernandez , Guillaume Couairon , Hervé Jégou , Matthijs Douze , Teddy Furon

Robust invisible watermarks are widely used to support copyright protection, content provenance, and accountability by embedding hidden signals designed to survive common post-processing operations. However, diffusion-based image editing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Qian Qi , Jiangyun Tang , Jim Lee , Emily Davis , Finn Carter

Machine learning involves expensive data collection and training procedures. Model owners may be concerned that valuable intellectual property can be leaked if adversaries mount model extraction attacks. As it is difficult to defend against…

Cryptography and Security · Computer Science 2021-02-22 Hengrui Jia , Christopher A. Choquette-Choo , Varun Chandrasekaran , Nicolas Papernot

Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves…

Machine Learning · Computer Science 2024-06-07 Mingjia Huo , Sai Ashish Somayajula , Youwei Liang , Ruisi Zhang , Farinaz Koushanfar , Pengtao Xie

Generative models have enabled easy creation and generation of images of all kinds given a single prompt. However, this has also raised ethical concerns about what is an actual piece of content created by humans or cameras compared to…

Cryptography and Security · Computer Science 2024-12-31 Aryaman Shaan , Garvit Banga , Raghav Mantri