English
Related papers

Related papers: Task-Agnostic Language Model Watermarking via High…

200 papers

Model watermarking techniques can embed watermark information into the protected model for ownership declaration by constructing specific input-output pairs. However, existing watermarks are easily removed when facing model stealing…

Cryptography and Security · Computer Science 2025-11-13 Yunfei Yang , Xiaojun Chen , Yuexin Xuan , Zhendong Zhao , Xin Zhao , He Li

Recent advances in the capabilities of large language models such as GPT-4 have spurred increasing concern about our ability to detect AI-generated text. Prior works have suggested methods of embedding watermarks in model outputs, by…

Cryptography and Security · Computer Science 2023-06-16 Miranda Christ , Sam Gunn , Or Zamir

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

Computation and Language · Computer Science 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

Contrastive learning has become a popular technique to pre-train image encoders, which could be used to build various downstream classification models in an efficient way. This process requires a large amount of data and computation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Yutong Wu , Han Qiu , Tianwei Zhang , Jiwei L , Meikang Qiu

Due to costly efforts during data acquisition and model training, Deep Neural Networks (DNNs) belong to the intellectual property of the model creator. Hence, unauthorized use, theft, or modification may lead to legal repercussions.…

Machine Learning · Computer Science 2023-10-26 Torsten Krauß , Jasper Stang , Alexandra Dmitrienko

Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising method for addressing potential harm and biases from LLMs,…

Cryptography and Security · Computer Science 2024-12-09 Lingjie Chen , Ruizhong Qiu , Siyu Yuan , Zhining Liu , Tianxin Wei , Hyunsik Yoo , Zhichen Zeng , Deqing Yang , Hanghang Tong

Although deep neural networks have made tremendous progress in the area of multimedia representation, training neural models requires a large amount of data and time. It is well-known that utilizing trained models as initial weights often…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Yuki Nagai , Yusuke Uchida , Shigeyuki Sakazawa , Shin'ichi Satoh

Watermarking has recently emerged as an effective strategy for detecting the outputs of large language models (LLMs). Most existing schemes require white-box access to the model's next-token probability distribution, which is typically not…

Cryptography and Security · Computer Science 2026-02-24 Dara Bahri , John Wieting

Triggerable watermarking enables model owners to assert ownership against model extraction attacks. However, most existing approaches require additional training, which limits post-deployment flexibility, and the lack of clear theoretical…

Cryptography and Security · Computer Science 2026-01-22 Yixiao Xu , Binxing Fang , Rui Wang , Yinghai Zhou , Yuan Liu , Mohan Li , Zhihong Tian

Large language models (LLMs) have demonstrated outstanding performance, making them valuable digital assets with significant commercial potential. Unfortunately, the LLM and its API are susceptible to intellectual property theft.…

Cryptography and Security · Computer Science 2024-07-25 Shuai Li , Kejiang Chen , Kunsheng Tang , Jie Zhang , Weiming Zhang , Nenghai Yu , Kai Zeng

Model watermarking utilizes internal representations to protect the ownership of large language models (LLMs). However, these features inevitably undergo complex distortions during realistic model modifications such as fine-tuning,…

Cryptography and Security · Computer Science 2026-03-20 Zikang Ding , Junhao Li , Suling Wu , Junchi Yao , Hongbo Liu , Lijie Hu

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

Computation and Language · Computer Science 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

The rapid growth of transformer-based models increases the concerns about their integrity and ownership insurance. Watermarking addresses this issue by embedding a unique identifier into the model, while preserving its performance. However,…

Cryptography and Security · Computer Science 2024-01-19 Pierre Fernandez , Guillaume Couairon , Teddy Furon , Matthijs Douze

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

Computation and Language · Computer Science 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

With the advancement of intelligent healthcare, medical pre-trained language models (Med-PLMs) have emerged and demonstrated significant effectiveness in downstream medical tasks. While these models are valuable assets, they are vulnerable…

Machine Learning · Computer Science 2025-04-16 Cong Kong , Rui Xu , Weixi Chen , Jiawei Chen , Zhaoxia Yin

Watermarking is the process of embedding information into an image that can survive under distortions, while requiring the encoded image to have little or no perceptual difference from the original image. Recently, deep learning-based…

Multimedia · Computer Science 2020-01-15 Xiyang Luo , Ruohan Zhan , Huiwen Chang , Feng Yang , Peyman Milanfar

With the rise of Machine Learning as a Service (MLaaS) platforms,safeguarding the intellectual property of deep learning models is becoming paramount. Among various protective measures, trigger set watermarking has emerged as a flexible and…

Cryptography and Security · Computer Science 2024-04-23 Hongyu Zhu , Sichu Liang , Wentao Hu , Fangqi Li , Ju Jia , Shilin Wang

In this work, we introduce a novel deep learning-based approach to text-in-image watermarking, a method that embeds and extracts textual information within images to enhance data security and integrity. Leveraging the capabilities of deep…

Multimedia · Computer Science 2024-04-23 Bishwa Karki , Chun-Hua Tsai , Pei-Chi Huang , Xin Zhong

The recent explosion of high-quality language models has necessitated new methods for identifying AI-generated text. Watermarking is a leading solution and could prove to be an essential tool in the age of generative AI. Existing approaches…

Cryptography and Security · Computer Science 2024-10-25 Miranda Christ , Sam Gunn , Tal Malkin , Mariana Raykova

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

Machine Learning · Computer Science 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto