中文
相关论文

相关论文: Task-Agnostic Language Model Watermarking via High…

200 篇论文

Model watermarking techniques can embed watermark information into the protected model for ownership declaration by constructing specific input-output pairs. However, existing watermarks are easily removed when facing model stealing…

密码学与安全 · 计算机科学 2025-11-13 Yunfei Yang , Xiaojun Chen , Yuexin Xuan , Zhendong Zhao , Xin Zhao , He Li

Recent advances in the capabilities of large language models such as GPT-4 have spurred increasing concern about our ability to detect AI-generated text. Prior works have suggested methods of embedding watermarks in model outputs, by…

密码学与安全 · 计算机科学 2023-06-16 Miranda Christ , Sam Gunn , Or Zamir

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

计算与语言 · 计算机科学 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

Contrastive learning has become a popular technique to pre-train image encoders, which could be used to build various downstream classification models in an efficient way. This process requires a large amount of data and computation…

计算机视觉与模式识别 · 计算机科学 2022-01-21 Yutong Wu , Han Qiu , Tianwei Zhang , Jiwei L , Meikang Qiu

Due to costly efforts during data acquisition and model training, Deep Neural Networks (DNNs) belong to the intellectual property of the model creator. Hence, unauthorized use, theft, or modification may lead to legal repercussions.…

机器学习 · 计算机科学 2023-10-26 Torsten Krauß , Jasper Stang , Alexandra Dmitrienko

Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising method for addressing potential harm and biases from LLMs,…

密码学与安全 · 计算机科学 2024-12-09 Lingjie Chen , Ruizhong Qiu , Siyu Yuan , Zhining Liu , Tianxin Wei , Hyunsik Yoo , Zhichen Zeng , Deqing Yang , Hanghang Tong

Although deep neural networks have made tremendous progress in the area of multimedia representation, training neural models requires a large amount of data and time. It is well-known that utilizing trained models as initial weights often…

计算机视觉与模式识别 · 计算机科学 2018-02-09 Yuki Nagai , Yusuke Uchida , Shigeyuki Sakazawa , Shin'ichi Satoh

Watermarking has recently emerged as an effective strategy for detecting the outputs of large language models (LLMs). Most existing schemes require white-box access to the model's next-token probability distribution, which is typically not…

密码学与安全 · 计算机科学 2026-02-24 Dara Bahri , John Wieting

Triggerable watermarking enables model owners to assert ownership against model extraction attacks. However, most existing approaches require additional training, which limits post-deployment flexibility, and the lack of clear theoretical…

密码学与安全 · 计算机科学 2026-01-22 Yixiao Xu , Binxing Fang , Rui Wang , Yinghai Zhou , Yuan Liu , Mohan Li , Zhihong Tian

Large language models (LLMs) have demonstrated outstanding performance, making them valuable digital assets with significant commercial potential. Unfortunately, the LLM and its API are susceptible to intellectual property theft.…

密码学与安全 · 计算机科学 2024-07-25 Shuai Li , Kejiang Chen , Kunsheng Tang , Jie Zhang , Weiming Zhang , Nenghai Yu , Kai Zeng

Model watermarking utilizes internal representations to protect the ownership of large language models (LLMs). However, these features inevitably undergo complex distortions during realistic model modifications such as fine-tuning,…

密码学与安全 · 计算机科学 2026-03-20 Zikang Ding , Junhao Li , Suling Wu , Junchi Yao , Hongbo Liu , Lijie Hu

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

计算与语言 · 计算机科学 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

The rapid growth of transformer-based models increases the concerns about their integrity and ownership insurance. Watermarking addresses this issue by embedding a unique identifier into the model, while preserving its performance. However,…

密码学与安全 · 计算机科学 2024-01-19 Pierre Fernandez , Guillaume Couairon , Teddy Furon , Matthijs Douze

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

计算与语言 · 计算机科学 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

With the advancement of intelligent healthcare, medical pre-trained language models (Med-PLMs) have emerged and demonstrated significant effectiveness in downstream medical tasks. While these models are valuable assets, they are vulnerable…

机器学习 · 计算机科学 2025-04-16 Cong Kong , Rui Xu , Weixi Chen , Jiawei Chen , Zhaoxia Yin

Watermarking is the process of embedding information into an image that can survive under distortions, while requiring the encoded image to have little or no perceptual difference from the original image. Recently, deep learning-based…

多媒体 · 计算机科学 2020-01-15 Xiyang Luo , Ruohan Zhan , Huiwen Chang , Feng Yang , Peyman Milanfar

With the rise of Machine Learning as a Service (MLaaS) platforms,safeguarding the intellectual property of deep learning models is becoming paramount. Among various protective measures, trigger set watermarking has emerged as a flexible and…

密码学与安全 · 计算机科学 2024-04-23 Hongyu Zhu , Sichu Liang , Wentao Hu , Fangqi Li , Ju Jia , Shilin Wang

In this work, we introduce a novel deep learning-based approach to text-in-image watermarking, a method that embeds and extracts textual information within images to enhance data security and integrity. Leveraging the capabilities of deep…

多媒体 · 计算机科学 2024-04-23 Bishwa Karki , Chun-Hua Tsai , Pei-Chi Huang , Xin Zhong

The recent explosion of high-quality language models has necessitated new methods for identifying AI-generated text. Watermarking is a leading solution and could prove to be an essential tool in the age of generative AI. Existing approaches…

密码学与安全 · 计算机科学 2024-10-25 Miranda Christ , Sam Gunn , Tal Malkin , Mariana Raykova

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

机器学习 · 计算机科学 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto