中文
相关论文

相关论文: Cross-Attention Watermarking of Large Language Mod…

200 篇论文

Vision-language models demand watermarking solutions that protect intellectual property without compromising multimodal coherence. Existing text watermarking methods disrupt visual-textual alignment through biased token selection and static…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Shuliang Liu , Qi Zheng , Jesse Jiaxi Xu , Yibo Yan , Junyan Zhang , He Geng , Aiwei Liu , Peijie Jiang , Jia Liu , Yik-Cheung Tam , Xuming Hu

Watermarking technology is a method used to trace the usage of content generated by large language models. Sentence-level watermarking aids in preserving the semantic integrity within individual sentences while maintaining greater…

计算与语言 · 计算机科学 2025-04-25 Junyan Zhang , Shuliang Liu , Aiwei Liu , Yubo Gao , Jungang Li , Xiaojie Gu , Xuming Hu

As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse. Most detectors for identifying model-generated text are limited by their…

密码学与安全 · 计算机科学 2024-10-10 Zhenyu Xu , Victor S. Sheng

Watermarking language models is essential for distinguishing between human and machine-generated text and thus maintaining the integrity and trustworthiness of digital communication. We present a novel green/red list watermarking approach…

机器学习 · 统计学 2025-06-13 Yangxinyu Xie , Xiang Li , Tanwi Mallick , Weijie J. Su , Ruixun Zhang

We study the power of cross-attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross-attention when training from scratch. We conduct a series…

计算与语言 · 计算机科学 2021-09-15 Mozhdeh Gheini , Xiang Ren , Jonathan May

With the increasing use of large language models (LLMs) in daily life, concerns have emerged regarding their potential misuse and societal impact. Watermarking is proposed to trace the usage of specific models by injecting patterns into…

密码学与安全 · 计算机科学 2024-05-24 Baizhou Huang , Xiaojun Wan

The rapid development of LLMs has raised concerns about their potential misuse, leading to various watermarking schemes that typically offer high detectability. However, existing watermarking techniques often face trade-off between…

密码学与安全 · 计算机科学 2025-10-21 Chenrui Wang , Junyi Shu , Billy Chiu , Yu Li , Saleh Alharbi , Min Zhang , Jing Li

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

机器学习 · 统计学 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

In recent years, there has been significant advancement in the field of model watermarking techniques. However, the protection of image-processing neural networks remains a challenge, with only a limited number of methods being developed.…

密码学与安全 · 计算机科学 2023-02-20 Huajie Chen , Tianqing Zhu , Chi Liu , Shui Yu , Wanlei Zhou

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

机器学习 · 计算机科学 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer

Large language models (LLMs) have demonstrated outstanding performance, making them valuable digital assets with significant commercial potential. Unfortunately, the LLM and its API are susceptible to intellectual property theft.…

密码学与安全 · 计算机科学 2024-07-25 Shuai Li , Kejiang Chen , Kunsheng Tang , Jie Zhang , Weiming Zhang , Nenghai Yu , Kai Zeng

Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves…

机器学习 · 计算机科学 2024-06-07 Mingjia Huo , Sai Ashish Somayajula , Youwei Liang , Ruisi Zhang , Farinaz Koushanfar , Pengtao Xie

Watermarking is a technical means to dissuade malfeasant usage of Large Language Models. This paper proposes a novel watermarking scheme, so-called WaterMax, that enjoys high detectability while sustaining the quality of the generated text…

密码学与安全 · 计算机科学 2024-10-21 Eva Giboulot , Teddy Furon

Fine-tuning attacks are effective in removing the embedded watermarks in deep learning models. However, when the source data is unavailable, it is challenging to just erase the watermark without jeopardizing the model performance. In this…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Qi Zhong , Leo Yu Zhang , Shengshan Hu , Longxiang Gao , Jun Zhang , Yong Xiang

Large language models (LLMs) are widely deployed in multiple scenarios due to reasoning capabilities. In order to prevent the models from being misused, watermarking is generally employed to ensure ownership. However, most existing…

密码学与安全 · 计算机科学 2026-04-29 Ziming Zhang , Li Li , Guorui Feng , Hanzhou Wu , Xinpeng Zhang

Text content created by humans or language models is often stolen or misused by adversaries. Tracing text provenance can help claim the ownership of text content or identify the malicious users who distribute misleading content like…

密码学与安全 · 计算机科学 2021-12-16 Xi Yang , Jie Zhang , Kejiang Chen , Weiming Zhang , Zehua Ma , Feng Wang , Nenghai Yu

In this paper, we investigate the recent state-of-the-art schemes for watermarking large language models (LLMs) outputs. These techniques are claimed to be robust, scalable and production-grade, aimed at promoting responsible usage of LLMs.…

密码学与安全 · 计算机科学 2026-05-11 Jonathan Hong Jin Ng , Anh Tu Ngo , Anupam Chattopadhyay

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect…

Large Language Models (LLMs) excel in various applications, including text generation and complex tasks. However, the misuse of LLMs raises concerns about the authenticity and ethical implications of the content they produce, such as…

密码学与安全 · 计算机科学 2024-12-02 Zesen Liu , Tianshuo Cong , Xinlei He , Qi Li

A recent watermarking scheme for language models achieves distortion-free embedding and robustness to edit-distance attacks. However, it suffers from limited generation diversity and high detection overhead. In parallel, recent research has…

密码学与安全 · 计算机科学 2025-12-12 Yangkun Wang , Jingbo Shang