中文
相关论文

相关论文: Towards Watermarking of Open-Source LLMs

200 篇论文

Securing digital text is becoming increasingly relevant due to the widespread use of large language models. Individuals' fear of losing control over data when it is being used to train such machine learning models or when distinguishing…

密码学与安全 · 计算机科学 2025-12-16 Malte Hellmeier

The rapid growth of Large Language Models (LLMs) has highlighted the pressing need for reliable mechanisms to verify content ownership and ensure traceability. Watermarking offers a promising path forward, but it remains limited by privacy…

密码学与安全 · 计算机科学 2026-01-21 Thomas Fargues , Ye Dong , Tianwei Zhang , Jin-Song Dong

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

机器学习 · 计算机科学 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto

Watermarking has emerged as a promising technique to track AI-generated content and differentiate it from authentic human creations. While prior work extensively studies watermarking for autoregressive large language models (LLMs) and image…

密码学与安全 · 计算机科学 2026-02-16 Avi Bagchi , Akhil Bhimaraju , Moulik Choraria , Daniel Alabi , Lav R. Varshney

The vast amounts of digital content captured from the real world or AI-generated media necessitate methods for copyright protection, traceability, or data provenance verification. Digital watermarking serves as a crucial approach to address…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Vitaliy Kinakh , Brian Pulfer , Yury Belousov , Pierre Fernandez , Teddy Furon , Slava Voloshynovskiy

In recent years, large language models (LLMs) have achieved remarkable performances in various NLP tasks. They can generate texts that are indistinguishable from those written by humans. Such remarkable performance of LLMs increases their…

计算与语言 · 计算机科学 2025-02-18 Yuki Takezawa , Ryoma Sato , Han Bao , Kenta Niwa , Makoto Yamada

Watermarking generative-AI systems, such as LLMs, has gained considerable interest, driven by their enhanced capabilities across a wide range of tasks. Although current approaches have demonstrated that small, context-dependent shifts in…

计算与语言 · 计算机科学 2024-03-29 Piotr Molenda , Adian Liusie , Mark J. F. Gales

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily…

密码学与安全 · 计算机科学 2025-03-04 Yuhang Cai , Yaofei Wang , Donghui Hu , Chen Gu

The rapid growth of transformer-based models increases the concerns about their integrity and ownership insurance. Watermarking addresses this issue by embedding a unique identifier into the model, while preserving its performance. However,…

密码学与安全 · 计算机科学 2024-01-19 Pierre Fernandez , Guillaume Couairon , Teddy Furon , Matthijs Douze

The impressive performances of Large Language Models (LLMs) and their immense potential for commercialization have given rise to serious concerns over the Intellectual Property (IP) of their training data. In particular, the synthetic texts…

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

密码学与安全 · 计算机科学 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

计算与语言 · 计算机科学 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang

Watermarking is a technique that involves embedding nearly unnoticeable statistical signals within generated content to help trace its source. This work focuses on a scenario where an untrusted third-party user sends prompts to a trusted…

机器学习 · 计算机科学 2024-10-29 Xingchi Li , Guanxun Li , Xianyang Zhang

Recent advances in the capabilities of large language models such as GPT-4 have spurred increasing concern about our ability to detect AI-generated text. Prior works have suggested methods of embedding watermarks in model outputs, by…

密码学与安全 · 计算机科学 2023-06-16 Miranda Christ , Sam Gunn , Or Zamir

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

密码学与安全 · 计算机科学 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

The growing use of large language models (LLMs) for sensitive applications has highlighted the need for effective watermarking techniques to ensure the provenance and accountability of AI-generated text. However, most existing watermarking…

计算与语言 · 计算机科学 2026-04-07 Yepeng Liu , Xuandong Zhao , Christopher Kruegel , Dawn Song , Yuheng Bu

We investigate the radioactivity of text generated by large language models (LLM), i.e. whether it is possible to detect that such synthetic input was used to train a subsequent LLM. Current methods like membership inference or active IP…

密码学与安全 · 计算机科学 2024-10-29 Tom Sander , Pierre Fernandez , Alain Durmus , Matthijs Douze , Teddy Furon

With the widespread adoption of Large Language Models (LLMs), concerns about potential misuse have emerged. To this end, watermarking has been adapted to LLM, enabling a simple and effective way to detect and monitor generated text.…

密码学与安全 · 计算机科学 2024-07-22 Duy C. Hoang , Hung T. Q. Le , Rui Chu , Ping Li , Weijie Zhao , Yingjie Lao , Khoa D. Doan

Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused…

密码学与安全 · 计算机科学 2025-02-14 Karl Tamberg , Hayretdin Bahsi

Large language models (LLMs) are increasingly integrated into academic workflows, with many conferences and journals permitting their use for tasks such as language refinement and literature summarization. However, their use in peer review…

密码学与安全 · 计算机科学 2025-11-13 Alexander Nemecek , Yuzhou Jiang , Erman Ayday