English
Related papers

Related papers: Watermarking Pre-trained Language Models with Back…

200 papers

Large Language Models (LLMs) are increasingly integrated into diverse industries, posing substantial security risks due to unauthorized replication and misuse. To mitigate these concerns, robust identification mechanisms are widely…

Cryptography and Security · Computer Science 2024-07-25 Xuhong Wang , Haoyu Jiang , Yi Yu , Jingru Yu , Yilun Lin , Ping Yi , Yingchun Wang , Yu Qiao , Li Li , Fei-Yue Wang

To mitigate the potential harms of Large Language Models (LLMs)generated text, researchers have proposed watermarking, a process of embedding detectable signals within text. With watermarking, we can always accurately detect LLM-generated…

Computation and Language · Computer Science 2025-11-19 William Guo , Adaku Uchendu , Ana Smith

With the rapid advancement and extensive application of artificial intelligence technology, large language models (LLMs) are extensively used to enhance production, creativity, learning, and work efficiency across various domains. However,…

Cryptography and Security · Computer Science 2024-09-04 Yuqing Liang , Jiancheng Xiao , Wensheng Gan , Philip S. Yu

Recent advances in vision-language pre-trained models (VLPs) have significantly increased visual understanding and cross-modal analysis capabilities. Companies have emerged to provide multi-modal Embedding as a Service (EaaS) based on VLPs…

Cryptography and Security · Computer Science 2023-11-13 Yuanmin Tang , Jing Yu , Keke Gai , Xiangyan Qu , Yue Hu , Gang Xiong , Qi Wu

To support various applications, a prevalent and efficient approach for business owners is leveraging their valuable datasets to fine-tune a pre-trained LLM through the API provided by LLM owners or cloud servers. However, this process…

Cryptography and Security · Computer Science 2024-06-06 Shen Li , Liuyi Yao , Jinyang Gao , Lan Zhang , Yaliang Li

Large Language Models (LLMs) have demonstrated remarkable capabilities, but their training requires extensive data and computational resources, rendering them valuable digital assets. Therefore, it is essential to watermark LLMs to protect…

Cryptography and Security · Computer Science 2025-10-21 Shuai Li , Kejiang Chen , Jun Jiang , Jie Zhang , Qiyi Yao , Kai Zeng , Weiming Zhang , Nenghai Yu

Large Language Models (LLMs) have transformed natural language processing, demonstrating impressive capabilities across diverse tasks. However, deploying these models introduces critical risks related to intellectual property violations and…

Cryptography and Security · Computer Science 2025-12-24 Kieu Dang , Phung Lai , NhatHai Phan , Yelong Shen , Ruoming Jin , Abdallah Khreishah , My T. Thai

Given a text, can we determine whether it was generated by a large language model (LLM) or by a human? A widely studied approach to this problem is watermarking. We propose an undetectable and elementary watermarking scheme in the closed…

Cryptography and Security · Computer Science 2025-06-26 Pedro Abdalla , Roman Vershynin

Text watermarking for Large Language Models (LLMs) has made significant progress in detecting LLM outputs and preventing misuse. Current watermarking techniques offer high detectability, minimal impact on text quality, and robustness to…

Cryptography and Security · Computer Science 2025-01-29 Aiwei Liu , Sheng Guan , Yiming Liu , Leyi Pan , Yifei Zhang , Liancheng Fang , Lijie Wen , Philip S. Yu , Xuming Hu

Large Language Models (LLMs) excel in various applications, including text generation and complex tasks. However, the misuse of LLMs raises concerns about the authenticity and ethical implications of the content they produce, such as…

Cryptography and Security · Computer Science 2024-12-02 Zesen Liu , Tianshuo Cong , Xinlei He , Qi Li

Large pre-trained language models (PLMs) have demonstrated strong performance on natural language understanding (NLU) tasks through fine-tuning. However, fine-tuned models still suffer from overconfident predictions, especially in…

Computation and Language · Computer Science 2023-05-31 Guande He , Jianfei Chen , Jun Zhu

The huge supporting training data on the Internet has been a key factor in the success of deep learning models. However, this abundance of public-available data also raises concerns about the unauthorized exploitation of datasets for…

Cryptography and Security · Computer Science 2023-04-11 Ruixiang Tang , Qizhang Feng , Ninghao Liu , Fan Yang , Xia Hu

In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on…

Cryptography and Security · Computer Science 2024-05-03 Minhao Bai , Kaiyi Pang , Yongfeng Huang

The indistinguishability of large language model (LLM) output from human-authored content poses significant challenges, raising concerns about potential misuse of AI-generated text and its influence on future model training. Watermarking…

Cryptography and Security · Computer Science 2026-04-16 Alexander Nemecek , Yuzhou Jiang , Erman Ayday

Contrastive learning has become a popular technique to pre-train image encoders, which could be used to build various downstream classification models in an efficient way. This process requires a large amount of data and computation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Yutong Wu , Han Qiu , Tianwei Zhang , Jiwei L , Meikang Qiu

Watermarking the outputs of large language models (LLMs) is critical for provenance tracing, content regulation, and model accountability. Existing approaches often rely on access to model internals or are constrained by static rules and…

Machine Learning · Computer Science 2025-06-23 Agnibh Dasgupta , Abdullah Tanvir , Xin Zhong

Large Language Models (LLMs) have demonstrated impressive capabilities in generating diverse and contextually rich text. However, concerns regarding copyright infringement arise as LLMs may inadvertently produce copyrighted material. In…

The recent advancements in large language models (LLMs) have sparked a growing apprehension regarding the potential misuse. One approach to mitigating this risk is to incorporate watermarking techniques into LLMs, allowing for the tracking…

Cryptography and Security · Computer Science 2023-10-19 Zhengmian Hu , Lichang Chen , Xidong Wu , Yihan Wu , Hongyang Zhang , Heng Huang

Detecting machine-generated text is essential for transparency and accountability when deploying large language models (LLMs). Among detection approaches, watermarking is a statistically reliable method by design -- it embeds detectable…

Computation and Language · Computer Science 2026-05-05 Koshiro Saito , Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

Machine Learning · Computer Science 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer