English
Related papers

Related papers: Towards Watermarking of Open-Source LLMs

200 papers

Large Language Models (LLMs) are distinguished by their architecture, which dictates their parameter size and performance capabilities. Social scientists have increasingly adopted LLMs for text classification tasks, which are difficult to…

Computation and Language · Computer Science 2024-11-05 Marcello Carammia , Stefano Maria Iacus , Giuseppe Porro

Watermarking is a tool for actively identifying and attributing the images generated by latent diffusion models. Existing methods face the dilemma of image quality and watermark robustness. Watermarks with superior image quality usually…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zheling Meng , Bo Peng , Jing Dong

We study the problem of multi-bit watermarking for large language models (LLMs). We introduce a block-autoregressive model inspired by multi-token prediction, in which the encoder has limited non-causal access to token distributions within…

Information Theory · Computer Science 2026-05-19 Sidong Guo , Tyler Kann , Teodora Baluta , Matthieu R. Bloch

Large language models (LLMs) have become essential tools in software development, widely used for requirements engineering, code generation and review tasks. Software engineers often rely on LLMs to verify if code implementation satisfy…

Software Engineering · Computer Science 2026-03-03 Haolin Jin , Huaming Chen

Recent advances in large language models have raised wide concern in generating abundant plausible source code without scrutiny, and thus tracing the provenance of code emerges as a critical issue. To solve the issue, we propose CodeMark, a…

Cryptography and Security · Computer Science 2023-05-23 Wei Li , Borui Yang , Yujie Sun , Suyu Chen , Ziyun Song , Liyao Xiang , Xinbing Wang , Chenghu Zhou

The effectiveness of watermark algorithms in AI-generated text identification has garnered significant attention. Concurrently, an increasing number of watermark algorithms have been proposed to enhance the robustness against various…

Cryptography and Security · Computer Science 2024-10-01 Xianheng Feng , Jian Liu , Kui Ren , Chun Chen

We present a publicly-detectable watermarking scheme for LMs: the detection algorithm contains no secret information, and it is executable by anyone. We embed a publicly-verifiable cryptographic signature into LM output using rejection…

Machine Learning · Computer Science 2025-01-07 Jaiden Fairoze , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Mingyuan Wang

Large language models generate high-quality responses with potential misinformation, underscoring the need for regulation by distinguishing AI-generated and human-written texts. Watermarking is pivotal in this context, which involves…

Machine Learning · Computer Science 2024-06-07 Mingjia Huo , Sai Ashish Somayajula , Youwei Liang , Ruisi Zhang , Farinaz Koushanfar , Pengtao Xie

Watermarking is a commonly used strategy to protect creators' rights to digital images, videos and audio. Recently, watermarking methods have been extended to deep learning models -- in principle, the watermark should be preserved when an…

The advent of instruction-tuned Large Language Models designed for coding tasks (Code LLMs) has transformed software engineering practices. However, their robustness against various input challenges remains a critical concern. This study…

Software Engineering · Computer Science 2024-12-02 Md Imran Hossen , Xiali Hei

With the growth of editing and sharing images through the internet, the importance of protecting the images' authorship has increased. Robust watermarking is a known approach to maintaining copyright protection. Robustness and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Arezoo PariZanganeh , Ghazaleh Ghorbanzadeh , Zahra Nabizadeh ShahreBabak , Nader Karimi , Shadrokh Samavi

We propose an imperceptible multi-bit text watermark embedded by paraphrasing with LLMs. We fine-tune a pair of LLM paraphrasers that are designed to behave differently so that their paraphrasing difference reflected in the text semantics…

Artificial Intelligence · Computer Science 2025-06-18 Xiaojun Xu , Jinghan Jia , Yuanshun Yao , Yang Liu , Hang Li

The rapid growth of Large Language Models (LLMs) raises concerns about distinguishing AI-generated text from human content. Existing watermarking techniques, like \kgw, struggle with low watermark strength and stringent false-positive…

Machine Learning · Computer Science 2025-05-22 Zhuang Li , Qiuping Yi , Zongcheng Ji , Yijian Lu , Yanqi Li , Keyang Xiao , Hongliang Liang

Large Language Models (LLMs) have demonstrated impressive capabilities in generating diverse and contextually rich text. However, concerns regarding copyright infringement arise as LLMs may inadvertently produce copyrighted material. In…

Large Language Models (LLMs) are widely used in complex natural language processing tasks but raise privacy and security concerns due to the lack of identity recognition. This paper proposes a multi-party credible watermarking framework…

Artificial Intelligence · Computer Science 2025-09-17 Haoyu Jiang , Xuhong Wang , Ping Yi , Shanzhe Lei , Yilun Lin

Recent advances of large language models in the field of Verilog generation have raised several ethical and security concerns, such as code copyright protection and dissemination of malicious code. Researchers have employed watermarking…

Cryptography and Security · Computer Science 2025-01-07 Kun Wang , Kaiyan Chang , Mengdi Wang , Xinqi Zou , Haobo Xu , Yinhe Han , Ying Wang

Large language models (LLMs) and transformer-based architectures are increasingly utilized for source code analysis. As software systems grow in complexity, integrating LLMs into code analysis workflows becomes essential for enhancing…

Software Engineering · Computer Science 2025-03-25 Hamed Jelodar , Mohammad Meymani , Roozbeh Razavi-Far

As large language models (LLMs) are increasingly deployed for text generation, watermarking has become essential for authorship attribution, intellectual property protection, and misuse detection. While existing watermarking methods perform…

Computation and Language · Computer Science 2026-01-09 Amit Bin Tariqul , A N M Zahid Hossain Milkan , Sahab-Al-Chowdhury , Syed Rifat Raiyan , Hasan Mahmud , Md Kamrul Hasan

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models (LMs). However, the robustness of the watermarking schemes has not been…

Computation and Language · Computer Science 2025-07-04 Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang

The radioactive nature of Large Language Model (LLM) watermarking enables the detection of watermarks inherited by student models when trained on the outputs of watermarked teacher models, making it a promising tool for preventing…

Computation and Language · Computer Science 2025-05-27 Leyi Pan , Aiwei Liu , Shiyu Huang , Yijian Lu , Xuming Hu , Lijie Wen , Irwin King , Philip S. Yu